The edited nearest neighbor rule based on the reduced reference set and the consistency criterion

• Autorzy: Raniszewski M.
• Języki publikacji: EN

Abstrakty

EN

In this paper a new editing procedure for the Nearest Neighbor Rule (NN) is presented. The representativeness measure is introduced and used to choose the most representative samples of the classes. These samples constitute a reduced reference set. An edited reference set is created from all the training set samples (including samples from the reduced set), which are correctly classified by the NN rule operating with the reduced set. The performance of the presented method is evaluated and compared with five other well-known editing techniques, on five medical datasets.

Słowa kluczowe

EN

editing techniques; nearest neighbour rule; consistency criterion; reference set reduction; representativeness measure

PL

technika edycji; reguła najbliższego sąsiada; kryterium zgodności; redukcja zbioru odniesienia

• Wydawca: Nałęcz Institute of Biocybernetics and Biomedical Engineering of the Polish Academy of Sciences ; Elsevier
• Czasopismo: Biocybernetics and Biomedical Engineering
• Rocznik: 2010
• Tom: Vol. 30, no. 1
• Strony: 31--40
• Opis fizyczny: Bibliogr. 14 poz., rys., tab., wykr.

Twórcy

autor

Raniszewski M.

• Technical University of Łódź, Computer Engineering Departament, ul. Stefanowskiego 18/22, 90-924 Łódź,

Bibliografia

• 1. Duda R.O., Hart P.E., Stork D.G.: Pattern Classification - Second Edition. John Wiley & Sons, Inc, 2001.
• 2. Theodoridis S., Koutroumbas K.: Pattern Recognition - Third Edition. Academic Press - Elsevier, USA, 2006.
• 3. Fix E., Hodges J.L.: Discriminatory analysis - nonparametric discrimination: Consistency properties. Project 21-49-004, Report No. 4, USAF School of Aviation Medicine, Randolph Field, TX, USA, 1951, 261-279.
• 4. Fix E., Hodges J.L.: Discriminatory analysis - nonparametric discrimination: Small sample performance. Project 21-49-004, Report No. 11, USAF School of Aviation Medicine, Randolph Field, TX, USA, 1952, 280-322.
• 5. Cover T.M., Hart P.E.: Nearest neighbor pattern classification. IEEE Trans. Inform. Theory, 1967, IT-13, 21-27.
• 6. Wilson D.L.: Asymptotic properties of nearest neighbor rules using edited data. IEEE Trans. On Systems, Man and Cybern., 1972, 2, 408-421.
• 7. Tomek I.: An Experiment with the edited nearest-neighbor rule. IEEE Transactions on Systems, Man, and Cybernetics, 1976, SMC-6, 6, 448-452.
• 8. Devijver P.A., Kittler J.: On the edited nearest neighbor rule. Proc. 5th Internat. Conf. Pattern Recognition, 1980, 72-80.
• 9. Kuncheva L.I.: Editing for the k-nearest neighbors rule by a genetic algorithm. Pattern Recognition Letters, 1995, 16, 809-814.
• 10. Raniszewski M.: Reference set reduction algorithms based on double sorting. Computer Recognition Systems 2: 5th International Conference on Computer Recognition Systems CORES'07, Springer-Verlag, Berlin-Heidelberg, 2007, 258-265.
• 11. Kohavi R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. Proc. 14th Int. Joint Conf. Artificial Intelligence, 1995, 338-345.
• 12. Hart P.E.: The condensed nearest neighbor rule. IEEE Transactions on Information Theory, 1968, IT-14, 3, 515-516.
• 13. Asuncion A., Newman, D.J.: UCI Machine Learning Repository [http://www.ics.uci.edu/~mlearn/ MLRepository.html]. Irvine, CA: University of California, School of Information and Computer Science, 2007.
• 14. Nakai K., Kanehisa M.: Expert System for Predicting Protein Localization Sites in Gram-Negative Bacteria. PROTEINS: Structure, Function, and Genetics 1991, 11, 95-110.