Evolutionary and greedy exploration of the space of decision trees

• Autorzy: Biedrzycki R. , Arabas J.
• Konferencja: Evolutionary Computation and Global Optimization 2006 / National Conference (9 ; 31.05-2.06.2006 ; Murzasichle, Poland)
• Języki publikacji: EN

Abstrakty

EN

This paper addresses the issue of the decision trees induction. We define the space of all possible trees and try to find good trees by searching that space. We compare performance of an evolutionary algorithm and standard, problem-specific algorithms (ID3, C4.5).

Słowa kluczowe

EN

decision tree; evolutionary algorithm; EA; greedy algorithm; optimization

PL

drzewo decyzyjne; algorytm ewolucyjny; algorytm zachłanny; optymalizacja

• Wydawca: Oficyna Wydawnicza Politechniki Warszawskiej
• Czasopismo: Prace Naukowe Politechniki Warszawskiej. Elektronika
• Rocznik: 2006
• Tom: z. 156
• Strony: 61--68
• Opis fizyczny: Bibliogr. 15 poz., tab., rys.

Twórcy

autor

Biedrzycki R.

autor

Arabas J.

• Warsaw University of Technology, Institute of Electronic Systems, Warsaw, Poland,

Bibliografia

• [1] Orange homepage. http://www.ailab.si/orange/datasets/
• [2] Blai Bonet and Héctor Geffner. Planning as heuristic search: New results. In ECP, pages 360-372, 1999.
• [3] Martijn Bot. Application of genetic programming to induction of linear classification trees. Technical report, Vrije Universiteit, Faculteit der Wiskunde en Informatica, November 1999.
• [4] Erick Cantú-Paz and Chandrika Kamath. Inducing oblique decision trees with evolutionary algorithms. IEEE Transactions on Evolutionary Computation, 7(1), February 2003.
• [5] Paweł Cichosz. Systemy uczące się. WNT, 2000.
• [6] Jeroen Eggermont, Joost N. Kok and Walter A. Kosters. Genetic programming for data classification: Partitioning the search space. In SAC'OA, Nicosia, Cyprus, 14-17 March 2004.
• [7] Richard E. Korf. Artificial intelligence search algorithms. In Algorithms and Theory of Computation Handbook. CRC Press, 1999.
• [8] Jacek Koronacki and Jan Ćwik. Statystyczne systemy uczące się. WNT, 2005.
• [9] John R. Koza. Concept formation and decision tree induction using the genetic programming paradigm. In H.P. Schwefel and R. Männer, editors, Parallel Problem Solving from Nature - Proceedings of 1st Workshop, PPSN 1, volume 496, pages 124-128, Dortmund, Germany, 1-3 1991. Springer-Verlag, Berlin, Germany.
• [10] Tom M. Mitchell. Generalization as search. Artificial Intelligence, 18:203-226, 1982.
• [11] D.J. Newman, S. Hettich, C.L. Blake and C.J. Merz. UCI repository of machine learning databases, 1998. http://www.ics.uci.edu/~mlearn/MLRepository.html
• [12] Athanasios Papagelis and Dimitris Kalles. GATree: Genetically evolved decision trees. In ICTAI'00, page 203. IEEE, November 2000.
• [13] John Ross Quinlan. Induction of decision trees. Machine Learning, 1:81-106, 1986.
• [14] Lior Rokach and Oded Maimon. Top-down induction of decision trees classifiers - a survey. IEEE Transactions on systems, man and cybernetics - part C: applications and reviews, 35(4), November 2005.
• [15] Ian H. Witten and Eibe Frank. Data mining: practical machine learning tools and technigues with Java implementations. Morgan Kaufmann, 2000.