Hyperplane Aggregation of Dominance Decision Rules

• Autorzy: Pindur R. , Susmaga R. , Stefanowski J.
• Konferencja: International Conference on Soft Computing and Distributed Processing (SCDP'2002) (June 2002, Rzeszów, Poland).
• Języki publikacji: EN

Abstrakty

EN

In this paper we consider multiple criteria decision aid systems based on decision rules generated from examples. A common problem in such systems is the over-abundance of decision rules, as in many situations the rule generation algorithms produce very large sets of rules. This prolific representation of knowledge provides a great deal of detailed information about the described objects, but is appropriately difficult to interpret and use. One way of solving this problem is to aggregate the created rules into more general ones, e.g. by forming rules of enriched syntax. The paper presents a generalization of elementary rule conditions into linear combinations. This corresponds to partitioning the preference-ordered condition space of criteria with non-orthogonal hyperplanes. The objective of this paper is to introduce the generalized rules into the multiple criteria classification problems and to demonstrate that these problems can be successfully solved using the introduced rules. The usefulness of the introduced solution is finally demonstrated in computational experiments with real-life data sets.

Słowa kluczowe

EN

rough sets; knowledge discovery and representation; rule induction

• Wydawca: IOS Press
• Czasopismo: Fundamenta Informaticae
• Rocznik: 2004
• Tom: Vol. 61, nr 2
• Strony: 117--137
• Opis fizyczny: Bibliogr. 41 poz., tab., wykr.

Twórcy

autor

Pindur R.

• Institute of Computing Science, University of Technology, Piotrowo 3A, 60-965 Poznań, Poland

autor

Susmaga R.

• Institute of Computing Science, University of Technology, Piotrowo 3A, 60-965 Poznań, Poland

autor

Stefanowski J.

• Institute of Computing Science, University of Technology, Piotrowo 3A, 60-965 Poznań, Poland

Bibliografia

• [1] Agrawal R., Mannila H.: Srikant R., Toivonen H., Verkamo A.I.: Fast Discovery of Association Rules, Advanced in Knowledge Discovery and Data Mining (U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, R. Uthurusamy, Eds.). AAAl/MIT Press, Cambridge Mass., 1996, 307-328.
• [2] Bazan J.: A comparison of dynamic and non-dynamic rough set methods for extracting laws from decision tables. Rough Sets in Knowledge Discovery (A. Skowron, L. Polkowski. eds.), 1, Physica Verlag, Heidelberg, 1998,321-365.
• [3] Boros, Hammer, Kogan.: Logical analysis of numerical data., Mathematical Programming 79, 1997, 163-190.
• [4] Breiman L., Friedman J.H. Stone C.J.: Classification and regression trees. Wadsworth, 1984.
• [5] Cios K.J., Pedrycz W., Swinarski R.W.: Data mining methods for knowledge discovery. Dordrecht, Kluwer, 1998.
• [6] Clark P, Niblett T.: The CN2 induction algorithm. Machine Learning, 3, 1989, 261-283.
• [7] Dembczyski K., Pindur R., Susniaga R.: Generation of exhaustive set of rules within DRSA. Proceedings International Workshop on Rough Sets in Knowledge Discovery and Soft Computing, Warsaw, 2003.
• [8] Fayyad U.M., Piatetsky-Shapiro G., Smyth P., Uthurusamy R.: From data mining to knowledge discovery. Advanced in Knowledge Discovery and Data Mining (U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, R. Uthurusamy, Eds.), AAAI/MIT Press. Cambridge Mass., 1996. 1-36.
• [9] Greco S., Matarazzo B., Słowiński R.: A new rough set approach to evaluation of bankruptcy risk. Operational Tools in the Management of Financial Risk (Zopounidis C. Ed), Dordrecht, Boston, Kluwer Academic Publishers, 1998, 121-136.
• [10] Greco S., Malarazzo B., Słowiński R.: A new rough sets approach to multicriteria and multiattribute classification. Proceedings of the RSCT’98. LNAl 1424, 1998, 283-284.
• [11] Greco S., Matarazzo B., Słowiński R.: The use of rough sets and fuzzy sets in MCDM, Advances in Multiple Criteria Decision Making (Gal T., Stewart T., Hanne T., Eds.). Kluwer Academic Publishers, 1999, 14.1-14.59.
• [12] Greco S., Matarazzo B., Słowiński R., Stefanowski J.: An algorithm for induction of decision rules consistent with dominance principle. Proceeding of 2nd conf. Rough Sets and Current Trends in Computing, 2000, 266-275.
• [13] Greco S., Matarazzo B., Słowiński R., Stefanowski J.: Variable consistency model of dominance-based rough set approach. Proceeding 2nd conf. Rough Sets and Current Trends in Computing 2000, 2000, 138-149.
• [14] Greco S., Matarazzo B., Słowiński R.: Rough sets theory for multicriteria decision analysis, European Journal of Operational Research. 138. 2001, 247-259.
• [15] Greco S., Matarazzo B., Słowiński R.: Rough sets methodology for sorting problems in presence of multiple attributes and criteria, European Journal of Operational Research, 129. 2002,
• [16] Greco S., Matarazzo B., Słowiński R.: Rough approximation by dominance relations, International Journal of Intelligent Systems. 17(2). 2002. 153-171.
• [17] Grzymala-Busse J.W.: LFRS - a system for learning from examples based on rough sets, in [31]. 3-18.
• [18] Grzymala-Bussse J.W.: Discretization of numerical attributes. Handbook of Knowledge Discovery (Zytkow J., Klosgen W., Eds.), chapter C.3.4, 2001.
• [19] Kryszkiewicz M.: Generation of rules from incomplete information systems, Proceeding of the First European Symposium on Principles of Knowledge Discovery: PKDD'97 (Komorowski J., Zytkow J. Eds.), Trondhiem. Springer LNAT no. 1263. Springer, 1997. 156-166.
• [20] Kubat M., Bratko I., Michalski R.S.: Review of machine learning methods, Machine Learning and Data Mining: Methods and Applications (R.S. Michalski, I. Bratko, M. Kubat, Eds.), London, John Wiley & Sons, 1998,3-70.
• [21] Michalski R.S.: Data mining and knowledge discovery, a review of issues and a multistrategy approach. Machine Learning and Data Mining: Methods and Applications (Michalski R.S., Bratko I. and Kubat M., Eds.), London, John Wiley & Sons, 1998. 71-112.
• [22] Murthy K.VS.: On Growing Better Decision Trees from Data, PhD Thesis, Johns Hopkins Univ., Baltimore. 1995.
• [23] Murphy P.M., Aha D.W.: UCI Repository of machine learning database. University of California at Irvine, Department of Information and Computer Science [URL: http://www.ics.uci.edu/--mleani/MLRepository.htmI].
• [24] Nguyen H.S., Nguyen S.H., Skowron A.: Searching for Features Defined by Hyperplanes, Proceeding of the IX International Symposium on Methodologies for Information Systems lSMfS'96 (Z. W. Ras, M. Michalewicz, Eds.), Zakopane. Poland. Lecture Notes in Al 1079, Berlin, Springer Verlag. June 1996, 366-375.
• [25] Nguyen H. Son.: From Optimal Hyperplanes to Optimal Decision Trees, Fundamenta Informaticae, 34(1-2), 1998, 145-174.
• [26] Pindur R., Susmaga R.: Fast Rule Extraction with Binary-Coded Relations, Intelligent Data Analysis, 7( 1), 2003.
• [27] Quinian J. R.: C4.5: Programs for Machine Learning, San Francisco. Morgan Kaufmann. 1993.
• [28] Roy B.: Methedologie Multicritere d'Aide a la Decision. Economica, Paris 1985.
• [29] Skowron A., Rauszer C: The Discernibility Matrices and Functions in Information Systems, in [31].
• [30] Skowron A.: Boolean reasoning for decision rules generation, in: Methodologies for Intelligent Systems (Komorowski J., Ras Z. Eds.), LNA! 689, Springer-Verlag, Berlin, 1993, 295-305.
• [31] Słowiński R. (Ed.): Intelligent Decision Support. Handbook of Applications and Advances of the Rough Sets Theory, Dordrecht, Kluwer Academic Publishers, 1992.
• [32] Słowiński R., Stefanowski J, Greco, S., Matarazzo B.: Rough sets processing of inconsistent information. Control and Cybernetics. 29(I), 2000, 379-404.
• [33] Stefanowski J.: On rough set based approaches to induction of decision rules, in: Rough Sets in Knowledge Discovery (A. Skowron, L. Polkowski, Eds.), I, Physica Verlag, Heidelberg, 1998, 500-529.
• [34] Stefanowski J.: Rough set based rule induction techniques for classification problems. Proceeding of 6th European Congress on Intelligent Techniques and Soft Computing, 1, Aachen Sept. 7-10, 1998. 109-113.
• [35] Stefanowski J., Vanderpooten D.: Induction of decision rules in classification and discovery-oriented perspectives. International Journal of Intelligent Information Systems, 2000.
• [36] Stefanowski J.: Algorithms of rule induction for knowledge discovery, Habilitation Thesis, published as Series Rozprawy no. 361, Wydawnictwo Politechniki Poznanskicj, Poznan, 2001.
• [37] Susmaga R., Slowinski R., Greco S., Matarazzo B.: Computation of Reducts for Multi-Attribute and Multi-Criteria Classification, Proceeding of 7th Workshop Intelligent Information Systems, Ustron, Poland, June 14-18. 1999.
• [38] Susmaga R., Słowiński R., Greco S., Matarazzo B.: Generation of reducts and rules in multi-attribute and multi-criteria classification. Control and Cybernetics. 29(4), 2000, 970-988.
• [39] Weiss S.M., Kulikowski C.A.: Computer Systems That Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning and Expert Systems. Morgan Kaufmann, 1991.
• [40] Weiss S.M., Indurkhya N.: Predictive Data Mining. San Francisco, Morgan Kaufmann, 1999.
• [41] Zak J., Stefanowski J.: Determining maintenance activities of motor vehicles using rough sets approach. Proceeding of Euromaintenance'94 Conference, Amsterdam. 1994, 39-42.