Explainability in RIONA Algorithm Combining Rule Induction and Instance-Based Learning

• Autorzy: Góra Grzegorz , Skowron Andrzej , Wojna Arkadiusz

Identyfikatory

DOI

10.15439/2023F4139

• Języki publikacji: EN

Abstrakty

EN

The article concerns the well-known RIONA algorithm. We focus on the explainability property of this algorithm. The theoretical results, formulated and proved in the paper, show the relationships of the RIONA classifiers to both instance- and rule-based classifiers. In particular, we show the equivalence (relative to the classification) of the RIONA algorithm with the rule-based algorithm generating all consistent and maximally general rules from the neighbourhood of the test case. Consequently, the RIONA classifier can be represented by a rule-based classifier, with rules easily interpretable by humans. These theoretical results provide the explainability of the classifiers generated by RIONA and could be used in situations when an explanation or justification of the derived decision is important. It should be noted that the RIONA algorithm requires analysing only a small number of objects and rules contrary to algorithms based on the generation of huge sets of rules.

Słowa kluczowe

EN

training; computer science; prediction algorithm; classification algorithm

PL

szkolenie; informatyka; algorytm predykcyjny; algorytm klasyfikacji

• Wydawca: Polskie Towarzystwo Informatyczne
• Czasopismo: Annals of Computer Science and Information Systems
• Rocznik: 2023
• Tom: Vol. 35
• Strony: 491--502
• Opis fizyczny: Bibliogr. 35 poz., rys.

Twórcy

autor

Góra Grzegorz

• University of Warsaw Banacha 2, 02-097 Warszawa Poland

autor

Skowron Andrzej

• Systems Research Institute PAS Newelska 6, 01-447 Warszawa Poland

autor

Wojna Arkadiusz

• DeepSeas 12121 Scripps Summit Court San Diego, CA 92131, USA

Bibliografia

• 1. S. J. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, 4th ed. Hoboken, NJ: Pearson Education, 2021.
• 2. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. New York, NY: Springer, 2009. [Online]. Available: https://doi.org/10.1007/978-0-387-84858-7
• 3. T. M. Mitchell, Machine Learning. New York, NY: McGraw-Hill, 1997.
• 4. G. Góra and A. Wojna, “RIONA: A New Classification System Combining Rule Induction and Instance-Based Learning,” Fundamenta Informaticae, vol. 51, no. 4, pp. 369–390, 2002. [Online]. Available: https://doi.org/10.5555/2371138.2371141
• 5. G. Góra and A. Wojna, “RIONA: A Classifier Combining Rule Induction and K-nn Method with Automated Selection of Optimal Neighbourhood,” in Proceedings of the 13th European Conference on Machine Learning (ECML 2002). Heidelberg: Springer-Verlag, 2002, pp. 111–123. [Online]. Available: https://doi.org/10.1007/3-540-36755-1_10
• 6. G. Góra, “Combining instance-based learning and rule-based methods for imbalanced data,” Ph.D. dissertation, University of Warsaw, Warsaw, 2022, [Online]. Available: https://www.mimuw.edu.pl/sites/default/files/gora_grzegorz_rozprawa_doktorska.pdf.
• 7. J. Fürnkranz, D. Gamberger, and N. Lavrac, Foundations of Rule Learning, ser. Cognitive Technologies. Heidelberg: Springer, 2012. [Online]. Available: https://doi.org/10.1007/978-3-540-75197-7
• 8. A. Skowron and D. Śl ̨ezak, “Rough sets turn 40: From information systems to intelligent systems,” in Proceedings of the 17th Conference on Computer Science and Intelligence Systems, FedCSIS 2022, Sofia, Bulgaria, September 4-7, 2022, ser. Annals of Computer Science and Information Systems, M. Ganzha, L. A. Maciaszek, M. Paprzycki, and D. Ślęzak, Eds., vol. 30, 2022, pp. 23–34. [Online]. Available: https://doi.org/10.15439/2022F310
• 9. C. C. Aggarwal, “Instance-Based Learning: A Survey,” in Data Classification: Algorithms and Applications, 1st ed., C. C. Aggarwal, Ed. New York: Chapman & Hall/CRC, 2014, pp. 157–186. [Online]. Available: https://doi.org/10.1201/b17320
• 10. C. Cornelis, “Hybridization of fuzzy sets and rough sets: Achievements and opportunities,” in Proceedings of the 17th Conference on Computer Science and Intelligence Systems, FedCSIS 2022, Sofia, Bulgaria, September 4-7, 2022, ser. Annals of Computer Science and Information Systems, M. Ganzha, L. A. Maciaszek, M. Paprzycki, and D. Ślęzak, Eds., vol. 30, 2022, pp. 7–14. [Online]. Available: https://doi.org/10.15439/2022F302
• 11. A. Adadi and M. Berrada, “Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI),” IEEE Access, vol. 6, pp. 52 138–52 160, 2018. [Online]. Available: https://doi.org/10.1109/ACCESS.2018.2870052
• 12. F. K. Došilović, M. Brčić, and N. Hlupić, “Explainable artificial intelligence: A survey,” in 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). Croatian Society MIPRO, 2018, pp. 0210–0215. [Online]. Available: https://doi.org/10.23919/MIPRO.2018.8400040
• 13. H. Hagras, “Toward Human-Understandable, Explainable AI,” Computer, vol. 51, no. 9, pp. 28–36, 2018. [Online]. Available: https://doi.org/10.1109/MC.2018.3620965
• 14. D. W. Aha, Ed., Lazy Learning, 1st ed. Dordrecht: Springer, 1997. [Online]. Available: https://doi.org/10.1007/978-94-017-2053-3
• 15. A. Wojna and R. Latkowski, “Rseslib 3: Library of Rough Set and Machine Learning Methods with Extensible Architecture,” in Transactions on Rough Sets XXI, J. F. Peters and A. Skowron, Eds. Berlin, Heidelberg: Springer, 2019, pp. 301–323.
• 16. N. Dey, S. Borah, R. Babo, and A. S. Ashour, Eds., Social Network Analytics: Computational Research Methods and Techniques, 1st ed. London: Academic Press, 2019. [Online]. Available: https://doi.org/10.1016/C2017-0-02844-6
• 17. L. Grama and C. Rusu, “Choosing an accurate number of mel frequency cepstral coefficients for audio classification purpose,” in Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis (ISPA 2017), 2017, pp. 225–230. [Online]. Available: https://doi.org/10.1109/ISPA.2017.8073600
• 18. R. de Oliveira Almeida and G. T. Valente, “Predicting metabolic pathways of plant enzymes without using sequence similarity: Models from machine learning,” The Plant Genome, vol. 13, no. 3, p. e20043, 2020. [Online]. Available: https://doi.org/10.1002/tpg2.20043
• 19. C. Rusu and L. Grama, “Recent developments in acoustical signal classification for monitoring,” in 2017 5th International Symposium on Electrical and Electronics Engineering (ISEEE), 2017, pp. 1–10. [Online]. Available: https://doi.org/10.1109/ISEEE.2017.8170705
• 20. L. Grama and C. Rusu, “Adding audio capabilities to TIAGo service robot,” in 2018 International Symposium on Electronics and Telecommunications (ISETC), 2018, pp. 1–4. [Online]. Available: https://doi.org/10.1109/ISETC.2018.858389
• 21. A. Almasri, E. Celebi, and R. S. Alkhawaldeh, “EMT: Ensemble Meta-Based Tree Model for Predicting Student Performance,” Scientific Programming, vol. 2019, pp. Article No. 3 610 248, 1–13, 2019. [Online]. Available: https://doi.org/10.1155/2019/3610248
• 22. N. R. Howes, Modern Analysis and Topology. New York: Springer Science+Business Media, 1995. [Online]. Available: https://doi.org/10.1007/978-1-4612-0833-4
• 23. P. Domingos, “Unifying instance-based and rule-based induction,” Machine Learning, vol. 24, no. 2, pp. 141–168, 1996. [Online]. Available: https://doi.org/10.1007/BF00058656
• 24. H. S. Nguyen and A. Skowron, “Quantization of Real Value Attributes – Rough Set and Boolean Reasoning Approach,” in Proceedings of the 2nd Joint Annual Conference on Information Sciences (JCIS 1995), 1995, pp. 34–37.
• 25. A. Skowron and C. Rauszer, “The Discernibility Matrices and Functions in Information Systems,” in Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory, R. Słowiński, Ed. Dordrecht: Springer, 1992, pp. 331–362. [Online]. Available: https://doi.org/10.1007/978-94-015-7975-9_21
• 26. C. Sammut and G. I. Webb, Eds., Encyclopedia of Machine Learning and Data Mining, 2nd ed. USA: Springer, 2017. [Online]. Available: https://doi.org/10.1007/978-1-4899-7687-1
• 27. H. S. Nguyen, “Approximate Boolean Reasoning: Foundations and Applications in Data Mining,” in Transactions on Rough Sets V, J. F. Peters and A. Skowron, Eds. Heidelberg: Springer, 2006, pp. 334–506. [Online]. Available: https://doi.org/10.1007/11847465_16
• 28. J. G. Bazan and M. Szczuka, “RSES and RSESlib – A Collection of Tools for Rough Set Computations,” in Rough Sets and Current Trends in Computing (RSCTC 2001). Heidelberg: Springer, 2001, pp. 106–113. [Online]. Available: https://doi.org/10.1007/3-540-45554-X_12
• 29. J. W. Grzymala-Busse, “LERS-A System for Learning from Examples Based on Rough Sets,” in Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory, R. Słowiński, Ed. Dordrecht: Springer, 1992, pp. 3–18. [Online]. Available: https://doi.org/10.1007/978-94-015-7975-9_1
• 30. S. H. Nguyen, “Regularity Analysis and its Applications in Data Mining,” in Rough Set Methods and Applications: New Developments in Knowledge Discovery in Information Systems, L. Polkowski, S. Tsumoto, and T. Y. Lin, Eds. Heidelberg: Physica-Verlag, 2000, pp. 289–378. [Online]. Available: https://doi.org/10.1007/978-3-7908-1840-6_7
• 31. R. S. Michalski, I. Mozetic, J. Hong, and N. Lavrac, “The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains,” in Proceedings of the 5th AAAI National Conference on Artificial Intelligence. AAAI Press, 1986, pp. 1041–1045.
• 32. J. G. Bazan, “Discovery of Decision Rules by Matching New Objects Against Data Tables,” in Rough Sets and Current Trends in Computing (RSCTC 1998). Heidelberg: Springer, 1998, pp. 521–528. [Online]. Available: https://doi.org/10.1007/3-540-69115-4_72
• 33. Z. Pawlak and A. Skowron, “A Rough Set Approach to Decision Rules Generation,” in Proceedings of the Workshop W12: The Management of Uncertainty at the 13th International Joint Conference on Artificial Intelligence (IJCAI 1993). Chambéry: Morgan Kaufmann, 1993, pp. 114–119.
• 34. J. Wróblewski, “Covering with Reducts – A Fast Algorithm for Rule Generation,” in Rough Sets and Current Trends in Computing (RSCTC 1998). Heidelberg: Springer, 1998, pp. 402–407. [Online]. Available: https://doi.org/10.1007/3-540-69115-4_72
• 35. J. G. Bazan, H. S. Nguyen, S. H. Nguyen, P. Synak, and J. Wróblewski, “Rough Set Algorithms in Classification Problem,” in Rough Set Methods and Applications: New Developments in Knowledge Discovery in Information Systems, L. Polkowski, S. Tsumoto, and T. Y. Lin, Eds. Heidelberg: Physica-Verlag, 2000, pp. 49–88. [Online]. Available: https://doi.org/10.1007/978-3-7908-1840-6_3

Uwagi

1. Thematic Tracks Regular Papers

2. Opracowanie rekordu ze środków MEiN, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2024).