Determination of Criteria Priorities and Interactions in ChatGPT by a Fuzzy Model

• Autorzy: Çakır Fatma Sönmez , Keleş Nuh

Identyfikatory

DOI

10.2478/fcds-2025-0008

• Języki publikacji: EN

Abstrakty

EN

Today, technology is advancing much more and faster than in the past. The technological revolution is progressing so fast that people can now communicate with preprogrammed computers through Artificial Intelligence (AI). This study aims to evaluate the priorities and interactions of the criteria that stand out in the use of ChatGPT-4, using Fuzzy-Analytical Hierarchy Process (F-AHP) and Fuzzy-DEMATEL (F-DEMATEL) methods. Eight critical criteria in the use of ChatGPT are determined by the expert opinions obtained from the focus group. Among the criteria, this study found that reliability 23.1% and security 21.2% were the most important criteria by F-AHP calculations. This study also found that the criteria of appearance and functionality were generally influencing criteria, and the criteria of speed was generally influenced by other criteria.

Słowa kluczowe

EN

ChatGPT; Artificial Intelligence; fuzzy AHP; fuzzy DEMATEL

• Wydawca: Wydawnictwo Politechniki Poznańskiej
• Czasopismo: Foundations of Computing and Decision Sciences
• Rocznik: 2025
• Tom: Vol. 50, No. 2
• Strony: 207--228
• Opis fizyczny: Bibliogr. 45 poz., rys., tab.

Twórcy

autor

Çakır Fatma Sönmez

• Department of Management Information Systems, Bartın University

• https://orcid.org/0000-0001-5845-9162

autor

Keleş Nuh

• Department of Customs Management, Faculty of Applied Sciences, Tarsus University

• https://orcid.org/0000-0001-6768-728X

Bibliografia

• [1] Abdullah, L., and Zulkifli, N., Integration of fuzzy AHP and interval type-2 fuzzy DEMATEL: An application to human resource management. Expert Systems with Applications, 42, 9, 2015, 4397-4409. https://doi.org/10.1016/j.eswa.2015.01.021.
• [2] Almazyad, M., Aljofan, F., Abouammoh, N. A., Muaygil, R., Malki, K. H., Aljamaan, F., and Alrubaian, A., Enhancing expert panel discussions in pediatric palliative care: innovative scenario development and summarization with ChatGPT-4. Cureus, 15, 4, 2023, https://doi.org/10.7759/cureus.38249.
• [3] Ayhan, M. B., A Fuzzy AHP Approach for supplier selection problem: A case study in a gearmotor company. International Journal of Managing Value and Supply Chains, 4, 3, 2013, 11-23. http://dx.doi.org/10.5121/ijmvsc.2013.4302.
• [4] Bakır, M., and Atalık, Ö., Application of fuzzy AHP and fuzzy MARCOS approach for the evaluation of e-service quality in the airline industry. Decision Making: Applications in Management and Engineering, 4, 1, 2021, 127-152. https://doi.org/10.31181/dmame2104127b.
• [5] Burger, B., Kanbach, D. K., Kraus, S., Breier, M., and Corvello, V., On the use of AI-based tools like ChatGPT to support management research. European Journal of Innovation Management, 26, 7, 2023, 233-241. https://doi.org/10.1108/EJIM-02-2023-0156.
• [6] Chang, B., Chang, C. W., and Wu, C. H., Fuzzy DEMATEL method for developing supplier selection criteria. Expert systems with Applications, 38, 3, 2011, 1850-1858. https://doi.org/10.1016/j.eswa.2010.07.114.
• [7] Cotton, D. R., Cotton, P. A., and Shipway, J. R., Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 2023, 1-12. https://doi.org/10.1080/14703297.2023.2190148.
• [8] Deng, J., and Lin, Y., The Benefits and Challenges of ChatGPT: An Overview. Frontiers in Computing and Intelligent Systems, 2, 2, 2022, 81-83. https://doi.org/10.54097/fcis.v2i2.4465.
• [9] Dergaa, I., Chamari, K., Zmijewski, P., and Saad, H. B., From human writing to artificial intelligence generated text: examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40, 2, 2023, 615-622. https://doi.org/10.5114/biolsport.2023.125623.
• [10] Farrokhnia, M., Banihashem, S. K., Noroozi, O., and Wals, A., A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61, 3, 2024, 460-474.
• [11] Feng, C., and Ma, R., Identification of the factors that influence service innovation in manufacturing enterprises by using the fuzzy DEMATEL method. Journal of Cleaner Production, 253, 2020, 120002. https://doi.org/10.1016/j.jclepro.2020.120002.
• [12] Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A., and Chartash, D., How does ChatGPT perform on the United States medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med Educ. 2023; 9: e45312. Published 2023 Feb 8. Inf Process Manag, 39, 1, 2023 45-65. https://doi.org/10.2196/45312.
• [13] Haleem, A., Javaid, M., and Singh, R. P., An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. BenchCouncil transactions on benchmarks, standards and evaluations, 2, 4, 2022 1-8, 100089. https://doi.org/10.1016/j.tbench.2023.100089.
• [14] Heo, E., Kim, J., and Boo, K. J., Analysis of the assessment factors for renewable energy dissemination program evaluation using fuzzy AHP. Renewable and sustainable energy reviews, 14, 8, 2010, 2214-2220. https://doi.org/10.1016/j.rser.2010.01.020.
• [15] Hosseini, S. M., Paydar, M. M., and Hajiaghaei-Keshteli, M., Recovery solutions for ecotourism centers during the Covid-19 pandemic: Utilizing Fuzzy DEMATEL and Fuzzy VIKOR methods. Expert Systems with Applications, 185, 2021, 115594. https://doi.org/10.1016/j.eswa.2021.115594.
• [16] Javaid, M., Haleem, A., and Singh, R. P., ChatGPT for healthcare services: An emerging stage for an innovative perspective. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3, 1, 2023, 1-11, 100105. https://doi.org/10.1016/j.tbench.2023.100105.
• [17] Khan, S., and Haleem, A., Strategies to implement circular economy practices: A fuzzy DEMATEL approach. Journal of Industrial Integration and Management, 5, 2, 2020, 253-269. https://doi.org/10.1142/S2424862220500050.
• [18] Khan, S., Singh, R., Haleem, A., Dsilva, J., and Ali, S. S., Exploration of critical success factors of logistics 4.0: a DEMATEL approach. Logistics, 6, 1, 2022, 13. https://doi.org/10.3390/logistics6010013.
• [19] Li, H., Wang, W., Fan, L., Li, Q., and Chen, X., A novel hybrid MCDM model for machine tool selection using fuzzy DEMATEL, entropy weighting and later defuzzification VIKOR. Applied Soft Computing, 91, 2020, 106207. https://doi.org/10.1016/j.asoc.2020.106207.
• [20] Li, C. W., and Tzeng, G. H., Identification of a threshold value for the DEMATEL method using the maximum mean de-entropy algorithm to find critical services provided by a semiconductor intellectual property mall. Expert Systems with Applications, 36, 6, 2009 9891-9898. https://doi.org/10.1016/j.eswa.2009.01.073.
• [21] Liu, Y., Eckert, C. M., and Earl, C., A review of fuzzy AHP methods for decision-making with subjective judgements. Expert Systems with Applications, 161, 2020, 113738. https://doi.org/10.1016/j.eswa.2020.113738.
• [22] Liu, Y., Wood, L. C., Venkatesh, V. G., Zhang, A., and Farooque, M., Barriers to sustainable food consumption and production in China: A fuzzy DEMATEL analysis from a circular economy perspective. Sustainable Production and Consumption, 28, 2021, 1114-1129. https://doi.org/10.1016/j.spc.2021.07.028.
• [23] Lyu, H. M., Sun, W. J., Shen, S. L., and Zhou, A. N., Risk assessment using a new consulting process in fuzzy AHP. Journal of Construction Engineering and Management, 146, 3, 2020, 04019112. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001757.
• [24] Mangla, S. K., Kumar, P., and Barua, M. K., Risk analysis in green supply chain using fuzzy AHP approach: A case study. Resources, Conservation and recycling, 104, 375-390. 2015, https://doi.org/10.1016/j.resconrec.2015.01.001.
• [25] Mattas, P. S., ChatGPT: A Study of AI Language Processing and its Implications. International Journal of Research Publication and Reviews, 4, 2, 2023 435-440, ISSN 2582-7421.
• [26] Mijwil, M., Aljanabi, M., and Ali, A. H., ChatGPT: exploring the role of cybersecurity in the protection of medical information. Mesopotamian journal of cybersecurity, 2023, 18-21. https://doi.org/10.58496/MJCS/2023/004.
• [27] Nasrollahi, M., Fathi, M. R., Sobhani, S. M., Khosravi, A., and Noorbakhsh, A., Modeling resilient supplier selection criteria in desalination supply chain based on fuzzy DEMATEL and ISM. International Journal of Management Science and Engineering Management, 16, 4, 2021, 264-278. https://doi.org/10.1080/17509653.2021.1965502.
• [28] Ocampo, L. A., Villegas, Z. V. A., Carvajal, J. A. T., and Apas, C. A. A., Identifying significant drivers for sustainable practices in achieving sustainable food supply chain using modified fuzzy decision-making trial and evaluation laboratory approach. International Journal of Advanced Operations Management, 10, 1, 2018, 51-89. https://doi.org/10.1504/IJAOM.2018.091317.
• [29] Paul, J., Ueno, A., and Dennis, C., ChatGPT and consumers: benefits, pitfalls and future research Agenda. International Journal of Consumer Studies. 1-13, 2023, https://doi.org/10.1111/ijcs.12928.
• [30] Pekkaya, M., Keleş, N., and Çakır, F. S., Freight Village Efficiency Criteria Evaluation via Fuzzy Multi-criteria Decision-Making Methods. In: Sahoo, L., Senapati, T., Yager, R.R. (eds). In Real Life Applications of Multiple Criteria Decision Making Techniques in Fuzzy Domain (pp. 619-641). Singapore: Springer Nature Singapore. 2023, https://doi.org/10.1007/978-981-19-4929-6_30.
• [31] Pinochet, L. H. C., Moreira, M. Â. L., Fávero, L. P., dos Santos, M., and Pardim, V. I., Collaborative Work Alternatives with ChatGPT Based on Evaluation Criteria for its Use in Higher Education: Application of the PROMETHEE-SAPEVO-M1 Method. Procedia Computer Science, 221, 2023, 177-184. https://doi.org/10.1016/j.procs.2023.07.025.
• [32] Rahman, M., Terano, H. J., Rahman, M. N., Salamzadeh, A., and Rahaman, M., ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples, Journal of Education, Management and Development Studies, 3, 1, 2023, 1-12. http://dx.doi.org/10.52631/jemds.v3i1.175.
• [33] Ray, P. P., ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 2023, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
• [34] Rudolph, J., Tan, S., and Tan, S., ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?. Journal of Applied Learning and Teaching, 6, 1, 2023, 1-22. https://doi.org/10.37074/jalt.2023.6.1.9.
• [35] Saaty, T. L., The Analytic Hierarchy Process. New York: McGraw-Hill, 1980.
• [36] Sallam, M., ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. In Healthcare, 11, 6, 2023, 887. MDPI. https://doi.org/10.3390/healthcare11060887.
• [37] Shieh, J. I., Wu, H. H., and Huang, K. K., A DEMATEL method in identifying key success factors of hospital service quality. Knowledge-Based Systems, 23, 3, 2010, 277-282. https://doi.org/10.1016/j.knosys.2010.01.013.
• [38] Sönmez Çakır, F., and Pekkaya, M., Determination of interaction between criteria and the criteria priorities in laptop selection problem. International Journal of Fuzzy Systems, 22, 4, 2020 1177-1190. https://doi.org/10.1007/s40815-020-00857-2.
• [39] Sun, C. C., A performance evaluation model by integrating fuzzy AHP and fuzzy TOPSIS methods. Expert systems with applications, 37, 12, 2010, 7745-7754. https://doi.org/10.1016/j.eswa.2010.04.066.
• [40] Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., and Agyemang, B., What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10, 1, 2023, 15. https://doi.org/10.1186/s40561-023-00237-x.
• [41] Tsai, W. H., and Chou, W. C., Selecting management systems for sustainable development in SMEs: A novel hybrid model based on DEMATEL, ANP, and ZOGP. Expert systems with applications, 36, 2, 2009, 1444-1458. https://doi.org/10.1016/j.eswa.2007.11.058.
• [42] Tzeng, G. H., Chiang, C. H., and Li, C. W., Evaluating intertwined effects in e-learning programs: A novel hybrid MCDM model based on factor analysis and DEMATEL. Expert systems with Applications, 32, 4, 2007, 1028-1044. https://doi.org/10.1016/j.eswa.2006.02.004.
• [43] van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., and Bockting, C. L., ChatGPT: five priorities for research. Nature, 614, 7947, 2023, 224-226. https://doi.org/10.1038/d41586-023-00288-7.
• [44] Yan, H., Yang, Y., Lei, X., Ye, Q., Huang, W., and Gao, C., Regret Theory and Fuzzy-DEMATEL-Based Model for Construction Program Manager Selection in China. Buildings, 13, 4, 2023, 838. https://doi.org/10.3390/buildings13040838.
• [45] Zadeh, L. A., The concept of a linguistic variable and its application to approximate reasoning-I. Information sciences, 8, 3, 1975, 199-249. https://doi.org/10.1016/0020-0255(75)90036-5.