Supervised multilabel classification techniques for categorising customer requirements during the conceptual phase in the new product development

• Autorzy: Sutrilastyo , Diar Astant Ririn

Identyfikatory

DOI

10.2478/emj-2024-0003

• Języki publikacji: EN

Abstrakty

EN

The research aims to provide the decision-maker with a framework for determining customer requirements during product development. The proposed framework is based on sentiment analysis and supervised multilabel classification techniques. Therefore, the proposed technique can categorise customer reviews based on the “product design criteria” label and the “sentiment of the review” label. To achieve the research goal, the research presented in this article uses the existing product development framework presented in the literature. The modification is conducted especially in the conceptual stage of product development, in which the voice of the customer or a customer review is obtained from the scraping, and a multilabel classification technique is performed to categorise customer reviews. The proposed framework is tested by using the set data on women’s clothing reviews from an e-commerce site downloaded from www.kaggle.com based on data by Agarap (2018). The result shows that the proposed framework can categorise customer reviews. The research presented in this paper has contributed by proposing a technique based on sentiment analysis and multilabel classification that can be used to categorise customers during product development. The research presented in this paper answers one of the concerns in the categorisation of needs raised by Shabestari et al. (2019), namely, the unclear rules or main attributes of a requirement that make these needs fall into certain categories. Categorising customer requirements allows decisionmakers to determine the direction of product development to meet customer needs.

Słowa kluczowe

EN

voice of customer; customer needs; conceptual design; product development process; customer’s requirement categorisation; sentiment analysis; supervised multilabel classification technique

PL

głos klienta; potrzeby klienta; projekt koncepcyjny; proces rozwoju produktu; kategoryzacja wymagań klienta; analiza nastrojów; nadzorowana technika klasyfikacji wieloetykietowej

• Wydawca: Oficyna Wydawnicza Politechniki Białostockiej
• Czasopismo: Engineering Management in Production and Services
• Rocznik: 2024
• Tom: Vol. 16, no. 1
• Strony: 31--47
• Opis fizyczny: Bibliogr. 67 poz., tab., wykr.

Twórcy

autor

Sutrilastyo

• Faculty of Industrial Technology Universitas Atma Jaya Yogyakarta Jalan Babarsari Street 44 55281 Yogyakarta, Indonesia

autor

Diar Astant Ririn

• Faculty of Industrial Technology Universitas Atma Jaya Yogyakarta Jalan Babarsari Street 44 55281 Yogyakarta, Indonesia

• https://orcid.org/0000-0001-5234-0283+

Bibliografia

• Abad, Z. S. H., Karras, O., Ghazi, P., Glinz, M., Ruhe, G., & Schneider, K. (2017). What Works Better? A Study of Classifying Requirements. Proceedings of 2017 IEEE 25th International Requirements Engineering Conference, RE 2017, 496-501. doi: 10.1109/RE.2017.36
• Agarap, A. F. (2018). Statistical Analysis on E-Commerce Reviews, with Sentiment Classification using Bidirectional Recurrent Neural Network (RNN). arXiv preprint arXiv:1805.03687. Retrieved from http://arxiv.org/abs/1805.03687
• Aguwa, C., Olya, M. H., & Monplaisir, L. (2017). Modeling of fuzzy-based voice of customer for business decision analytics. Knowledge-Based Systems, 125, 136- 145. doi: 10.1016/j.knosys.2017.03.019
• Bhuiyan, N. (2011). A framework for successful new product development. Journal of Industrial Engineering and Management, 4(4), 746-770. doi: 10.3926/jiem.334
• Bird, S., Klein, E., & Loper, E. (2009). Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit. O’Reilly Media, Inc.
• Booz, A., & Hamilton (1982). New Products Management for the 1980s. Booz, Allen and Hamilton, Tysons Corner.
• Broucke, S.V., & Baesens, B. (2018). Practical Web Scraping for Data Science: Best Practices and Examples with Python. Apress.
• Büyüközkan, G., & Arsenyan, J. (2012). Collaborative product development: A literature overview. Production Planning and Control, 23(1), 47-66. doi: 10.1080/09537287.2010.543169
• Carter, M. P. (2015). Creation and validation of a best practice new product development process assessment tool for industrial practitioners. Doctoral dissertation, Indiana State University.
• Cooper, R. G. (2001). Winning at New Products: Accelerating the Process from Idea to Launch (3rd ed.). Perseus Books.
• Devi, D. V. N., Kumar, C. K., & Prasad, S. (2016). A Feature Based Approach for Sentiment Analysis by Using Support Vector Machine. Proceedings of 2016 IEEE 6th International Conference on Advanced Computing (IACC), 3-8. doi: 10.1109/IACC.2016.11
• Di Benedetto, C. A. (1999). Identifying the key success factors in new product launch. Journal of Product Innovation Management, 16(6), 530-544. doi: 10.1111/1540-5885.1660530
• Eckman, M., Damhorst, M. L., & Kadolph, S. J. (1990). Toward a Model of the In-Store Purchase Decision Process: Consumer Use of Criteria for Evaluating Women’s Apparel. Clothing and Textiles Research Journal, 8(2), 13-22. doi: 10.1177/0887302X9000800202
• Edwards, A. S., Kaplan, B., & Jie, T. (2021). A Primer on Machine Learning. Transplantation, 105(4), 699-703. doi: 10.1097/TP.0000000000003316
• Elreedy, D., & Atiya, A. F. (2019). A Comprehensive Analysis of Synthetic Minority Oversampling Technique (SMOTE) for handling class imbalance. Information Sciences, 505, 32-64. doi: 10.1016/j.ins.2019.07.070
• Folkestad, J. E., & Johnson, R. L. (2001). Resolving the conflict between design and manufacturing: Integrated Rapid Prototyping and Rapid Tooling (IRPRT). Journal of Industrial Technology, 17(4), 1-7.
• Gonçalves, P., Benevenuto, F., Araujo, M., & Cha, M. (2013). Comparing and Combining Sentiment Analysis Methods Categories and Subject Descriptors. Proceedings of the first ACM conference on Online social networks (COSN ‘13), 27-38. doi: 10.1145/2512938.2512951
• Guo, S., Liu, Y., Chen, R., Sun, X., & Wang, X. (2019). Improved SMOTE Algorithm to Deal with Imbalanced Activity Classes in Smart Homes. Neural Processing Letters, 50(2), 1503-1526. doi: 10.1007/s11063-018-9940-3
• Gupta, M., & Sebastian, S. (2018). Framework to analyze customer’s feedback in smartphone industry using opinion mining. International Journal of Electrical and Computer Engineering, 8(5), 3317-3324. doi: 10.11591/ijece.v8i5.pp3317-3324
• Hadi, W., Al-Radaideh, Q. A., & Alhawari, S. (2018). Integrating associative rule-based classification with Naïve Bayes for text classification. Applied Soft Computing Journal, 69, 344-356. doi: 10.1016/j.asoc.2018.04.056
• Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate Data Analysis (7th ed.). Pearson Education Limited.
• Haq, A. U., Li, J., Khan, J., Memon, M. H., Parveen, S., Raji, M. F., Akbar, W., Ahmad, T., Ullah, S., Shoista, L., & Monday, H. N. (2019). Identifying The Predictive Capability of Machine Learning Classifiers For Designing Heart Disease Detection System. Proceedings of the 16th International Computer Conference on Wavelet Active Media Technology and Information Processing, 130-138. doi: 10.1109/ICCWAMTIP47768.2019.9067519.
• Huang, S., Peng, W., Li, J., & Lee, D. (2013). Sentiment and Topic Analysis on Social Media: A Multi-Task MultiLabel Classification Approach. Proceedings of the 5th Annual ACM Web Science Conference, 172-181. doi: 10.1145/2464464.2464512
• Ireland, R., & Liu, A. (2018). Application of data analytics for product design: Sentiment analysis of online product reviews. CIRP Journal of Manufacturing Science and Technology, 23, 128-144. doi: 10.1016/j.cirpj.2018.06.003
• Issac, B., & Jap, W. J. (2009). Implementing spam detection using Bayesian and porter stemmer keyword stripping approaches. Proceedings of TENCON 2009 IEEE Region 10 Conference, 1-5. doi: 10.1109/TENCON.2009.5396056
• Jeong, B., & Yoon, J. (2016). Identifying product opportunities using topic modeling and sentiment analysis of social media data. Proceedings of the 17th Asia Pacific Industrial Engineering and Management System Conference, Paper 208.
• Jiang, L., Cai, Z., Zhang, H., & Wang, D. (2013). Naive Bayes text classifiers: A locally weighted learning approach. Journal of Experimental & Theoretical Artificial Intelligence, 25(2), 273-286. doi: 10.1080/0952813X.2012.721010
• Kang, D., & Park, Y. (2014). Review-based measurement of customer satisfaction in mobile service: Sentiment analysis and VIKOR approach. Expert Systems with Applications, 41(4-1), 1041-1050. doi: 10.1016/j.eswa.2013.07.101
• Kapucugil Ikiz, A., & Özdağoğlu, G. (2015). Text Mining as a Supporting Process for VoC Clarification. Alphanumeric Journal, 3(1), 25-40.
• Kaulio, M. A. (1998). Customer, consumer, and user involvement in product development: A framework and a review of selected methods. Total Quality Management, 9(1), 141-149. doi: 10.1080/0954412989333
• Khedr, A. E., Salama, S. E., & Yaseen, N. (2017). Predicting stock market behavior using data mining technique and news sentiment analysis. International Journal of Intelligent Systems and Applications, 9(7), 22-30. doi: 10.5815/ijisa.2017.07.03
• Kim, Y. H., Park, S. W., & Sawng, Y. W. (2016). Improving new product development (NPD) process by analyzing failure cases. Asia Pacific Journal of Innovation and Entrepreneurship, 10(1), 134-150. doi: 10.1108/APJIE-12-2016-002
• Kolchyna, O., Souza, T. T., Treleaven, P., & Aste, T. (2015). Twitter sentiment analysis: Lexicon method, machine learning method and their combination. arXiv preprint arXiv:1507.00955. Retrieved from http://arxiv.org/abs/1507.00955
• Kornish, L. J., & Hutchison-Krupat, J. (2017). Research on Idea Generation and Selection: Implications for Management of Technology. Production and Operations Management, 26(4), 633-651. doi: 10.1111/poms.12664
• Kreuzbauer, R., & Malter, A. J. (2005). Embodied cognition and new product design: Changing product form to influence brand categorization. Journal of Product Innovation Management, 22(2), 165-176. doi: 10.1111/j.0737-6782.2005.00112.x
• Lai, S. T., & Leu, F. Y. (2017). Data preprocessing quality management procedure for improving big data applications efficiency and practicality. Lecture Notes on Data Engineering and Communications Technologies, 2, 731-738. doi: 10.1007/978-3-319-49106-6_73
• Lee, T. Y., & Bradlow, E. T. (2011). Automated Marketing Research Using Online Customer Reviews. Journal of Marketing Research, 48(5), 881-894. doi: 10.1509/jmkr.48.5.881
• Li, S., Wang, Z., Zhou, G., & Lee, S. Y. M. (2011). SemiSupervised Learning for Imbalanced Sentiment Classification. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, 1826-1831.
• Malviya, S., Tiwari, A. K., Srivastava, R., & Tiwari, V. (2020). Machine learning techniques for sentiment analysis: A review. SAMRIDDHI: A Journal of Physical Sciences, Engineering and Technology, 12(02), 72- 78. doi: 10.18090/samriddhi.v12i02.03
• Micu, A., Micu, A. E., Geru, M., & Lixandroiu, R. C. (2017). Analyzing user sentiment in social media: Implications for online marketing strategy. Psychology & Marketing, 34(12), 1094-1100. doi: 10.1002/mar.21049
• Misopoulos, F., Mitic, M., Kapoulas, A., & Karapiperis, C. (2014). Uncovering customer service experiences with Twitter: The case of airline industry. Management Decision, 52(4), 705-723. doi: 10.1108/MD-03- 2012-0235
• Mulay, R., & Khanna, V. T. (2017). A Study on the Relationship between the Voice of Customer with the Cost of Quality in Processes of Professional Higher Education Institutions. South Asian Journal of Management, 24(4), 55.
• Nazari-Shirkouhi, S., & Keramati, A. (2017). Modeling customer satisfaction with new product design using a flexible fuzzy regression-data envelopment analysis algorithm. Applied Mathematical Modelling, 50, 755- 771. doi: 10.1016/j.apm.2017.01.020
• Park, J., Lee, H., Lee, J. H., & Suh, H. W. (2018). Featurebased sentiment word selection and rating for system design. Journal of Industrial Electronics Technology and Application, 1(4), 54-57.
• Park, Y. E., & Alenezi, M. (2018). Predicting the popularity of Saudi multinational enterprises using a data mining technique. Journal of Management Information and Decision Science, 21(1), 1-15.
• Pedersen, S. N., Christensen, M. E., & Howard, T. J. (2016). Robust design requirements specification: a quantitative method for requirements development using quality loss functions. Journal of Engineering Design, 27(8), 544-567. doi: 10.1080/09544828.2016.1183163
• Pedregosa, F., Michel, V., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Vanderplas, J., Cournapeau, D., Varoquaux, G., Gramfort, A., Thirion, B., Dubourg, V., Passos, A., Brucher, M., Perrot, M., & Duchesnay, É. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12, 2825-2830.
• Pienaar, C., van der Lingen, E., & Preis, E. (2019). A framework for successful new product development. South African Journal of Industrial Engineering, 30(3), 199- 209. doi: 10.7166/30-3-2239
• Pinquié, R., Véron, P., Segonds, F., & Croué, N. (2018). A requirement mining framework to support complex sub-systems suppliers. Procedia CIRP, 70, 410- 415. doi: 10.1016/j.procir.2018.03.228
• Povoda, L., Burget, R., & Dutta, M. K. (2016). Sentiment analysis based on support vector machine and big data. Proceedings of the 39th International Conference on Telecommunications and Signal Processing, 543- 545. doi: 10.1109/TSP.2016.7760939
• Pranckevičius, T., & Marcinkevičius, V. (2017). Comparison of Naive Bayes, Random Forest, Decision Tree, Support Vector Machines, and Logistic Regression Classifiers for Text Reviews Classification. Baltic Journal of Modern Computing, 5(2), 221-232. doi: 10.22364/bjmc.2017.5.2.05
• Rácz, A., Bajusz, D., & Héberger, K. (2021). Effect of dataset size and train/test split ratios in qsar/qspr multiclass classification. Molecules, 26(4), 1111. doi: 10.3390/molecules26041111
• Samuel, J., Ali, G. G. M. N., Rahman, M. M., Esawi, E., & Samuel, Y. (2020). COVID-19 public sentiment insights and machine learning for tweets classification. Information, 11(6), 314. doi: 10.3390/info11060314
• Schulze, A., & Hoegl, M. (2006). Knowledge creation in new product development projects. Journal of Management, 32(2), 210-236. doi: 10.1177/0149206305280102
• Shabestari, S. S., Herzog, M., & Bender, B. (2019). A survey on the applications of machine learning in the early phases of product development. Proceedings of the Design Society: International Conference on Engineer ing Design, 2437-2446. doi: 10.1017/dsi.2019.250
• Shah, K., Patel, H., Sanghvi, D., & Shah, M. (2020). A Comparative Analysis of Logistic Regression, Random Forest and KNN Models for the Text Classification. Augmented Human Research, 5(1), 12. doi: 10.1007/s41133-020-00032-0
• Shen, J., Baysal, O., & Shafiq, M. O. (2019). Evaluating the Performance of Machine Learning Sentiment Analy - sis Algorithms in Software Engineering. 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 1023-1030. doi: 10.1109/DASC/PiCom/CBDCom/CyberSciTech.2019.00185
• Shukri, S. E., Yaghi, R. I., Aljarah, I., & Alsawalqah, H. (2015). Twitter sentiment analysis: A case study in the automotive industry. 2015 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies, AEECT 2015, 1-5. doi: 10.1109/AEECT.2015.7360594
• Singh, G., Kumar, B., Gaur, L., & Tyagi, A. (2019). Comparison between Multinomial and Bernoulli Naïve Bayes for Text Classification. International Conference on Automation, Computational and Technology Management (ICACTM), 593-596. doi: ICACTM.2019.8776800
• Šperková, L. (2019). Qualitative Research on Use of Voice of Customer in Czech Organisations. Journal of Systems Integration, 10(2), 9-19.
• Tan, S., Cheng, X., Wang, Y., & Xu, H. (2009). Adapting Naive Bayes to Domain Adaptation for Sentiment Analysis. Advances in Information Retrieval. ECIR 2009. Lecture Notes in Computer Science, 5478, 337- 349. doi: 10.1007/978-3-642-00958-7_31
• Ulrich, K. T., & Eppinger, S. D. (2015). Product Design and Development (6th ed.). McGraw-Hill Education.
• Wang, Y., Zhou, Z., Jin, S., Liu, D., & Lu, M. (2017). Comparisons and Selections of Features and Classifiers for Short Text Classification. IOP Conference Series: Materials Science and Engineering, 261, 012018. doi: 10.1088/1757-899X/261/1/012018
• Waykole, R. N., & Thakare, A. D. (2018). A Review of Feature Extraction Methods for Text Classification. International Journal of Advance Engineering and Research Development, 5(04), 351-354.
• Zhang, W., Xu, H., & Wan, W. (2012). Weakness Finder: Find product weakness from Chinese reviews by using aspects-based sentiment analysis. Expert Systems with Applications, 39(11), 10283-10291. doi: 10.1016/j.eswa.2012.02.166
• Zhang, W., Yoshida, T., & Tang, X. (2011). A comparative study of TF*IDF, LSI and multi-words for text classification. Expert Systems with Applications, 38(3), 2758-2765. doi: 10.1016/j.eswa.2010.08.066
• Zhou, Q., Xia, R., & Zhang, C. (2016). Online Shopping Behavior Study Based on Multi-granularity Opinion Mining: China Versus America. Cognitive Computation, 8(4), 587-602. doi: 10.1007/s12559-016-9384-x