Proposal of a performance measurement system model: overcoming effectiveness barriers

• Autorzy: Cunha Flávio , Dinis-Carvalho José , Sousa Rui M.

Identyfikatory

DOI

10.30657/pea.2025.31.25

• Języki publikacji: EN

Abstrakty

EN

Although the importance of Performance Measurement Systems (PMS) is recognized by organizations in general, it is found that many of these systems are ineffective and end up being discredited. The research question inherent to this work is: how to develop a PMS capable of mitigating the main barriers to the effectiveness of this kind of system? Subsequently, the main objective of this paper is to present a new PMS, called PMS_UM, together with the respective implementation methodology, capable of reducing the impact of the most common barriers to effectiveness, something that the current PMS do not achieve. The research was conducted in the period 2021-2024, and, in terms of methodology, this paper relies on the designated Grounded Theory as it systematically brings together the knowledge needed to develop a robust and effective PMS model and implementation methodology from a set of four studies previously carried out and published by the authors. The methodology begins with identifying barriers to PMS effectiveness through scientific articles, interviews and questionnaires. It then focuses on recognizing existing PMS (and their characteristics) that can mitigate some of these barriers and developing solutions (and necessary PMS characteristics) for unaddressed barriers. All characteristics are classified into groups and their relationships are mapped to develop an effective PMS model. The process integrates theoretical research with practical organizational insights. The main results of this work are (i) the PMS_UM model, which encompasses the critical characteristics needed to be an effective PMS, along with (ii) the corresponding practical methodology for development, implementation and maintenance. Both the model and the methodology are evaluated based on their ability to mitigate or eliminate the most common barriers to PMS effectiveness, thus demonstrating the better performance of PMS_UM compared to existing PMS. As for practical implications, this work provides managers with the means to, step by step, obtain a robust and effective PMS that truly reflects the state of the company and is therefore an essential tool not only for day-today management but also to support any improvement intervention. The PMS_UM model and methodology have not yet been tested in real-world scenarios, which is, at the moment, the main limitation of this work.

Słowa kluczowe

EN

performance measurement system; key performance indicators; continuous improvement; operational excellence; lean production

PL

system pomiaru wydajności; kluczowe wskaźniki wydajności; ciągłe doskonalenie; doskonałość operacyjna; szczupłe wytwarzanie

• Wydawca: Oficyna Wydawnicza Stowarzyszenia Menedżerów Jakości i Produkcji
• Czasopismo: Production Engineering Archives
• Rocznik: 2025
• Tom: Vol. 31, Iss. 2
• Strony: 247--265
• Opis fizyczny: Bibliogr. 55 poz., rys., tab.

Twórcy

autor

Cunha Flávio

• Algoritmi Centre, Department of Production and Systems, University of Minho, 4800-058 Guimarães, Portugal

autor

Dinis-Carvalho José

• Algoritmi Centre, Department of Production and Systems, University of Minho, 4800-058 Guimarães, Portugal

autor

Sousa Rui M.

• Algoritmi Centre, Department of Production and Systems, University of Minho, 4800-058 Guimarães, Portugal

Bibliografia

• 1.Bahri, M., St-Pierre, J., Sakka, O., 2017. Performance measurement and management for manufacturing SMEs: a financial statement-based system. Measuring Business Excellence, 21(1), 17-36. DOI: 10.1108/MBE-06-2015-0034
• 2.Baird, K., 2017. The effectiveness of strategic performance measurement systems. International Journal of Productivity and Performance Management, 66(1), 3-21. DOI: 10.1108/IJPPM-06-2014-0086
• 3.Behery, M., Jabeen, F., Parakandi, M., 2014. Adopting a contemporary performance management system: A fast-growth small-to-medium enterprise (FGSME) in the UAE. International Journal of Productivity and Performance Management, 63(1), 22-43. DOI: 10.1108/IJPPM-07-2012-0076
• 4.Bititci, U., 2015. Managing business performance: The science and the art. John Wiley & Sons.
• 5.Boone, H. N., Boone, D. A., 2012. Analyzing likert data. Journal of Extension, 50(2), 1-5.
• 6.Carvalho, J. D., 2021. Melhoria Contínua nas Organizações. Lidel.
• 7.Choong, K. K., 2014. Has this large number of performance measurement publications contributed to its better understanding? A systematic review for research and applications. International Journal of Production Research, 52(14), 4174-4197. DOI: 10.1080/00207543.2013.866285
• 8.Cocca, P., Alberti, M., 2010. A framework to assess performance measurement systems in SMEs. International Journal of Productivity and Performance Management, 59(2), 186-200. DOI: 10.1108/17410401011014258
• 9.Cunha, F., Dinis-Carvalho, J., Sousa, R. M., 2023. Performance Measurement Systems in Continuous Improvement Environments: Obstacles to Their Effectiveness. Sustainability (Switzerland), 15(1), 867. DOI: 10.3390/su15010867
• 10.Cunha, F., Dinis-Carvalho, J., Sousa, R. M., 2024a. Assessment of Performance Measurement Systems’ Ability to Mitigate or Eliminate Typical Barriers Compromising Organisational Sustainability. Sustainability (Switzerland), 16(5), 2173. DOI: 10.3390/su16052173
• 11.Cunha, F., Dinis-Carvalho, J., Sousa, R. M., 2024b. Key Characteristics of effective Performance Measurement Systems. Manuscript Submitted for Publication.
• 12.Cunha, F., Dinis-Carvalho, J., Sousa, R. M., 2024c. Analysis of barriers for performance measurement system effectiveness in a company: perceptions across hierarchical levels. International Journal of Lean Six Sigma, Ahead of p(Ahead of print. DOI: 10.1108/IJLSS-12-2023-0205
• 13.Fantozzi, I. C., Di Luozzo, S., Schiraldi, M. M., 2023. Industrial Performance Measurement Systems Coherence: A Comparative Analysis of Current Methodologies, Validation and Introduction to Key Activity Indicators. Applied Sciences (Switzerland), 13(1. DOI: 10.3390/app13010235
• 14.Fitzgerald, L., Moon, P. (1996. Performance Measurement in Service Industries: Making It Work. CIMA Publishing.
• 15.Franco-Santos, M., Kennerley, M., Micheli, P., Martinez, V., Mason, S., Marr, B., Gray, D., Neely, A., 2007. Towards a definition of a business performance measurement system. International Journal of Operations and Production Management, 27(8), 784-801. DOI: 10.1108/ 01443570710763778
• 16.Franco-Santos, M., Lucianetti, L., Bourne, M., 2012. Contemporary performance measurement systems: A review of their consequences and a framework for research. Management Accounting Research, 23(2), 79-119. DOI: 10.1016/j.mar.2012.04.001
• 17.Franco, M., Bourne, M., 2003. Factors that play a role in “managing through measures.” Management Decision, 41(8), 698-710. DOI: 10.1108/00251740310496215
• 18.Gabris, G. T., 1986. Recognizing Management Technique Dysfunctions : How Management Tools Often Create More Problems than They Solve. Public Productivity Review, 10(2), 3-19. DOI: 10.2307/3380448
• 19.Ghalayini, A. M., Noble, J. S., 1996. The changing basis of performance measurement. International Journal of Operations and Production Management, 16(8), 63-80. DOI: 10.1108/01443579610125787
• 20.Gupta, S., Jain, S. K., 2013. A literature review of lean manufacturing. International Journal of Management Science and Engineering Management, 8(4), 241-249. DOI: 10.1080/17509653.2013.825074
• 21.Hudson Smith, M., Smith, D., 2007. Implementing strategically aligned performance measurement in small firms. International Journal of Production Economics, 106(2), 393-408. DOI: 10.1016/j.ijpe.2006.07.011
• 22.ISO/TC 184/SC5., 2014. ISO 22400-1:2014 Automation systems and integration — Key performance indicators (KPIs) for manufacturing operations management (Vol. 2014).
• 23.Jonsson, P., Lesshammar, M., 1999. Evaluation and improvement of manufacturing performance measurement systems - the role of OEE Patrik Jonsson Magnus Lesshammar Article. International Journal of Operations & Production Management, 19(1), 55-78. http://dx.doi.org/10.1108/01443579910244223
• 24.Joshi, A., Kale, S., Chandel, S., Pal, D., 2015. Likert Scale: Explored and Explained. British Journal of Applied Science & Technology, 7(4), 396-403. DOI: 10.9734/bjast/2015/14975
• 25.Kennerley, M., Neely, A., 2002. A framework of the factors affecting the evolution of performance measurement systems. International Journal of Operations and Production Management, 22(11), 1222-1245. DOI: 10.1108/01443570210450293
• 26.Kerzner, H., 2017. Project management metrics, KPIs and D dashboards: a guide to measuring and monitoring project performance (Third Edit). John Wiley & Sons.
• 27.Langwerden, E. F., 2015. Performance Measurement System Development in SMEs : Testing & Refining The Circular Methodology. In 5Th IBA Bachelor Thesis Conference, July 2015, Enschede, Netherlands.
• 28.Lee, K., Lee, S., 2023. Enhancing R&D Performance Management: A Case of R&D Projects in South Korea. Sustainability (Switzerland), 15(15), 1-14. DOI: 10.3390/su151511752
• 29.Lehtinen, J., Ahola, T., 2010. Is performance measurement suitable for an extended enterprise? International Journal of Operations and Production Management, 30(2), 181-204. DOI: 10.1108/01443571011018707
• 30.Malagueño, R., Lopez-Valeiras, E., Gomez-Conde, J., 2018. Balanced scorecard in SMEs: effects on innovation and financial performance. Small Business Economics, 51(1). DOI: 10.1007/s11187-017-9921-3
• 31.McCunn, P., 1998. The Balanced Scorecard... The eleventh commandment. Management Accounting: Magazine for Chartered Management Accountants, 76(11), 34. DOI: Available: https://www.proquest.com/ trade-journals/balanced-scorecard-eleventhcommandment/docview/195676560/se-2?accountid=39260.
• 32.Meekings, A., 1995. Unlocking the potential of performance measurement: A practical implementation guide. Public Money & Management, 15(4), 5- 12. DOI: 10.1080/09540969509387888
• 33.Mettänen, P., 2005. Design and implementation of a performance measurement system for a research organization. Production Planning and Control, 16(2), 178-188. DOI: 10.1080/09537280512331333075
• 34.Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., Group, T. P., 2009. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med, 6(7). DOI: 10.1371/journal. pmed.1000097
• 35.Munir, R., Baird, K., Si, Z., 2012. Associations with the use of multidimensional performance measures and the effectiveness of performance measurement systems. Asia-Pacific Management Accounting Journal, 7(2).
• 36.Naslund, D., Norrman, A., 2019. A performance measurement system for change initiatives: An action research study from design to evaluation. Business Process Management Journal, 25(7), 1647-1672. DOI: 10.1108/BPMJ-11-2017-0309
• 37.Neely, A., Bourne, M., 2000. Why Measurement Initiatives Fail. Measuring Business Excellence, 4, 3-7. DOI: 10.1108/13683040010362283
• 38.Neely, A., Mills, J., Platts, K., Richards, H., Gregory, M., Kennerley, M., 2000. Performance measurement system design : developing and testing a process-based approach. International Journal of Operations & Production Management, 20(10), 1119-1145.
• 39.Pandis, N., 2016. The chi-square test. American Journal of Orthodontics and Dentofacial Orthopedics, 150(5), 898-899. DOI: 10.1016/j.ajodo.2016.08.009
• 40.Pedersen, E. R. G., Sudzina, F., 2012. Which firms use measures?: Internal and external factors shaping the adoption of performance measurement systems in Danish firms. International Journal of Operations and Production Management, 32(1), 4-27. DOI: 10.1108/ 01443571211195718
• 41.Saunders, M. N. K., Lewis, P., Thornhill, A., 2019. Research Methods for Business Students (Eight). Pearson.
• 42.Schneiderman, A. M., 2013. Why Balanced Scorecards Fail. Journal of Strategic Performance Measurement.
• 43.Striteska, M., Svoboda, O., 2012. Survey of performance measurement systems in Czech companies. E a M: Ekonomie a Management, 15(2).
• 44.Stříteská, M., Zapletal, D., Jelínková, L., 2016. Performance management systems in Czech companies: Findings from a questionnaire survey. E a M: Ekonomie a Management, 19(4), 44-55. DOI: 10.15240/tul/ 001/2016-4-004
• 45.Suwignjo, P., Bititci, U. S., Carrie, A. S., 2000. Quantitative Models for Performance Measurement System. International Journal of Production Economics, 64(1), 231-241. DOI: 10.1016/S0925-5273(99)00061-4
• 46.Todorut, A. V., Bojinca, M., Tselentis, V., 2013. Using balanced scorecard for measuring excellence in SMEs. Recent Researches in Law Science and Finances.
• 47.Tung, A., Baird, K., Schoch, H. P., 2011. Factors influencing the effectiveness of performance measurement systems. International Journal of Operations and Production Management, 31(12), 1287-1310. DOI: 10.1108/01443571111187457
• 48.Ukko, J., Saunila, M., 2020. Understanding the practice of performance measurement in industrial collaboration: From design to implementation. Journal of Purchasing and Supply Management, 26(1). DOI: 10.1016/j.pursup.2019.02.001
• 49.Wouters, M., Wilderom, C., 2008. Developing performance-measurement systems as enabling formalization: A longitudinal field study of a logistics department. Accounting, Organizations and Society, 33(4-5), 488-516. DOI: 10.1016/j.aos.2007.05.002
• 50.Yang, G., Macnab, A., Yang, L., Fan, C., 2015. Developing performance measures and setting their targets for national research institutes based on strategy maps. Journal of Science and Technology Policy Management, 6(2), 165-186. DOI: 10.1108/JSTPM-12-2014-0042
• 51.Zairi, M., 1994. Measuring performance for business results. Springer Science & Business Media. https://books.google.pt/books?id=VfD7CAAAQBAJ
• 52.Ingaldi, M., Ulewicz, R., 2020. Problems with the Implementation of Industry 4.0 in Enterprises from the SME Sector. Sustainability, 12, 217. DOI: 10.3390/su12010217
• 53.Sá, J., Carvalho, A., Fonseca, L., Santos, G., Dinis-Carvalho, J., 2023. Science Based Targets and the factors contributing to the sustainable development of an organisation from a Literature review to a conceptual model. Production Engineering Archives, 29(3), 241-253.DOI: 10.30657/pea.2023.29.28
• 54.Voss, C.A., Tsikiktsis, N., Frohlich, M., 2002. Case research in operations management, International Journal of Operations & Production Management, 22, 195-219.
• 55.Xu, X., Lu, Y., Vogel-Heuser, B., Wang, L., 2021. Industry 4.0 and Industry 5.0-Inception, conception and perception, Journal of Manufacturing Systems, 61, 530-535, DOI: 10.1016/j.jmsy.2021.10.006

Uwagi

Opracowanie rekordu ze środków MNiSW, umowa nr POPUL/SP/0154/2024/02 w ramach programu "Społeczna odpowiedzialność nauki II" - moduł: Popularyzacja nauki (2025).