PL
 |
EN

PL EN

Preferencje help
Polish version English version Język
Widoczny [Schowaj] Abstrakt
Liczba wyników
Tytuł artykułu

A Systematic Mapping Study on Software Measurement Programs in SMEs

Autorzy
Tahir T. , Rasool G. , Noman M.
Treść / Zawartość
Pełne teksty:
tahir_a_systematic_1_2018.pdf
Identyfikatory
DOI
10.5277/e-Inf180106
Warianty tytułu
Języki publikacji
EN
Abstrakty
EN
Context: Software measurement programs are essential to understand, evaluate, improve and predict the software processes, products and resources. However, successful implementation of software measurement programs (MPs) in small and medium enterprises (SMEs) is challenging. Objective: To perform a detailed analysis of studies on MPs for highlighting the existing measurement models, tools, metrics selection methods and challenges for implementing MPs in SMEs. Methods: A Systematic Mapping Study (SMS) is conducted. Results: In total, 35 primary studies are comprehensively analyzed. We identified 29 software measurement models and 4 tools specifically designed for MPs in SMEs. Majority of the measurement models (51%) are built upon software process improvement approaches. With respect to measurement purposes of models, the distribution of MPs was identified as: characterization (63%), evaluation (83%), improvement (93%) and prediction (16%). Majority of primary studies discussed the use of measurement experts and experience (60%) followed by the use of measurement standards (40% and the use of automated tools (22%) for metrics selection in MPs. We found that the SMEs and large organization face different challenges as studies in SMEs report challenges that exist even before the implementation of MPs due to infrastructure and management processes of SMEs. The challenges reported by studies in large organizations are mostly related to the issues discovered while implementing MPs. Conclusion: The analysis of measurement models, tools, metrics selection methods and challenges of implementing MPs should help the SMEs to make a feasibility study before implementing a MP.
Słowa kluczowe
EN
Wydawca
Oficyna Wydawnicza Politechniki Wrocławskiej
Czasopismo
e-Informatica Software Engineering Journal
Rocznik
2018
Tom
Vol. 12, nr 1
Strony
133--165
Opis fizyczny
Bibliogr. 102 poz., tab., rys.
Twórcy
autor
Tahir T.
touseeftahir@ciitlahore.edu.pk
  • COMSATS Institute of IT, Department of Computer Science, Lahore, Pakistan
autor
Rasool G.
  • COMSATS Institute of IT, Department of Computer Science, Lahore, Pakistan
autor
Noman M.
  • COMSATS Institute of IT, Department of Computer Science, Lahore, Pakistan
Bibliografia
  • [1] P. Cocca and M. Alberti, “A framework to assess performance measurement systems in SMEs,” International Journal of Productivity and Performance Management, Vol. 59, No. 2, 2010, pp. 186–200.
  • [2] U. Loecher, “Small and medium-sized enterprises – Delimitation and the European definition in the area of industrial business,” European Business Review, Vol. 12, No. 5, 2000, pp. 261–264.
  • [3] M. Ayyagari, T. Beck, and A. Demirguc-Kunt, “Small and medium enterprises across the globe,” Small Business Economics, Vol. 29, No. 4, 2007, pp. 415–434.
  • [4] M. Khalique, N. Bontis, J. Abdul Nassir bin Shaari, and A. Hassan Md. Isa, “Intellectual capital in small and medium enterprises in Pakistan,” Journal of Intellectual Capital, Vol. 16, No. 1, 2015, pp. 224–238.
  • [5] N. Fenton and J. Bieman, Software metrics: A rigorous and practical approach. CRC Press, 2014.
  • [6] T. Tahir, G. Rasool, and C. Gencel, “A systematic literature review on software measurement programs,” Information and Software Technology, Vol. 73, 2016, pp. 101–121.
  • [7] M. Díaz-Ley, F. García, and M. Piattini, “Implementing a software measurement program in small and medium enterprises: A suitable framework,” IET Software, Vol. 2, No. 5, 2008, pp. 417–436.
  • [8] M. Díaz-Ley, F. García, and M. Piattini, “MIS-PyME software measurement capability maturity model – Supporting the definition of software measurement programs and capability determination,” Advances in Engineering Software, Vol. 41, No. 10, 2010, pp. 1223–1237.
  • [9] A.M. Bhatti, H.M. Abdullah, and C. Gencel, “A model for selecting an optimum set of measures in software organizations,” in European Conference on Software Process Improvement. Springer, 2009, pp. 44–56.
  • [10] M.K. Sharma, R. Bhagwat, and G.S. Dangayach, “Practice of performance measurement: experience from indian SMEs,” International Journal of Globalisation and Small Business, Vol. 1, No. 2, 2005, pp. 183–213.
  • [11] V. Claudia, M. Mirna, and M. Jezreel, “Characterization of software processes improvement needs in SMEs,” in International Conference on Mechatronics, Electronics and Automotive Engineering (ICMEAE. IEEE, 2013, pp. 223–228.
  • [12] I. Richardson and C.G. Von Wangenheim, “Guest editors’ introduction: Why are small software organizations different?” IEEE Software, Vol. 24, No. 1, 2007, pp. 18–22.
  • [13] C.Y. Laporte, S. Alexandre, and R.V. O’Connor, “A software engineering lifecycle standard for very small enterprises,” Software Process Improvement, 2008, pp. 129–141.
  • [14] B. Kitchenham, “What’s up with software metrics? – a preliminary mapping study,” Journal of Systems and Software, Vol. 83, No. 1, 2010, pp. 37–51.
  • [15] O. Gómez, H. Oktaba, M. Piattini, and F. García, “A systematic review measurement in software engineering: State-of-the-art in measures,” in International Conference on Software and Data Technologies. Springer, 2006, pp. 165–176.
  • [16] C. Catal and B. Diri, “A systematic review of software fault prediction studies,” Expert Systems with Applications, Vol. 36, No. 4, 2009, pp. 7346–7354.
  • [17] R. Malhotra, “A systematic review of machine learning techniques for software fault prediction,” Applied Soft Computing, Vol. 27, 2015, pp. 504–518.
  • [18] D. Radjenović, M. Heričko, R. Torkar, and A. Živkovič, “Software fault prediction metrics: A systematic literature review,” Information and Software Technology, Vol. 55, No. 8, 2013, pp. 1397–1418.
  • [19] T. Hall, S. Beecham, D. Bowes, D. Gray, and S. Counsell, “A systematic literature review on fault prediction performance in software engineering,” IEEE Transactions on Software Engineering, Vol. 38, No. 6, 2012, pp. 1276–1304.
  • [20] M. Unterkalmsteiner, T. Gorschek, A.M. Islam, C.K. Cheng, R.B. Permadi, and R. Feldt, “Evaluation and measurement of software process improvementóa systematic literature review,” IEEE Transactions on Software Engineering, Vol. 38, No. 2, 2012, pp. 398–424.
  • [21] K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic mapping studies in software engineering.” in EASE, Vol. 8, 2008, pp. 68–77.
  • [22] M. Sulayman and E. Mendes, “A systematic literature review of software process improvement in small and medium web companies,” Advances in Software Engineering, 2009, pp. 1–8.
  • [23] F.J. Pino, F. García, and M. Piattini, “Software process improvement in small and medium software enterprises: A systematic review,” Software Quality Journal, Vol. 16, No. 2, 2008, pp. 237–261.
  • [24] A. Ahmad and M.A. Babar, “Software architectures for robotic systems: A systematic mapping study,” Journal of Systems and Software, Vol. 122, 2016, pp. 16–39.
  • [25] K. Petersen, S. Vakkalanka, and L. Kuzniarz, “Guidelines for conducting systematic mapping studies in software engineering: An update,” Information and Software Technology, Vol. 64, 2015, pp. 1–18.
  • [26] F. García, M.F. Bertoa, C. Calero, A. Vallecillo, F. Ruíz, M. Piattini, and M. Genero, “Towards a consistent terminology for software measurement,” Information and Software Technology, Vol. 48, No. 8, 2006, pp. 631–644.
  • [27] S. Keele et al., “Guidelines for performing systematic literature reviews in software engineering,” in Technical report, Ver. 2.3 EBSE Technical Report. EBSE. sn, 2007.
  • [28] J.W. Creswell, Research design: Qualitative, quantitative, and mixed methods approaches. Sage Publications, 2013.
  • [29] N. Mack, C. Woodsong, K.M. MacQueen, G. Guest, and E. Namey, “Qualitative research methods: A data collectors field guide.” POPLine, 2005.
  • [30] R. Conradi and A.I. Wang, Empirical methods and studies in software engineering: experiences from ESERNET. Springer, 2003, Vol. 2765.
  • [31] N.E. Fenton and M. Neil, “Software metrics: Successes, failures and new directions,” Journal of Systems and Software, Vol. 47, No. 2, 1999, pp. 149–157. [32] G. Tom, Software Metrics. Chartwell-Bratt, 1976.
  • [33] R.B. Grady and D.L. Caswell, Software metrics: Establishing a company-wide program. Prentice Hall, 1987.
  • [34] V.R. Basili, G. Caldiera, and H.D. Rombach, “The goal question metric approach,” in Encyclopedia of Software Engineering. Wiley, 1994, pp. 528–532.
  • [35] R.E. Park, W.B. Goethert, and W.A. Florac, “Goal-driven software measurement. A guidebook,” Carnegie Mellon University, Pittsburgh, PA,
  • USA, Tech. Rep., 1996.
  • [36] L.C. Briand, C.M. Differding, and H.D. Rombach, “Practical guidelines for measurement-based process improvement,” Software Process Improvement and Practice, Vol. 2, No. 4, 1996, pp. 253–280.
  • [37] Ø. Moen, M. Gavlen, and I. Endresen, “Internationalization of small, computer software firms: Entry forms and market selection,” European Journal of Marketing, Vol. 38, No. 9/10, 2004, pp. 1236–1251.
  • [38] C. Larman and V.R. Basili, “Iterative and incremental developments. A brief history,” Computer, Vol. 36, No. 6, 2003, pp. 47–56.
  • [39] A. Cockburn, Agile software development. Addison-Wesley Boston, 2002, Vol. 177.
  • [40] A. Boyd, “The goals, questions, indicators, measures (GQIM) approach to the measurement of customer satisfaction with e-commerce Web sites,” in Aslib proceedings, Vol. 54. MCB UP Ltd, 2002, pp. 177–187. [41] J. Motwani, “Critical factors and performance measures of TQM,” The TQM magazine, Vol. 13, No. 4, 2001, pp. 292–300.
  • [42] A. Abran, J.W. Moore, P. Bourque, and R. Dupuis, Eds., Guide to the Software Engineering Body of Knowledge (SWEBOK–2004 Version). IEEE Computer Society, 2004.
  • [43] A. Abran, L. Buglione, and A. Sellami, “Software measurement body of knowledge – initial validation using Vincenti’s classification of engineering knowledge types,” in Software Measurement Conference, 2004, pp. 1–16.
  • [44] S. Alexandre, A. Renault, and N. Habra, “POWPL: A gradual approach for software process improvement in SMEs,” in 32nd EUROMICRO Conference on Software Engineering and Advanced Applications. IEEE, 2006, pp. 328–335.
  • [45] A.H. Lee, W.C. Chen, and C.J. Chang, “A fuzzy AHP and BSC approach for evaluating performance of IT department in the manufacturing industry in Taiwan,” Expert Systems with Applications, Vol. 34, No. 1, 2008, pp. 96–107.
  • [46] P. Garengo, S. Biazzo, and U.S. Bititci, “Performance measurement systems in SMEs: A review for a research agenda,” International Journal of Management Reviews, Vol. 7, No. 1, 2005, pp. 25–47.
  • [47] O.T. Pusatli, “Software measurement activities in small and medium enterprises: An empirical assessment,” Acta Polytechnica Hungarica, Vol. 8, No. 5, 2011, pp. 21–42.
  • [48] C. Wang, E. Walker, and J. Redmond, “Explaining the lack of strategic planning in SMEs: The importance of owner motivation,” International Journal of Organisational Behaviour, Vol. 12, No. 1, 2007, pp. 1–16. [49] J. Chen, “Development of Chinese small and medium-sized enterprises,” Journal of Small Business and Enterprise Development, Vol. 13, No. 2, 2006, pp. 140–147.
  • [49] J. Chen, “Development of Chinese small and medium-sized enterprises,” Journal of Small Business and Enterprise Development, Vol. 13, No. 2, 2006, pp. 140–147.
  • [50] M. Hudson, A. Smart, and M. Bourne, “Theory and practice in SME performance measurement systems,” International Journal of Operations & Production Management, Vol. 21, No. 8, 2001, pp. 1096–1115.
  • [51] J. Iversen and L. Mathiassen, “Cultivation and engineering of a software metrics program,” Information Systems Journal, Vol. 13, No. 1, 2003, pp. 3–19.
  • [52] B. Daubner, “Empowering software development environments by automatic software measurement,” in 11th International Symposium Software Metrics. IEEE, 2005, p. 3.
  • [53] A. Coletta, “An industrial experience in assessing the capability of non-software processes using ISO/IEC 15504,” Software Process: Improvement and Practice, Vol. 12, No. 4, 2007, pp. 315–319.
  • [54] H. Abushama, M. Ramachandran, and P. Allen, PRISMS: an approach to software process improvement for small to medium enterprises. UOFK, 2016.
  • [55] Systems and software engineering – Measurement process, International Organization for Standardization Standard ISO/IEC 15939:2007, 2007.
  • [56] Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – Quality measure elements, International Organization for Standardization Standard ISO/IEC 25021:2012, 2012.
  • [57] Product quality – Part 1: Quality model, International Organization for Standardization Standard ISO/IEC 9126-1:2001, 2001.
  • [58] Information Technology – Software Product Evaluation – Parts 1-6, International Organization for Standardization Standard ISO/IEC 14598, 2001.
  • [59] Systems and software engineering – Vocabulary, International Organization for Standardization Standard ISO/IEC/IEEE 24765:2010, 2010.
  • [60] “Capability maturity model integration (CMMI) (continuous representation),” Carnegie Mellon University, Tech. Rep. ICMU/SEI-2002-TR-011, 2002. [Online]. https://resources.sei.cmu.edu/asset_files/TechnicalReport/2002_005_001_14039.pdf
  • [61] “Capability maturity model integration (CMMI) (staged representation),” Carnegie Mellon University, Tech. Rep. CMU/SEI-2002-TR-012, SEI, 2002. [Online]. https://www.sei.cmu.edu/reports/02tr029.pdf
  • [62] Software engineering: Software product quality requirements and evaluation (square) quality measure elements, International Organization for Standardization Standard ISO/IEC 2502-1, 2005.
  • [63] Product quality – Part 2: Quality model, International Organization for Standardization Standard ISO/IEC 9126-2:2001, 2001.
  • [64] Product quality – Part 3: Quality model, International Organization for Standardization Standard ISO/IEC 9126-3:2001, 2001.
  • [65] Product quality – Part 4: Quality model, International Organization for Standardization Standard ISO/IEC 9126-4:2001, 2001.
  • [66] F.G. Wilkie, D. McFall, and F. McCaffery, “An evaluation of CMMI process areas for small-to medium-sized software development organisations,” Software Process: Improvement and Practice, Vol. 10, No. 2, 2005, pp. 189–201.
  • [67] J.A. Williams, “The impact of motivating factors on implementation of ISO 9001:2000 registration process,” Management Research News, Vol. 27, No. 1/2, 2004, pp. 74–84.
  • [68] M. Jørgensen, “A review of studies on expert estimation of software development effort,” Journal of Systems and Software, Vol. 70, No. 1, 2004, pp. 37–60.
  • [69] T. Tahir and C. Gencel, “A structured goal based measurement framework enabling traceability and prioritization,” in 6th International Conference on Emerging Technologies (ICET). IEEE, 2010, pp. 282–286.
  • [70] C. Gencel, K. Petersen, A.A. Mughal, and M.I. Iqbal, “A decision support framework for metrics selection in goal-based measurement programs: GQM-DSFMS,” Journal of Systems and Software, Vol. 86, No. 12, 2013, pp. 3091–3108.
  • [71] J. Soini, “A survey of metrics use in finnish software companies,” in International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 2011, pp. 49–57.
  • [72] P. Carbone, L. Buglione, L. Mari, and D. Petri, “A comparison between foundations of metrology and software measurement,” IEEE Transactions on Instrumentation and Measurement, Vol. 57, No. 2, 2008, pp. 235–241.
  • [73] C. Kaner et al., “Software engineering metrics: What do they measure and how do we know?” in 10th International Software Metrics Symposium, METRICS. IEEE Computer Society, 2004.
  • [74] A. Meneely, B. Smith, and L. Williams, “Validating software metrics: A spectrum of philosophies,” ACM Transactions on Software Engineering and Methodology (TOSEM), Vol. 21, No. 4, 2012, p. 24.
  • [75] M. Díaz-Ley, F. García, and M. Piattini, “Implementing software measurement programs in non mature small settings,” Software Process and Product Measurement, 2008, pp. 154–167.
  • [76] M. Díaz-Ley, F. García, and M. Piattini, “Software measurement programs in SMEs–defining software indicators: A methodological framework,” Product-Focused Software Process Improvement, 2007, pp. 247–261.
  • [77] M. Diaz-Ley, F. García, and M. Piattini, “MIS-PyME software measurement maturity model-supporting the definition of software measurement programs,” Product-Focused Software Process Improvement, 2008, pp. 19–33.
  • [78] A. Tosun, A. Bener, and B. Turhan, “Implementation of a software quality improvement project in an SME: A before and after comparison,” in 35th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 2009, pp. 203–209.
  • [79] E. Amrina and S.M. Yusof, “A proposed manufacturing performance measures for small and medium-sized enterprises (SMEs),” in Proceedings of the 10th Asia Pacific Industrial Engineering and Management Systems (APIEMS) Conference, 2009, pp. 623–629.
  • [80] J.A.C.M. Villalón, G.C. Agustín, T.S.F. Gilabert, A.D.A. Seco, L.G. Sánchez, and M.P. Cota, “Experiences in the application of software process improvement in SMEs,” Software Quality Journal, Vol. 10, No. 3, 2002, pp. 261–273.
  • [81] I. Richardson and K. Ryan, “Software process improvements in a very small company,” Software Quality Professional, Vol. 3, No. 2, 2001, pp. 23–35.
  • [82] F. McCaffery, M. Pikkarainen, and I. Richardson, “AHAA–Agile, hybrid assessment method for automotive, safety critical SMEs,” in Proceedings of the 30th International Conference on Software Engineering. ACM, 2008, pp. 551–560.
  • [83] F.T. Shah, S. Shamail, and N. Ahmad Akhtar, “Lean quality improvement model for quality practices in software industry in Pakistan,” Journal of Software: Evolution and Process, Vol. 27, No. 4, 2015, pp. 237–254.
  • [84] S. Bibi, I. Stamelos, G. Gerolimos, and V. Kollias, “BBN based approach for improving the software development process of an SME – A case study,” Journal of Software: Evolution and Process, Vol. 22, No. 2, 2010.
  • [85] P. Clarke and R.V. OíConnor, “The meaning of success for software SMEs: An holistic scorecard based approach,” in European Conference on Software Process Improvement. Springer, 2011, pp. 72–83.
  • [86] E. Caballero, J.A. Calvo-Manzano, and T. San Feliu, “Introducing scrum in a very small enterprise: A productivity and quality analysis,” Systems, Software and Service Process Improvement, 2011, pp. 215–224.
  • [87] C.G. von Wangenheim, T. Punter, and A. Anacleto, “Software measurement for small and medium enterprises,” in Proceeding 7th International Conference on Empirical Assessment in Software Engineering (EASE), 2003.
  • [88] M. Sulayman, C. Urquhart, E. Mendes, and S. Seidel, “Software process improvement success factors for small and medium Web companies: A qualitative study,” Information and Software Technology, Vol. 54, No. 5, 2012, pp. 479–500.
  • [89] N. Ohsugi, K. Fushida, N. Inoguchi, H. Arai, H. Yamanaka, T. Niwa, M. Fujinuki, M. Tomura, and T. Kitani, “Using trac for empirical data collection and analysis in developing small and medium-sized enterprise systems,” in ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 2015, pp. 1–9.
  • [90] H.M. Haddad and D.E. Meredith, “Instituting software metrics in small organizations: A practical approach,” in Eighth International Conference on Information Technology: New Generations (ITNG). IEEE, 2011, pp. 227–232.
  • [91] A. Potter, P. Childerhouse, R. Banomyong, and N. Supatn, “Developing a supply chain performance tool for smes in thailand,” Supply Chain Management: An International Journal, Vol. 16, No. 1, 2011, pp. 20–31.
  • [92] A. Janes, V. Lenarduzzi, and A.C. Stan, “A continuous software quality monitoring approach for small and medium enterprises,” in Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering Companion. ACM, 2017, pp. 97–100.
  • [93] H. Ayed, N. Habra, and B. Vanderose, “AM-QuICk: A measurement-based framework for Agile methods customisation,” in Software Measurement and the 2013 Eighth International Conference on Software Process and Product Measurement (IWSM-MENSURA). IEEE, 2013, pp. 71–80.
  • [94] S. Suwanya and W. Kurutach, “Applying agility framework in small and medium enterprises,” Advances in Software Engineering, 2009, pp. 102–110.
  • [95] E. Irrazabal, F. Vásquez, R. Díaz, and J. Garzás, “Applying ISO/IEC 12207:2008 with SCRUM and Agile methods,” Software Process Improvement and Capability Determination, 2011, pp. 169–180.
  • [96] M. Díaz, F. García, and M. Piattini, “Defining, performing and maintaining software measurement programs: State of the art,” in IV Simposio Internacional de Sistemas de Informacióne, 2006, p. 13.
  • [97] J.C. Ruiz, Z.B. Osorio, J. Mejia, M. Muñoz, A.M. Ch, B.A. Olivares et al., “Definition of a hybrid measurement process for the models ISO/IEC 15504 – ISO/IEC 12207:2008 and CMMI Dev 1.3 in SMEs,” in Electronics, Robotics and Automotive Mechanics Conference (CERMA). IEEE, 2011, pp. 421–426.
  • [98] M. Jezreel, M. Mirna, N. Pablo, O. Edgar, G. Alejandro, and M. Sandra, “Identifying findings for software process improvement in SMEs: An experience,” in Ninth Electronics, Robotics and Automotive Mechanics Conference (CERMA). IEEE, 2012, pp. 141–146.
  • [99] F.J. Pino, F. Garcia, and M. Piattini, “Key processes to start software process improvement in small companies,” in Proceedings of the 2009 ACM symposium on Applied Computing. ACM, 2009, pp. 509–516.
  • [100] R. Chalmeta, S. Palomero, and M. Matilla, “Methodology to develop a performance measurement system in small and medium-sized enterprises,” International Journal of Computer Integrated Manufacturing, Vol. 25, No. 8, 2012, pp. 716–740.
  • [101] M. Lepmets and T. McBride, “Process improvement for the small and agile,” in European Conference on Software Process Improvement. Springer, 2012, pp. 310–318.
  • [102] D. Homchuenchom, C. Piyabunditkul, H. Lichter, and T. Anwar,“SPIALS: A light-weight software process improvement self-assessment tool,” in 5th Malaysian Conference in Software Engineering (MySEC). IEEE, 2011, pp. 195–199.
Uwagi
PL
Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2018).
Typ dokumentu
Bibliografia
Identyfikator YADDA
bwmeta1.element.baztech-f3b8232b-4931-4929-8aa0-0079e9b7949d
JavaScript jest wyłączony w Twojej przeglądarce internetowej. Włącz go, a następnie odśwież stronę, aby móc w pełni z niej korzystać.