Application of data envelopment analysis to evaluation of IT project success

• Autorzy: Kuchta Dorota , Despotis Dimitris , Frączkowski Kazimierz , Stanek Stanisław

Identyfikatory

DOI

10.5277/ord190302

• Języki publikacji: EN

Abstrakty

EN

The paper is devoted to the problem of IT project success definition and measurement seen against the background of IT human resources management organisation. A review of the state of art of the problem shows that the assessment of IT project success is highly equivocal and subjective. Various methods may produce conflicting results. The paper proposes basically one novelty: an original approach to IT project success evaluation based on Data Development Analysis (DEA). DEA has been developed and used for years, but for other purposes. The new method, contrasted with two other which are based on other philosophies, is applied to a sample of Polish IT projects. This application shows that the new method in some cases completely changes the optics and emphasizes such aspects of IT projects which are neglected by other methods. It also shows that a combination of the proposed method with other IT project measurement methods may substantially increase the fairness of IT project team members and managers’ appraisal, and hence the motivation of human resources in IT projects.

Słowa kluczowe

EN

IT project success; data envelopment analysis; IT project input; IT project output

• Wydawca: Oficyna Wydawnicza Politechniki Wrocławskiej
• Czasopismo: Operations Research and Decisions
• Rocznik: 2019
• Tom: Vol. 29, No. 3
• Strony: 17--36
• Opis fizyczny: Bibliogr. 43 poz., rys., tab.

Twórcy

autor

Kuchta Dorota

• Department of Computer Science and Management, Wrocław University of Science and Technology, ul. Łukasiewicza 5, 50-371 Wrocław, Poland

autor

Despotis Dimitris

• University of Pireus, Pireus, Greece

autor

Frączkowski Kazimierz

• Department of Computer Science and Management, Wrocław University of Science and Technology, ul. Łukasiewicza 5, 50-371 Wrocław, Poland

autor

Stanek Stanisław

• General Tadeusz Kościuszko Military University of Land Forces in Wrocław, ul. Czajkowskiego 109, 51-150 Wrocław, Poland

Bibliografia

• [1] ABRAN A., Software project estimation: The fundamentals for providing high quality information to decision makers, Wiley-IEEE Computer Society, 2015.
• [2] ASHLEY D.B., LAURIE C.S., JASELSKIS E.J., Determinants of construction project success, Proj. Manage. J., 1987, 18 (2), 69–79.
• [3] BACCARINI D., The logical framework method for defining project success, Proj. Manage. J., 1999, 30 (4), 25–32.
• [4] BERGMANN T., KARWOWSKI W., Agile project management and project success: A literature review, Adv. Intell. Sys. Comput., 2019, 783, 405–414.
• [5] CAMILLIERI E., Project success: Critical factors and behaviours, Gower Publishing Company, 2011.
• [6] CARROLL C.F., IT success and failure: The Standish Group CHAOS report success factors, [Online] Available from: http://www.cafe-encounter.net/p1183/it-success-and-failurethe-chaos-report-factors (accessed 1 January 2014).
• [7] CHAN A.P.C., CHAN A.P.L., Key performance indicators for measuring construction success, Benchmarking: An Int. J., 2004, 11 (2), 203–222.
• [8] CHARNES A., COOPER W.W., RHODES E., Measuring the efficiency of decision making units, Eur. J. Oper. Res., 1978, 2, 429–444.
• [9] CHENG M.Y., TSAI H.C., SUDJONO E., Evolutionary fuzzy hybrid neural network for dynamic project assessment in construction industry, Aut. Constr., 2012, 21, 46–51.
• [10] CHOW T.,CAO D.B., A survey study for critical success factors in agile software projects, J. Syst. Soft., 2008, 81, 961–971.
• [11] COOK W.D., ZHU J., Rank order data in DEA: A general framework, Eur. J. Oper. Res., 2006, 174, 1021–1038.
• [12] COOPER W.W., SEIFORD L.M., TONE K., Introduction to data envelopment analysis and its uses (with DEA-solver software and references), Springer, 2006.
• [13] DAVIS K., Different stakeholder groups and their perceptions of project success, Int. J. Proj. Manage., 2014, 32 (2), 189–201.
• [14] DVOŘÁKOVÁ M., KLICNAROVÁ J., On the differences between DEA and selected MCDM methods, International Scientific Conference INPROFORUM 2017, 338–343.
• [15] DESPOTIS D., KUCHTA D., Fuzzy weak link approach to the two stage DEA, RAIRO, Oper. Res., 2019, DOI: 10.1051/ro/2019093.
• [16] DEUTSCH M.S., An exploratory analysis relating the software project management process to project success, IEEE Trans. Eng. Manage., 1991, 38 (4), 365–375.
• [17] EILAT H., GOLANY B., SHTUB A., R&D project evaluation: An integrated DEA and balanced scorecard approach, Omega, 2008, 36 (5), 895–912.
• [18] FAN D., Analysis of critical success factors in IT project management, Proc. 2nd International Conference on Industrial and Information Systems, Dalian, China, 2010, 487–490.
• [19] FRĄCZKOWSKI K., GŁADYSZ B., KUCHTA D., STANEK S., Selection of IT projects to be implemented in an organisation to maximise their success probability, J. Dec. Syst., 2018, 27 (S1), 111–122.
• [20] FRĄCZKOWSKI K., KARWACKA D., Examination of factors influencing the success or failure of IT projects, [In:] C. Orłowski, Z. Kowalczuk, E. Szczerbicki (Eds.), Knowledge and information technology management, Pomorskie Wydawnictwo Naukowo-Techniczne, PWNT, Gdańsk 2008, 375–382.
• [21] GŁADYSZ B., KUCHTA D., Multicriteria analysis of the success of research projects, Mult. Crit. Dec. Making, 2017, 12, 22–35.
• [22] GOMES J.,ROMÃO M.,Improving the success of IS/IT projects in healthcare: Benefits and project management approaches, Adv. Intel. Syst. Comp., 2016, 444, 547–556.
• [23] GREER M., Handbook of human performance technology, Jossey-Bass, Wiley, Chichester 1999.
• [24] IJPM, International Journal of Project Management, Special issue on Project benefit management, 2016, 34 (4).
• [25] KUCHTA D., SKOWRON D., Classification of R&D projects and selection of R&D project management concept, R&D Management, 2016, 46 (5), 831–841.
• [26] KUCHTA D., SKORUPKA D., DUCHACZEK A., KOWACKA M., Modified, stakeholders perspective based DEA approach in IT and R&D project ranking, Proc. 18th International Conference on Enterprise Information Systems (ICEIS), Rome 2016, 2, 158–165.
• [27] LIM C.S., MOHAMED M.Z., Criteria of project success, Int. J. Proj. Manage., 1999, 17 (4), 243–248.
• [28] MAGLYAS A., NIKULA U., SMOLANDER K., Comparison of two models of success prediction in software development projects, Proc. 6th Central and Eastern European Software Engineering Conference (CEE-SECR), Moscow 2010, 43–57.
• [29] NAHOD M.M., VUKOMANOVIC M., RADUJKOVIC M., The impact of ICB 3.0 competences on project management success, Procedia: Social and Behavioral Sciences, 2012, 74, 244–254.
• [30] PINTO J.K., SLEVIN D.P., Critical success factors in successful project implementation, IEEE Trans. Eng. Manage., 1988, 34 (1), 22–27.
• [31] QUELOPANA A., FLORES V., A framework for IS project success analysis: A proposal, Proc. Iberian Conference on Information Systems and Technologies (CISTI), Cáceres, Spain, 2018, 1–5.
• [32] RAZ T., SHENHAR A.J., DVIR D., Risk management, project success and technological uncertainty, R&D Manage., 2002, 32 (2), 101–109.
• [33] SERRADOR P., PINTO J.K., Does Agile work? A quantitative analysis of agile project success, Int. J. Proj. Manage., 2015, 33 (5), 1040–1051.
• [34] SOWLATI T., PARADI J.C., SULD C., Information systems project prioritization using data envelopment analysis, Math. Comp. Model., 2005, 41 (11–12), 1279–1298.
• [35] SHASHI K.N.R., NAI T.R.G., SUMA V., SLI: A new metric to determine success of a software project, Proc. International Conference on Electronics and Communication Systems, ICECS 2014, Coimbatore, India, arXiv:1407.8377.
• [36] STANKOVIC D., NIKOLIC D., DJORDJEVIC M., CAO D.B., A survey study of critical success factors in agile software projects in former Yugoslavia IT companies, J. Syst. Soft., 2013, 86 (6), 1663–1678.
• [37] WATERIDGE J., How can IS/IT projects be measured for success?, Int. J. Proj. Manage., 1998, 16 (1), 59–63.
• [38] WIJESINGHE R., SCHEEPERS H., MCLOUGHLI S., Defining the optimal level of business benefits within IS/IT proj cts: Insights from benefit identification practices adopted in an IT service management (ITSM) project, Proc. 26th Australasian Conference on Information Systems (ACIS), 2015, Adelaida, Australia, arXiv:1606.03537.
• [39] WRAY B., MATHIEU R., Evaluating the performance of open source software projects using data envelopment analysis, Information Management and Computer Security, 2008, 16 (5), 449–462.
• [40] YOUSEF A.H., GAMAL A., WARDA A., MAHMOUD M., Software projects success factors identification using data mining, Proc. International Conference on Computer Engineering and Systems, 2006, 447–453.
• [41] YOURDON E., Death march: The complete software developer’s guide to surviving mission impossible projects, Prentice Hall, 1997.
• [42] ZIJIANG Y., PARADI J.C., A DEA evaluation of software project efficiency, Proc. Industrial Engineering and Engineering Management Conference, Hong Kong 2009, 1723–1727.
• [43] ZWIKAEL O., CHIH Y.Y., MEREDITH J.R., Project benefit management: Setting effective target benefits, Int. J. Proj. Manage., 2018, 36 (4), 650–658.

Uwagi

Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2019).