On generating Bayesian nets from small local qualitative data for software development effort and quality prediction

• Autorzy: Radliński Ł.
• Języki publikacji: EN

Abstrakty

EN

The aim of this paper is to investigate if it is possible to build accurate Bayesian net models for software development effort and quality prediction under two assumptions for model generation: (1) no expert knowledge is incorporated, (2) only small local qualitative data is used. Models generated in this study provide predictions with medium level of accuracy, yet still keeping the literature average. Thus, they can be used to make only rough estimations at the early software development stage. However, they can be a useful base for detailed models incorporating expert knowledge and tailored for individual needs.

Słowa kluczowe

EN

Bayesian nets; effort prediction; quality prediction; local data; process factors

PL

sieci bayesowskie; przewidywany wysiłek; przewidywana jakość; dane lokalne; czynniki technologiczne

• Wydawca: Komisja Informatyki Polskiej Akademii Nauk, Oddział w Gdańsku
• Czasopismo: Metody Informatyki Stosowanej
• Rocznik: 2011
• Tom: nr 2
• Strony: 121--136
• Opis fizyczny: Bibliogr. 42 poz., rys., tab.

Twórcy

autor

Radliński Ł.

• University of Szczecin, Department of Information Systems Engineering

Bibliografia

• [1] AgenaRisk. Agena, Ltd., 2009 [online] http://www.agenarisk.com [accessed: 2011]
• [2] Bai C.G., Hu Q.P., Xie M., Ng S.H. Software failure prediction based on a Markov Bayesian network model. Journal of Systems and Software, Vol. 74(3), 2005, pp. 275-282
• [3] Bayes T. An essay towards solving a Problem in the Doctrine of Chances. By the late Rev. Mr. Bayes, communicated by Mr. Price, in a letter to John Canton, M.A. and F.R.S. Philosophical Transactions of the Royal Society London, Vol. 53, 1763, pp. 370-418
• [4] Bibi S., Stamelos I. Software Process Modeling with Bayesian Belief Networks. Proc. of the International Software Metrics Symposium, Chicago, 2004
• [5] Boetticher G., Menzies T., Ostrand T. PROMISE Repository of Empirical Software Engineering Data, West Virginia University, Department of Computer Science, 2010 [online] http://promisedata.org/repository [accessed: 2010]
• [6] Cangussu J.W., DeCarlo R.A., Mathur A.P. Using sensitivity analysis to validate a state variable model of the software test process. IEEE Transactions on Software Engineering, Vol. 29(5), 2003, pp. 430–443
• [7] Cockram T. Gaining Confidence in Software Inspection Using a Bayesian Belief Model. Software Quality Journal, Vol. 9(1), 2001, pp. 31–42.
• [8] Dabney J.B., Barber G., Ohi D. Predicting Software Defect Function Point Ratios Using a Bayesian Belief Network. Proc. of the 2nd International Workshop on Predictor Models in Software Engineering, Philadelphia, PA, 2006
• [9] Darwiche A. Modeling and Reasoning with Bayesian Networks. Cambridge University Press, 2009
• [10] de Melo A.C.V., Sanchez A.J. Software maintenance project delays prediction using Bayesian Networks. Expert Systems with Applications, Vol. 34, 2008, pp. 908-919
• [11] del Salgado Martinez J., del Aguina Cano I.M. A Bayesian Network for Predicting the Need for a Requirements Review. [in:] Meziane F., Vadera S. (eds.) Artificial Intelligence Applications for Improved Software Engineering Development: New Prospects. Information Science Reference, New York, 2008, pp. 106-128
• [12] Fenton N., Hearty P., Neil M., Radliński Ł. Software Project and Quality Modelling Using Bayesian Networks. [in:] Meziane F., Vadera S. (eds.) Artificial Intelligence Applications for Improved Software Engineering Development: New Prospects. Information Science Reference, New York, 2008, pp. 1-25
• [13] Fenton N., Marsh W., Neil M., Cates P., Forey S., Tailor M. Making Resource Decisions for Software Projects. Proc. of the 26th International Conference on Software Engineering, Washington, DC, IEEE Computer Society, 2004, pp. 397–406
• [14] Fenton N., Neil M., Marsh W., Hearty P., Radliński Ł., Krause P. On the effectiveness of early life cycle defect prediction with Bayesian Nets. Empirical Software Engineering, Vol. 13, 2008, pp. 499–537
• [15] Fenton N.E., Neil M.., Marsh W., Krause P., Mishra R. Predicting Software Defects in Varying Development Lifecycles using Bayesian Nets. Information and Software Technology, Vol. 43(1), 2007, pp. 32–43
• [16] Genie. Decision Systems Laboratory, University of Pittsburgh, 2009 [online] http://genie.sis.pitt.edu [accessed: 2010]
• [17] Hearty P., Fenton N., Marquez D., Neil M. Predicting Project Velocity in XP using a Learning Dynamic Bayesian Network Model. IEEE Transactions on Software Engineering, Vol. 37(1), 2009, pp. 124–137
• [18] Jensen F.V. An Introduction to Bayesian Networks. UCL Press, London, 1996
• [19] Kitchenham B.A., Pickard L.M., MacDonell S.G., Shepperd M.J. What accuracy statistics really measure. IEE Proceedings Software, Vol. 148(3), 2001, pp. 81–85
• [20] Mendes E., Mosley N. Bayesian Network Models for Web Effort Prediction: A Comparative Study. IEEE Transactions on Software Engineering, Vol. 34, 2008, pp. 723-737
• [21] Mendes E. The Use of Bayesian Networks for Web Effort Estimation: Further Investigation. Proc. of the 8th International Conference on Web Engineering, Yorktown Heights, NJ, 2008, pp. 203-216
• [22] Musilek P., Pedrycz W., Nan Sun, Succi G. On the Sensitivity of COCOMO II Software Cost Model. Proc. of the 8th IEEE Symposium on Software Metrics, 2002, pp. 13–20
• [23] Neapolitan R.E., Learning Bayesian Networks. Pearson Prentice Hall, Upper Saddle River, 2004
• [24] Pai G., Bechta-Dugan J., Lateef K. Bayesian Networks applied to Software IV&V. Proc. of the 29th Annual IEEE/NASA Software Engineering Workshop, IEEE Computer Society, Washington, DC, 2005, pp. 293-304
• [25] Pai G.I., Dugan J.B. Empirical Analysis of Software Fault Content and Fault Proneness Using Bayesian Methods. IEEE Transactions on Software Engineering, Vol. 33(10), 2007, pp. 675-686
• [26] Pearl J. Bayesian Networks: A Model of Self-Activated Memory for Evidential Reasoning. (UCLA Technical Report CSD-850017). Proc. of the 7th Conference of the Cognitive Science Society, University of California, Irvine, 1985, pp. 329–334
• [27] Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, 1988
• [28] Poole D., Review of Modeling and Reasoning with Bayesian Networks. 2009 [online] http://www.cambridge.org/us/catalogue/catalogue.asp?isbn=9780521884389 [accessed: 2011]
• [29] Radlinski L. A Survey of Bayesian Net Models for Software Development Effort Prediction. International Journal of Software Engineering and Computing, Vol. 2(2), 2010, pp. 95-109
• [30] Radliński Ł., Fenton, N., Neil, M., Marquez D. Improved Decision-Making for Software Managers Using Bayesian Network. Proc. of the 11th IASTED International Conference Software Engineering and Applications, Cambridge, MA, 2007, pp. 13–19
• [31] Radlinski L. Improved Software Project Risk Assessment Using Bayesian Nets. Ph.D. Thesis, Queen Mary, University of London, London, 2008
• [32] Radliński Ł. Predicting Defect Types in Software Projects. Polish Journal of Environmental Studies, Vol. 18(3B), 2009, pp. 311-315
• [33] Radliński Ł. Software Development Effort and Quality Prediction Using Bayesian Nets and Small Local Qualitative Data. Proc. of the 22nd International Conference on Software Engineering and Knowledge Engineering, Redwood City, CA, 2010, pp. 113-116
• [34] Russell S., Norvig P. Artificial Intelligence. A Modern Approach. Second Edition. Pearson Education, Inc., Upper Saddle River, 2003
• [35] Saltelli A., Chan K., Scott E.M. (eds.) Sensitivity Analysis. John Wiley & Sons, 2000
• [36] Stensrud E., Foss T., Kitchenham B., Myrtveit I. An Empirical Validation of the Relationship Between the Magnitude of Relative Error and Project Size. Proc. of the 8th IEEE Symposium on Software Metrics, 2002, pp. 3–12
• [37] Stewart B. Predicting project delivery rates using the Naive–Bayes classifier. Journal of Software Maintenance and Evolution: Research and Practice, Vol. 14, 2002, pp. 161–179
• [38] van Koten C., Gray A.R. An application of Bayesian network for predicting objectoriented software maintainability. Information and Software Technology, Vol. 48, 2006, pp. 59-67
• [39] Wagner S. A Bayesian network approach to assess and predict software quality using activity-based quality models. Proc. of the 5th International Conference on Predictor Models in Software Engineering, New York, ACM Press, 2009
• [40] Wagner S. Global Sensitivity Analysis of Predictor Models in Software Engineering, Proc. of the 3rd International Workshop on Predictor Models in Software Engineering, International Conference on Software Engineering, IEEE Computer Society, Washington, DC, 2007, p. 3
• [41] Wooff D.A., Goldstein M., Coolen F.P.A. Bayesian Graphical Models for Software Testing. IEEE Transactions on Software Engineering, Vol. 28(5), 2002, pp. 510–525
• [42] Zhou Y., Würsch M., Giger E., Gall H.C., Lü J. A Bayesian Network Based Approach for Change Coupling Prediction. Proc. of the 15th Working Conference on Reverse Engineering, Washington, DC, IEEE Computer Society, 2008, pp. 27–36