Experience with instantiating an automated testing process in the context of incremental and evolutionary software development

• Autorzy: Górski, J. , Witkowicz, M.
• Języki publikacji: EN

Abstrakty

EN

The purpose of this article is to present experiences from testing a complex AJAX-based Internet-system which is under development for more than five years. The development process follows incremental and evolutionary lifecycle model and the system is delivered in subsequent releases. Delivering a new release involves both, the new tests (related to the new and/or modified functionalities) and the regression tests (after their possible refactoring). The article positions the testing process within the context of change management and describes the applied testing environment. Details related to documenting the test cases are given. The problem of automation of tests is discussed in more detail and a gradual transition from manual to automated tests is described. Experimental data related to the invested effort and the benefits resulting from tests automation are given. Plans for further development of the described approach are also presented.

Słowa kluczowe

EN

automated testing process; ncremental and evolutionary software development; experimental data

• Czasopismo: e-Informatica Software Engineering Journal
• Rocznik: 2011
• Tom: Vol. 5, nr 1
• Strony: 51--63
• Opis fizyczny: Bibliogr. 31 poz.

Twórcy

autor

Górski, J.

autor

Witkowicz, M.

• Departament of Software Engineering, Gdansk University of Technology,

Bibliografia

• [1] I. Sommerville, Software Engineering, eighth edition ed. England: Pearson Education, 2007.
• [2] R. Patton, Software Testing, second edition ed.United States of America: Sams Publishing,2006.
• [3] P. Grubb and A. A. Takang, Software Maintenance Concepts and Practice. Singapore: World Scientific Printers, 2003.
• [4] J. Górski, “Trust-it - a framework for trust cases,”in Proc. Workshop on Assurance Cases for Security- The Metrics Challenge. Edinburgh, UK:The 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks DSN, 2007, pp. 204–209.
• [5] J. Górski et al., “Trust-it research project,” information Assurance Group, Gdansk University of Technology (18.10.2011). [Online]. Available:http://iag.pg.gda.pl/iag/?s=research&p=trust_cases
• [6] D. Crane, E. Pascarello, and D. James, Ajax in Action. Manning Publications Co., 2006.
• [7] J. Eichorn, Understanding AJAX: Using JavaScript to Create Rich Internet Applications.Prentice Hall, 2006.
• [8] A. Marchetto, P. Tonella, and F. Ricca, “Testing techniques applied to ajax web applications,” 2007, workshop on Web Quality, Verification and Validation (WQVV), at the International Conference on Web Engineering.
• [9] A. Mesbah, “Analysis and testing of ajax-based single-page web applications,” Ph.D. dissertation,Delft University of Technology, 2009.
• [10] NOR-STA, “Support for achieving and assessing conformance to norms and standards,”(04.11.2011). [Online]. Available:http://www.nor-sta.eu/
• [11] L. Cyra, J. Miler, M. Witkowicz, and M. Olszewski,“Advanced design solutions of a rich internet application,” in Zwinnosc i dyscyplina w inzynierii oprogramowania, A. Jaszkiewicz,B. Walter, and A. Wojciechowski, Eds., Politechnika Poznanska. Poznan: Nakom, 2007, pp.35–47, (In Polish).
• [12] PostgreSQL. (10.06.2010). [Online]. Available:http://www.postgresql.org/
• [13] JBoss. (10.06.2010). [Online]. Available:http://www.jboss.org/
• [14] D. Flanagan, JavaScript: The Definitive Guide.O’Reilly, 2001.
• [15] SunMicrosystems, “Developer resources for java technology,” (10.06.2010). [Online]. Available:http://java.sun.com/
• [16] W3C, “Simple object access protocol,”(10.06.2010). [Online]. Available: http://www.w3.org/TR/soap/
• [17] C. Larman and V. R. Basili, “Iterative and incremental development: A brief history,” Computer,vol. Volume 36, no. 6, pp. 47–56, June 2003.
• [18] PCMagazine-Encyclopedia, “Iterative development,”(06.04.2011). [Online]. Available:http://www.pcmag.com/encyclopedia/
• [19] C. Larman, Agile and Iterative Development: A Manager’s Guide. Addison-Wesley Professional,2003.
• [20] Mantis. (10.06.2010). [Online]. Available:http://www.mantisbt.org/
• [21] Subversion. (10.06.2010). [Online]. Available:http://subversion.tigris.org/
• [22] Testng. (10.06.2010). [Online]. Available:http://testng.org/
• [23] Selenium, “Selenium web application testing system.” [Online]. Available: http://seleniumhq.org/projects/remote-control/
• [24] W3C, “Extensible markup language,”(10.06.2010). [Online]. Available: http://www.w3.org/XML/
• [25] A. V. Deursen, L. Moonen, A. Bergh, and G. Kok, “Refactoring test code,” in Proceedings of the 2nd International Conference on Extreme Programming and Flexible Processes in Software Engineering. Sardinia, Italy: XP2001, 2001, pp.92–95.
• [26] E. B. Swanson, “The dimensions of maintenance,”in Proceedings of the 2nd international conference on software engineering, San Francisco,1976, pp. 492–497.
• [27] R. Black, Advanced Software Testing - Vol. 2:Guide to the Istqb Advanced Certification as an Advanced Test Manager. USA: Rock Nook Inc.,2009, vol. 2.
• [28] R. Black and N. Atsushi, “Advanced risk based test results reporting: putting residual quality risk measurement in motion,” Software Test &Quality Assurance, vol. Volume 7, no. issue 8, pp.28–33, 2010.
• [29] R. Black, K. Young, and P. Nash, “A case study in successful risk-based testing at ca,” (06.04.2011). [Online]. Available:http://www.softed.com/resources/
• [30] F. Redmill, “Theory and practice of risk-based testing,” Software Testing, Verification and Reliability,vol. Volume 15, pp. 3–20, 2005.
• [31] Y. Jia and M. Harman, “An analysis and survey of the development of mutation testing,” CREST Centre, King’s College London, Technical ReportTR-09-06, 2009