Measuring the impact of academic policy innovation

• Autorzy: Akynova A. , Jumasheva S. , Rybiński K.

Identyfikatory

DOI

10.29119/1641-3466.2018.119.1

• Języki publikacji: EN

Abstrakty

EN

This paper presents application of Data science models to the quality assurance processes at the university. In 2015 Narxoz University in Almaty, Kazakhstan introduced a major change to its academic policy. Final year bachelor students were required to complete team-based diploma projects, focused on solving real business problems, instead of writing standard, often purely descriptive and theoretical diploma theses. This article uses data science models (linear regression, logit and CART) to analyze the effects of this policy change on recent graduates’ employability and wage levels using results of telephone survey conducted among 1956 graduates in 2015 and 2016. Estimated models show that students who have firm plans to find jobs, acquire valuable competences when preparing bachelor diploma and actively participate in student life, have higher probability of employment and earn higher wages. It means that the process of writing bachelor diploma should be carefully designed and monitored and that student learning outcomes also depend on their extra-curricular activity. Such analysis provides deep and interesting insights into the learning and assessment processes and should be a part of annual quality assurance review in every university. For example, results indicate that grading practices at Narxoz require a major review, as graduates with higher GPA did not exhibit higher employability nor higher wages. Similarly, curricula of some specializations (majors) should be reviewed due to low employment rate of graduates. Appropriate changes have already been implemented at Narxoz in 2017. Finally, we found that economic shocks have much stronger short-term impact on recent graduates’ employability and wages than reforms of academic curricula.

Słowa kluczowe

EN

academic policy; innovation; graduates’ employability; graduates’ wages; quality assurance; learning outcomes; data science

PL

polityka naukowa; innowacyjność; szanse absolwentów na zatrudnienie; płace absolwentów; zapewnienie jakości; efekt uczenia; data science

• Wydawca: Wydawnictwo Politechniki Śląskiej
• Czasopismo: Zeszyty Naukowe. Organizacja i Zarządzanie / Politechnika Śląska
• Rocznik: 2018
• Tom: z. 119
• Strony: 7--29
• Opis fizyczny: Bibliogr. 50 poz.

Twórcy

autor

Akynova A.

• Narxoz University, Almaty, Kazakhstan

autor

Jumasheva S.

• Narxoz University, Almaty, Kazakhstan

autor

Rybiński K.

• Vistula University, Warsaw, Poland

Bibliografia

• 1. Artess, J., Hooley, T., and Mellors-Bourne, R. (2017). Employability: A Review of the Literature 2012-2016. York: Higher Education Academy.
• 2. Blicblau, A.S., Nelson, T.L., and Dini, K. (2014). Outcomes for students working in industry. In A. Bainbridge-Smith, Z.T. Qi, G.S. Gupta (Eds.), Engineering the Knowledge Economy: Collaboration, Engagement & Employability – Proceedings of the 25th Annual Conference of the Australasian Association for Engineering Education (pp. 796-803). Barton, ACT: School of Engineering & Advanced Technology, Massey University.
• 3. Borden, V.M.H., and Rajecki, D.W. (2009). First-year employment outcomes of psychology baccalaureates: relatedness, preparedness, and prospects. Teaching of Psychology, 27(3), 164-168 (first published July 1, 2000).
• 4. Braun, E.M.P., Sheikh, H., and Hannover, B. (2011). Self‐rated competences and future vocational success: a longitudinal study. Assessment & Evaluation in Higher Education, 36(4), 417-427, doi: 10.1080/02602938.2010.534762.
• 5. Bristol, D.G. (2002). Using alumni research to assess a veterinary curriculum and alumni employment and reward patterns. Journal of Veterinary Medical Education, 29(1), 20-27.
• 6. Bruni, F. (2015). Where You Go Is Not Who You'll Be: An Antidote to the College Admissions Mania. Grand Central Publishing (17 March 2015).
• 7. Brunello, G., and Cappellari, L. (2008). The labour market effects of alma mater: evidence from Italy. Economics of Education Review, 27(5), 564-574. doi: 10.1016/j.econedurev. 2007.05.004.
• 8. Cabrera, A.F., Weerts, D.J., and Vidal, J. (2003). Alumni surveys: Three conceptualizations to alumni research. In J. Vidal (Ed.), Métodos de análisis de la inserción laboral de los universitarios (pp. 55-80). León, España: Universidad de León Press.
• 9. Cabrera, A.F., Weerts, D.J., and Zulick, B.J. (2005). Making an Impact with Alumni Surveys. In Weerts, D.J., and Vidal, J. (Eds.), Enhancing Alumni Reseach European and American Perspectives. New Directions for Institutional Research, No.126. San Francisco: Jossey-Bass.
• 10. Cranmer, S. (2007). Enhancing graduate employability: best intentions and mixed outcomes. Studies in Higher Education, 31 (2), 169-184. doi: 10.1080/030750706005 72041.
• 11. El-Temtamy, O.K., O'Neill, K., and Midraj S. (2016). Undergraduate employability training and employment: a UAE study. Higher Education, Skills and Work-Based Learning, 6(1), 100-115.
• 12. Gault, J., Leach, E., and Duey, M. (2010). Effects of business internships on job marketability: the employers' perspective. Education + Training, 52(1), 76-88.
• 13. Gault, J., Redington, J., and Schlager, T. (2000). Undergraduate business internships and career success: are they related? Journal of Marketing Education, 22(1), 45-53.
• 14. Gokuladas, V.K. (2011). Predictors of employability of engineering graduates in campus recruitment drives of Indian software services companies. International Journal of Selection and Assessment, 19, 313-319. doi:10.1111/j.1468-2389.2011.00560.x.
• 15. Hergert, M. (2009). Student perceptions of the value of internships in business education. American Journal of Business Education, 2(8).
• 16. Humburg M., Velden R., and Verhagen A. (2013). The employability of higher education graduates: the employers’ perspective. Luxembourg: Publications office of the European Union.
• 17. Hurst, J.L., and Good, L.K. (2010). A 20-year evolution of internships: implications for retail interns, employers and educators. The International Review of Retail, Distribution and Consumer Research, 20(1), 175-186. doi: 10.1080/09593960903498342.
• 18. Iftikhar, H., McNally, S., and Shqiponja, T. (2009). University quality and graduate wages in the UK. IZA Discussion Paper, No. 4043.
• 19. Jackson, D. (2013). Factors influencing job attainment in recent bachelor graduates: evidence from Australia. Higher Education, 68(1), 135-153. doi:10.1007/s10734-013-9696-7.
• 20. Jackson, D. (2015). Employability skill development in work -integrated learning: barriers and best practice, Studies in Higher Education, 40(2), 350-367. doi: 10.1080/03075079. 2013.842221.
• 21. Javier, B. (2015). Determinants of employability of the information technology graduates in Cagayan State University, Philippines. Countryside Development Research Journal, 3(1), 43-52.
• 22. Jolly, R.W., Yu, L., and Orazem, P.F. (2009). After they graduate: an overview of the Iowa State University alumni survey. Economics Working Papers (2002-2016), 134. Retrieved from http://lib.dr.iastate.edu/econ_las_workingpapers/134.
• 23. Knouse, S.B., Tanner, J.R., and Harris, E.W. (1999). The relation of college internships, college performance, and subsequent job opportunity. Journal of Employment Counseling, 36, 35-43. doi:10.1002/j.2161-1920.1999.tb01007.x.
• 24. Kumarasinghe, P.J., and Udeshika K.A.A. (2015, December 7-8). Extra-Curricular Activities and Employability of Undergraduates in Sri Lanka. Paper presented at the 12th International Conference on Business Management (ICBM) 2015, Colombo, Sri Lanka.
• 25. Lalanie, P.P., and Withanawasam, M.P.K. (2012). Internship of undergraduates, their academic performance and future employability, presented at First International Economic Research Conference of the Sri Lanka Forum of University Economists. Colombo: University of Colombo.
• 26. Lau, H-H., Hsu, Y., Acosta, S., and Hsu, T-L. (2014). Impact of participation in extra-curricular activities during college on graduate employability: an empirical study of graduates of Taiwanese business schools, Educational Studies, 40(1), 26-47, doi: 10.1080/03055698.2013.830244.
• 27. Li, T., and Zhang, J. (2010). What determines employment opportunity for college graduates in China after higher education reform? China Economic Review, 21(1), 38-50.
• 28. Little, R. (1988), Missing-data adjustments in large surveys, Journal of Business and Economic Statistics 6, 287-296.
• 29. Loh, W-Y. (2011). Classification and regression trees, Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 1(1), January 2011.
• 30. Mason, G., Williams, G., and Cranmer, S. (2009). Employability skills initiatives in higher education: what effects do they have on graduate labour market outcomes? Education Economics, 17(1), 1-30. doi: 10.1080/09645290802028315.
• 31. Millican, J., and Bourner, T. (2011). Student‐community engagement and the changing role and context of higher education, Education + Training, 53(2/3), 89-99, https://doi.org/ 10.1108/00400911111115645.
• 32. Nunley, J.M., Pugh, A., Romero, N., and Seals R.A. (2016). College major, internship experience, and employment opportunities: estimates from a résumé audit. Labour Economics, 38, 37-46.
• 33. Park, C.K. (2015). Student factors on employment of engineering graduates: a Korean University case. Asian Journal of Innovation and Policy, 4(3). doi:10.7545/ajip. 2015.4.288.
• 34. Park, C.K., and Seol, S.S. (2016). Role of university on undergraduate employment by disciplines. Asian Journal of Innovation and Policy, 5(1). doi:10.7545/ajip.2016.5.1.035.
• 35. Pinto, L.H., and Ramalheira, D.C. (2017). Perceived employability of business graduates: The effect of academic performance and extracurricular activities. Journal of Vocational Behavior, 99, 165-178. http://dx.doi.org/10.1016/j.jvb.2017.01.005.
• 36. Qenani, E., MacDougall, N., and Sexton, C. (2014). An empirical study of self-perceived employability: Improving the prospects for student employment success in an uncertain environment. Active Learning in Higher Education, 15(3), 199-213.
• 37. Ramalheira, D.C. (2015). The effect of the grade point average and of extracurricular activities on the perceived employability of business job applicants (Master’s dissertation). Retrieved from http://www.rcaap.pt/detail.jsp?id=oai:repositorio-aberto.up.pt:10216/80399.
• 38. Rayner, G., and Papakonstantinou, T. (2015). Student perceptions of their workplace preparedness: making work-integrated learning more effective. Asia-Pacific Journal of Cooperative Education, 16(1), 13-24.
• 39. Reddan, G., and Rauchle, M. (2016). Quality WIL + CDL = Employability. In M. Harvey & A. Rowe (Eds.), WIL 2020: Pushing the boundaries – Proceedings of the 2016 ACEN National Conference (pp. 28-31). Springvale South: Australian Collaborative Education Network Limited.
• 40. Richardson, J., Jackling, B., Henschke, K., and Tempone, I. (2013). Developing a collaborative model of industry feedback for work placement of business students. Asia-Pacific Journal Of Cooperative Education, 14(1), 27-43.
• 41. Rigsby, J.T., Addy N., Herring, C., and Polledo, D. (2013). An examination of internships and job opportunities. Journal of Applied Business Research, 29(4), 1131-1144.
• 42. Roshchin, S., and Rudakov, V. (2015). Do graduates wages measure the quality of education? A review of existing studies. Voprosy obrazovaniya/Educational Studies (Moscow), 1, 138-171.
• 43. Rothman M., and Lampe, M. (2010). Business school internships: sources and resources. Psychological Reports, 106(2), 548-554.
• 44. Rumberger, R.W., and Thomas, S. (1993). The Economic returns to college major, quality and performance: a multi-leveI analysis of recent graduates, Economics of Education Review, 12(1), 1-19.
• 45. Sahama, T.R., Yarlagadda, P.K., Oloyede, A., and Willet, G. (2008, November). Impact of Work Integrated Learning (WIL) on graduate preparation for the manufacturing industry. Paper presented at the 9th Global Congress on Manufacturing and Management, Gold Coast, Australia.
• 46. Saunders, G., and Stivason, C. (2010). How are your graduates doing? Do they still love you? Contemporary Issues in Education Research, 3(5), 9-20.
• 47. Shoenfelt, E.L., L. Kottke, J.L., and Stone, N.J. (2012). Master’s and undergraduate industrial/organizational internships, Teaching of Psychology, 39(2), 100-106.
• 48. Thomas, S.L., and Zhang, L. (2005). Post-baccalaureate wage growth within four years of graduation: the effects of college quality and college major. Research in Higher Education, 46(4), 437-459. doi:10.1007/s11162-005-2969-y.
• 49. Varghese, M.E., Parker, L.C., Adedokun, O., Shively, M., Burgess, W., Childress, A., and Bessenbacher, A. (2012). Experiential internships: understanding the process of student learning in small business internships. Industry and Higher Education, 26(5), 357-367.
• 50. Yu, L., Burton, A., and Rivero-Arias, O. (2007). Evaluation of software for multiple imputation of semicontinuous data

Uwagi

PL

Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2019).