Applicability of augmented and virtual reality for education in robotics

• Autorzy: Prokopiuk Norbert , Falkowski Piotr

Identyfikatory

DOI

10.14313/JAMRIS/3‐2022/25

• Języki publikacji: EN

Abstrakty

EN

The rapid development of automatic control and robotics requires an innovative approach to teaching. This is especially important in the case of studies at the academic level and in vocational schools, where training with expensive robotic stations is necessary. A solution to this problem may be substituting these with augmented reality (AR) and virtual reality (VR) due to their significantly lower costs. AR/VR technologies have an advantage interms of low‐cost and effective practices in robotics. The described content is an outcome of the MILAN project, wherein those technologies are used for the purpose of online courses. This includes providing access to virtual laboratories via a mobile application and the real‐life training stations connected to the network. This paper provides an overview of the available AR/VR applications implemented in robotics education and a detailed description of related best practices. The main sections contain a detailed methodology for designing an AR mobile tool for learning robotics in the AR environment. Moreover, the main challenges encountered during the development phase were listed and analysed. Additionally, this paper presents the possible future use of the application with the associated benefits. The literature overview and conclusions may be used to design similar online courses with an interactive form of teaching practical industrial robots programming.

Słowa kluczowe

EN

augmented reality; education; Industry 4.0; robotics; virtual reality

• Wydawca: Łukasiewicz Industrial Research Institute for Automation and Measurements PIAP
• Czasopismo: Journal of Automation Mobile Robotics and Intelligent Systems
• Rocznik: 2022
• Tom: Vol. 16, No. 3
• Strony: 65--74
• Opis fizyczny: Bibliogr. 31 poz., rys.

Twórcy

autor

Prokopiuk Norbert

• Warsaw University of Technology, Plac Politechniki 1, Warsaw, 00‑661

autor

Falkowski Piotr

• ŁUKASIEWICZ Research Network – Industrial Research Institute for Automation and Measurements PIAP, Al. Jerozolimskie 202, Warsaw, Warsaw University of Technology, 02‑486, Plac Politechniki 1, Warsaw, 00‑661

Bibliografia

• [1] S. Vaidya, P. Ambad, and S. Bhosle, “Industry 4.0–a glimpse,” Procedia manufacturing, vol. 20, pp. 233–238, 2018.
• [2] E. M. Onyema, N. C. Eucheria, F. A. Obafemi, S. Sen, F. G. Atonye, A. Sharma, and A. O. Alsayed, “Impact of coronavirus pandemic on education,” Journal of Education and Practice, vol. 11, no. 13, pp. 108–121, 2020.
• [3] V. Román‑Ibáñ ez, F. A. Pujol‑Ló pez, H. Mora‑Mora, M. L. Pertegal‑Felices, and A. Jimeno‑Morenilla, “A low‑cost immersive virtual reality system for teaching robotic manipulators programming,” Sustainability, vol. 10, no. 4, p. 1102, 2018.
• [4] A. Rukangu, A. Tuttle, and K. Johnsen, “Virtual reality for remote controlled robotics in engineering education,” in 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 2021, pp. 751–752.
• [5] L. Pérez, E. Diez, R. Usamentiaga, and D. F. Garcı́a, “Industrial robot control and operator training using virtual reality interfaces,” Computers in Industry, vol. 109, pp. 114–120, 2019.
• [6] M. Hernández‑Ordoñ ez, M. A. Nuñ o‑Maganda, C. A. Calles‑Arriaga, O. Montañ o‑Rivas, and K. E.Bautista Hernández, “An education application for teaching robot arm manipulator concepts using augmented reality,” Mobile Information Systems, vol. 2018, 2018.
• [7] B. Bogosian, L. Bobadilla, M. Alonso, A. Elias, G. Perez, H. Alhaffar, and S. Vassigh, “Work in progress: Towards an immersive robotics training for the future of architecture, engineering, and construction workforce,” in 2020 IEEE World Conference on Engineering Education (EDUNINE). IEEE, 2020, pp. 1–4.
• [8] Y.‑H. Su, C.‑Y. Chen, S.‑L. Cheng, C.‑H. Ko, and K.‑Y. Young, “Development of a 3d ar‑based interface for industrial robot manipulators,” in 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2018, pp. 1809–1814.
• [9] I. Verner, M. Reitman, D. Cuperman, T. Yan, E. Finkelstein, and T. Romm, “Exposing robot learning to students in augmented reality experience,” in International Conference on Remote Engineering and Virtual Instrumentation. Springer, 2018, pp. 610–619.
• [10] B. Zhong, J. Zheng, and Z. Zhan, “An exploration of combining virtual and physical robots in robotics education,” Interactive Learning Environments, pp. 1–13, 2020.
• [11] K. A. Herrera, J. A. Rocha, F. M. Silva, and V. H. Andaluz, “Training systems for control of mobile manipulator robots in augmented reality,” in 2020 15th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 2020, pp. 1–7.
• [12] A. Mallik and V. Kapila, “Interactive learning of mobile robots kinematics using ARCore,” in 2020 5th International Conference on Robotics and Automation Engineering (ICRAE). IEEE, 2020, pp. 1–6.
• [13] V. Kuts, T. Otto, E. G. Caldarola, G. E. Modoni, and M. Sacco, “Enabling the teaching factory leveraging a virtual reality system based on the digital twin,” in Proceedings of the 15th Annual EuroVr Conference. VTT Technical Research Centre of Finland, Ltd, 2018.
• [14] T. Kaarlela, S. Pieskä , and T. Pitkäaho, “Digital twin and virtual reality for safety training,” in 2020 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom). IEEE, 2020, pp. 000 115–000 120.
• [15] G. Michalos, P. Karagiannis, S. Makris, Odž . Tokçalar, and G. Chryssolouris, “Augmented reality (AR) applications for supporting human‑robot interactive cooperation,” Procedia CIRP, vol. 41, pp. 370–375, 2016.
• [16] M. Jasiulewicz‑Kaczmarek and A. Gola, “Maintenance 4.0 technologies for sustainable manufacturing‑an overview,” IFAC‑PapersOnLine, vol. 52, no. 10, pp. 91–96, 2019.
• [17] “ARCore supported devices,” https://developers.google.com/ar/devices, accessed: 2021‑7‑6.
• [18] “Multifunctional innovative learning assisting network for VET in advanced manufacturing (MILAN) – multifunctional innovative learning assisting network for VET in advanced manufacturing (MILAN),” http://milan‑project.eu/en/, accessed: 2021‑7‑6.
• [19] P. Falkowski, Z. Pilat, P. Arapi, M. Tamre, P. Dulencin, J. Homza, and M. Hajduk, “The concept f using AR and VR technologies in the vocational training system in robotics and automation,”in International Conference on Robotics in Education (RiE). Springer, 2020, pp. 318–325.
• [20] “ABB IRB 4600 product speciϐication,”https://search.abb.com/library/Download.aspx?DocumentID=3HAC032885‑001& LanguageCode=en&DocumentPartId=&Action=Launch, accessed: 2021‑7‑6.
• [21] R. R. Serrezuela, M. AƵ . T. Cardozo, D. L. Ardila, andC. A. C. Perdomo, “A consistent methodology for the development of inverse and direct kinematics of robust industrial robots,” ARPN Journal of Engineering and Applied Sciences, vol. 13, no. 01, pp. 293–301, 2018.
• [22] Robot installations 2019: Global economic downturn and trade tensions leave their marks, “Executive summary world robotics 20industrial robots,” https://ifr.org/img/worldrobotics/Executive_Summary_WR_2020_Industrial_Robots_1.pdf,accessed: 2021‑7‑6.
• [23] RobotWorx, “How much do industrial robots cost?” https://www.robots.com/faq/how‑much‑do‑industrial‑robots‑cost, accessed: 2021‑7‑6.
• [24] “How much do industrial robots cost?”https://sp‑automation.co.uk/how‑much‑do‑industrial‑robots‑cost‑3/, Sep. 2019, accessed: 2021‑7‑6.
• [25] R. Asari, “Automotive industrial robot ‑ total cost of ownership,” 08 2018.
• [26] “How much does it cost to build an AR/VR application: Estimating an augmented reality app development cost,”https://www.clavax.com/blog/how‑much‑ar‑vr‑app‑development‑cost‑in‑2019, acces‑sed: 2021‑7‑6.
• [27] “How much does app maintenance cost in 2021?” https://www.mobileappdaily.com/cost‑to‑maintain‑an‑app, accessed: 2021‑7‑6.
• [28] C. Li, L. Fu, and L. Wang, “Innovate engineering education by using virtual laboratory platform based industrial robot,” in 2018 Chinese Control And Decision Conference (CCDC). IEEE, 2018, pp. 3467–3472.
• [29] N. M. Alzahrani, “Augmented reality: A systematic review of its beneϐits and challenges in e‑learning contexts,” Applied Sciences, vol. 10, no. 16, p. 5660, 2020.
• [30] S. Criollo‑C, D. Abad‑Vásquez, M. Martic‑Nieto, F. A. Velásquez‑G, J.‑L. Pérez‑Medina, and S. Luján‑Mora, “Towards a new learning ex‑
• perience through a mobile application with augmented reality in engineering education,”Applied Sciences, vol. 11, no. 11, 2021. [On‑line]. Available: https://www.mdpi.com/2076‑3417/11/11/4921
• [31] P. Plaza, E. Sancristobal, G. Carro, M. Blazquez,A. Menacho, F. Garcı́a‑Loro, C. Perez, J. Muñoz,E. Tovar, J. Sluss et al., “Portable blended mooclaboratory,” in 2019 IEEE Learning With MOOCS (LWMOOCS). IEEE, 2019, pp. 15–20.

Uwagi

Opracowanie rekordu ze środków MEiN, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2022-2023).