Quantitative evaluation of stereoscopic augmented reality visualization using an optical see-through head-mounted display

• Autorzy: Żuk Magdalena , Majak Marcin , Szczur Izabela , Popek Michał , Świątek-Najwer Ewelina

Identyfikatory

DOI

10.37190/ABB-02296-2023-02

• Języki publikacji: EN

Abstrakty

EN

: The authors of the current study aimed to propose a calibration method for accurate augmented reality visualisation using an optical see-through head-mounted display, and to qualitatively evaluate visualisation accuracy for the application in computer assisted surgery. Methods: An adaptation of stereo single-point active alignment method was proposed as the calibration procedure together with verification. Three tests were performed: display of points in 3D space, on the plane and on the surface of a skull phantom on inexperience users (5 participants) and experienced users (17 participants). Results: The highest accuracy of visualization was obtained for skull phantom visualisation for an inexperienced user (3.00 mm, std 0.75 mm), while the lowest accuracy was obtained in a 3D visualisation test for an inexperienced user (22.95 mm, std 18.04 mm). The largest error was related to the depth component and amounted to 18.49 mm, std 18.10 mm for an inexperienced user. Conclusions: It is possible to achieve relatively high visualisation accuracy (less than 5 mm for visualisation in space) for selected users but providing it for the group of inexperienced users seems to remain a major challenge. The accuracy of point indication can be substantially and statistically significantly increased by visualising objects on surfaces. The proposed methods and obtained results can serve as a basis for further implementation of augmented reality visualisation on an optical see-through head-mounted display in applications requiring high-quality augmented reality guidance of manual tasks.

Słowa kluczowe

EN

augmented reality; optical a see-through head-mounted display; computer aided surgery; single point active aliment method

• Wydawca: Oficyna Wydawnicza Politechniki Wrocławskiej
• Czasopismo: Acta of Bioengineering and Biomechanics
• Rocznik: 2023
• Tom: Vol. 25, no. 1
• Strony: 173--182
• Opis fizyczny: Bibliogr. 18 poz., rys., tab., wykr.

Twórcy

autor

Żuk Magdalena

• Faculty of Mechanical Engineering, Department of Mechanics, Material and Biomedical Engineering, Wrocław University of Science and Technology, Wrocław, Poland.

autor

Majak Marcin

• Faculty of Mechanical Engineering, Department of Mechanics, Material and Biomedical Engineering, Wrocław University of Science and Technology, Wrocław, Poland.

autor

Szczur Izabela

• Faculty of Mechanical Engineering, Department of Mechanics, Material and Biomedical Engineering, Wrocław University of Science and Technology, Wrocław, Poland.

autor

Popek Michał

• Faculty of Mechanical Engineering, Department of Mechanics, Material and Biomedical Engineering, Wrocław University of Science and Technology, Wrocław, Poland.

autor

Świątek-Najwer Ewelina

• Faculty of Mechanical Engineering, Department of Mechanics, Material and Biomedical Engineering, Wrocław University of Science and Technology, Wrocław, Poland.

Bibliografia

• [1] AZUMA R., A survey of augmented reality, Teleoper. Virtual Environ., 1997, 6 (4), 355–385.
• [2] ITOH Y., LANGLOTZ T., SUTTON J., PLOPSKI A., Towards indistinguishable augmented reality: A survey on optical seethrough head-mounted displays, ACM Comput. Surv., 2021, 54 (6), 1–36.
• [3] GRUBERT J., ITOH Y., MOSER K., SWAN J.E., A survey of calibration methods for optical see-through head-mounted displays, IEEE Trans. Vis. Comput. Graph., 2018, 24 (9), 2649–2662.
• [4] TUCERYAN M., GENC Y., NAVAB N., Single-point active alignment method (SPAAM) for optical see-through hmd calibration for augmented reality, Teleoper. Virtual Environ., 2002, 11 (3), 259–276.
• [5] GENC Y., TUCERYAN M., NAVAB N., Practical solutions for calibration of optical see-through devices, Proc. Int. Symp. Mix. Augment. Real., 2002, 169.
• [6] GENC Y., SAUER F., WENZEL F., TUCERYAN M., NAVAB N., Optical see-through HMD calibration: A stereo method validated with a video see-through system, Proc. IEEE ACM Int. Symp. Augment. Real., 2000, 165–174.
• [7] ZHANG Z., WENG D., LIU Y., A modular calibration framework for 3D interaction system based on optical see-through head-mounted displays in augmented reality, Int. Conf. Vir. Real. Vis., 2016, 393–400.
• [8] MCGARRITY E., TUCERYAN M., OWEN C., GENC Y., NAVAB N., Evaluation of optical see-through systems, Proc. Int. Conf. Augment. Virtual Environ. 3D Imag., 2001, 18–21.
• [9] TANG A., ZHOU J., OWEN C., Evaluation of calibration procedures for optical see-through head-mounted displays, Proc 2nd IEEE ACM Int. Sym. Mix. Augment. Real., 2003, 161–168, DOI: 10.1109/ISMAR.2003.1240699.
• [10] JUN H., KIM G., A calibration method for optical see-through head-mounted displays with a depth camera, IEEE Virtual Reality (VR), 2016, 103–111, DOI: 10.1109/VR.2016.7504693.
• [11] MOSER K., ITOH Y., OSHIMA K., SWAN J.E., KLINKER G., SANDOR C., Subjective evaluation of a semi-automatic optical see- through head-mounted display calibration technique, IEEE Trans. Vis. Comput. Graph., 2015, 21 (4), 491–500.
• [12] MCGARRITY E., TUCERYAN M., OWEN C., GENC Y., NAVAB N., Evaluation of optical see-through systems, Proc. Int. Conf. Augment. Virtual Environ. 3D Imag., 2001, 18–21.
• [13] VENKATESAN M., MOHAN H., RYAN J.R. et al., Virtual and augmented reality for biomedical applications, Cell. Rep. Med., 2021, 2 (7).
• [14] BOGDANOVA R., BOULANGER P., ZHENG B., Depth perception of surgeons in minimally invasive surgery, Surg. Inov., 2016, 23 (5), 515–524, DOI: 10.1177/1553350616639141.
• [15] PIETRUSKI P., MAJAK M., ŚWIĄTEK-NAJWER E. et al., Supporting mandibular resection with intraoperative navigation utilizing augmented reality technology – A proof of concept study, J. Craniomaxillofac. Surg., 2019, 47 (6), 854–859.
• [16] MAJAK M., ŻUK M., ŚWIĄTEK-NAJWER E., POPEK M., PIETRUSKI P., Augmented reality visualization for aiding biopsy procedure according to computed tomography based virtual plan, Acta Bioeng. Biomech., 2021, 23 (2), 81–89.
• [17] MCGARRITY E., GENC Y., TUCERYAN M., OWEN C., NAVAB N., A new system for online quantitative evaluation of optical see-through augmentation, Proc. IEEE ACM Int. Symp. Augment Real., 2001a, 157–166.
• [18] PIETRUSKI P., MAJAK M., ŚWIĄTEK-NAJWER E. et al., Supporting fibula free flap harvest with augmented reality: A proof of concept study, Laryngoscope, 2020, 130 (5), 1173–1179.

Uwagi

Opracowanie rekordu ze środków MNiSW, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2024).