Digital Twin-Based Alternate Ego Modeling and Simulation: Eva Herzigová as a 3D MetaHuman Avatar

• Autorzy: Lăzăroiu, George , Gedeon, Tom , Szpilko, Danuta , Halicka, Katarzyna
• Języki publikacji: EN

Abstrakty

EN

Due to Dimension Studios and Unsigned Group, by likeness and movement digitization, the human supermodel Eva Herzigová’s highly realistic metahuman and 3D digital twin lead to perpetual career extension (e.g., on virtual runway shows by catwalk replication or in advertising campaigns by particular pose adoption), including in virtual worlds such as metaverse spaces, by use of extended reality technologies, in terms of virtual clothing, digital hair, skin texture, facial and body expressions, and makeup styling as avatar appearance and persona. In this paper, we show how, by likeness capturing (e.g., signature walk by motion capture shoot for face and body movement tracking) and virtual clothing, Eva Herzigová’s hyperreal 3D avatar (lifelike 3D digital human clone or realistic virtual human) is configured with subsequent restyled hair and make-up, 3D clothing modeling, and extended reality fashion shows on virtual catwalks or campaign shoots. We clarify that photographic reference materials and a sensorbased motion capture suit assisted Metahuman Creator in capturing facial and motion data for Eva Herzigová’s digital avatar, configuring realistic depiction and virtual activations of beauty standards, in addition to digital likeness, signature style, talent representation, and narrations, typifying digital human creation and presence in virtual worlds (e.g., for metaverse-based shoots). We conclude that Eva Herzigová’s hyperrealistic 3D digital human twin and MetaHuman avatar operate as a styled virtual alter ego and versatile personal brand extension by motion capture technologies for immersive virtual fashion shows, live video streams and broadcast, and digital wearable modeling.

Słowa kluczowe

PL

Eva Herzigová; bliźniak cyfrowy; hiperrealistyczny cyfrowy bliźniak 3D; wygląd i osobowość awatara MetaHuman; technologie przechwytywania ruchu; sztuczna inteligencja; AI

EN

Eva Herzigová; digital twin; hyperrealistic 3D digital human twin; MetaHuman avatar appearance and persona; motion capture technologies; artificial intelligence; AI

• Czasopismo: Engineering Management in Production and Services
• Rocznik: 2024
• Tom: Vol. 16, no. 3
• Strony: 1--14
• Opis fizyczny: Bibliogr. 28 poz., fot.

Twórcy

autor

Lăzăroiu, George

• Curtin University, Kent Street, Bentley Western Australia 6102, Australia Toronto Metropolitan University, 350 Victoria Str., ON M5B 2K3 Toronto, Canada,
• Cardiff Metropolitan University, Llandaff Campus, Western Avenue, CF5 2YB Cardiff, United Kingdom
• Spiru Haret University, 13 Ion Ghica Str., District 3, Bucharest, Romania

autor

Gedeon, Tom

• Curtin University, Kent Street, Bentley Western Australia 6102, Australia,

autor

Szpilko, Danuta

• Bialystok University of Technology, Wiejska 45A, 15-351 Bialystok, Poland,

autor

Halicka, Katarzyna

• Bialystok University of Technology, Wiejska 45A, 15-351 Bialystok, Poland,

Bibliografia

• Al-Emran, M., & Deveci, M. (2024). Unlocking the potential of cybersecurity behavior in the metaverse: Overview, opportunities, challenges, and future research agendas. Technology in Society, 77, 102498. doi: 10.1016/j.techsoc.2024.102498
• Alldieck, T., Zanfir, M., & Sminchisescu, C. (2022). Photorealistic monocular 3D reconstruction of humans wearing clothing. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, 1496-1505. doi: 10.1109/ CVPR52688.2022.00156
• Bertiche, H., Madadi, M., & Escalera, S. (2022). Neural cloth simulation. ACM Transactions on Graphics (TOG), 41(6), 220. doi: 10.1145/3550454.3555491
• Bugaj, M., Durana, P., & Lăzăroiu, G. (2023). Virtual navigation and digital twin simulation tools, Internet of Things-based decision support and big data computing systems, and image recognition and geolocation data processing algorithms in the virtual economy of the metaverse. Review of Contemporary Philosophy, 21, 137-153. doi: 10.22381/RCP2220238
• Chen, L., Peng, S., & Zhou, X. (2021). Towards efficient and photorealistic 3D human reconstruction: A brief survey. Visual Informatics, 5(4), 11-19. doi: 10.1016/ j.visinf.2021.10.003
• Correia, H. A., & Brito, J. H. (2023). 3D reconstruction of human bodies from single-view and multi-view images: A systematic review. Computer Methods and Programs in Biomedicine, 239, 107620. doi: 10.1016/ j.cmpb.2023.107620
• Cui, L., & Liu, J. (2023). Virtual human: A comprehensive survey on academic and applications. IEEE Access, 11, 123830-123845. doi: 10.1109/ACCESS.2023.3329573
• Ding, Y., He, H., & Mok, P. Y. (2024). Personalizing human avatars based on realistic 3D facial reconstruction. Multimedia Tools and Applications. doi: 10.1007/ s11042-024-19583-0
• Fjørtoft Ystgaard, K., Atzori, L., Palma, D., Heegaard, P. E., Bertheussen, L. E., Jensen, M. R., & De Moor, K. (2023). Review of the theory, principles, and design requirements of humancentric Internet of Things (IoT). Journal of Ambient Intelligence and Humanized Computing, 14, 2827-2859. doi: 10.1007/ s12652-023-04539-3
• Grupac, M., & Lăzăroiu, G. (2022). Image processing computational algorithms, sensory data mining techniques, and predictive customer analytics in the metaverse economy. Review of Contemporary Philosophy, 21, 205-222. doi: 10.22381/RCP21202213
• Jiang, M., Tian, Z., Yu, C., Shi, Y., Liu, L., Peng, T., Hu, X., & Yu, F. (2024). Intelligent 3D garment system of the human body based on deep spiking neural network. Virtual Reality & Intelligent Hardware, 6(1), 43-55. doi: 10.1016/j.vrih.2023.07.002
• Kliestik, T., Novak, A., & Lăzăroiu, G. (2022). Live shopping in the metaverse: Visual and spatial analytics, cognitive artificial intelligence techniques and algorithms, and immersive digital simulations. Linguistic and Philosophical Investigations, 21, 187-202. doi: 10.22381/lpi21202212
• Kliestik, T., & Lăzăroiu, G. (2023). Emotional state prediction and data visualization tools, generative artificial intelligence and workplace monitoring systems, and wearable sensor-based devices in immersive workspaces. Analysis and Metaphysics, 22, 43-61. doi: 10.22381/am2220233
• Lattas, A., Moschoglou, S., Ploumpis, S., Gecer, B., Deng, J., & Zafeiriou, S. (2023). FitMe: Deep photorealistic 3D morphable model avatars. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 8629-8640. doi: 10.1109/ CVPR52729.2023.00834
• Lee, J., & Joo, H. (2023). Locomotion-action-manipulation: Synthesizing human-scene interactions in complex 3D environments. IEEE/CVF International Conference on Computer Vision (ICCV), Paris, 9629-9640. doi: 10.1109/ICCV51070.2023.00886
• Lee, J., Nguyen, D., Kim, J., Kang, J., & Lee, S. (2024). Double reverse diffusion for realistic garment reconstruction from images. Engineering Applications of Artificial Intelligence, 127(B), 107404. doi: 10.1016/ j.engappai.2023.107404
• Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G.-J., Zhang, Y., Wang, X., Zhu, X., & Lei, Z. (2023). High-fidelity clothed avatar reconstruction from a single image. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, 8662-8672. doi: 10.1109/CVPR52729.2023.00837
• Liao, Z., & Waslander, S. L. (2024). Multi-view 3D object reconstruction and uncertainty modelling with neural shape prior. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 3086-3095. doi: 10.1109/WACV57701.2024.00307
• Sarakatsanos, O., PapazoglouChalikias, A., Boikou, M., Chatzilari, E., Jauk, M., Hafliger, U., Nikolopoulos, S., & Kompatsiaris, I. (2024). VR designer: Enhancing fashion showcases through immersive virtual garment fitting. Virtual Reality, 28, 70. doi: 10.1007/s10055-024-00945-w
• Uhlenberg, L., Derungs, A., & Amft, O. (2023). Co-simulation of human digital twins and wearable inertial sensors to analyse gait event estimation. Frontiers in Bioengineering and Biotechnology, 11, 1104000. doi: 10.3389/fbioe.2023.1104000
• Valaskova, K., Vochozka, M., & Lăzăroiu, G. (2022). Immersive 3D technologies, spatial computing and visual perception algorithms, and event modeling and forecasting tools on blockchain-based metaverse platforms. Analysis and Metaphysics, 21, 74-90. doi: 10.22381/am2120225
• Wang, A., Xu, Y., Sarafianos, N., Maier, R., Boyer, E., Yuille, A., & Tung, T. (2024). HISR: Hybrid implicit surface representation for photorealistic 3D human reconstruction. Proceedings of the AAAI Conference on Artificial Intelligence, 38(6), 5298-5308. doi: 10.1609/ aaai.v38i6.28337
• Xiang, D., Bagautdinov, T., Stuyck, T., Prada, F., Romero, J., Xu, W., Saito, S., Guo, J., Smith, B., Shiratori, T., Sheikh, Y., Hodgins, J., & Wu, C. (2022). Dressing avatars: Deep photorealistic appearance for physically simulated clothing. ACM Transactions on Graphics (TOG), 41(6), 222. doi: 10.1145/3550454.3555456
• Yang, Z., Su, B., & Wen, J.-R. (2023). Synthesizing longterm human motions with diffusion models via coherent sampling. Proceedings of the 31st ACM International Conference on Multimedia, 3954-3964. doi: 10.1145/3581783.3611887
• Yu, J., Alhilal, A., Zhou, T., Hui, P., & Tsang, D. H. K. (2024). Attention-based QoE-aware digital twin empowered edge computing for immersive virtual reality. IEEE Transactions on Wireless Communications. doi: 10.1109/TWC.2024.3380820
• Zhang, J., Jiang, Z., Yang, D., Xu, H., Shi, Y., Song, G., Xu, Z., Wang, X., & Feng, J. (2023a). AvatarGen: A 3D generative model for animatable human avatars. In Karlinsky, L., Michaeli, T., & Nishino, K. (Eds.), Computer Vision – ECCV 2022 Workshops (pp. 668–685). Springer, Cham. doi: 10.1007/978-3-031-25066-8_39
• Zhang, Z., Sun, L., Yang, Z., Chen, L., & Yang, Y. (2023b). Global-correlated 3D-decoupling transformer for clothed avatar reconstruction. Proceedings of the 37th International Conference on Neural Information Processing Systems, 343, 7818-7830.
• Zvarikova, K., Trnka, M., & Lăzăroiu, G. (2023). Immersive extended reality and remote sensing technologies, simulation modeling and spatial data acquisition tools, and cooperative decision and control algorithms in a real-time interoperable decentralized metaverse. Linguistic and Philosophical Investigations, 22, 43-59. doi: 10.22381/lpi2220233

Identyfikatory

DOI

10.2478/emj-2024-0020