Real Time Virtual Human Hand Using Leap Motion Controller

• Autorzy: Satheeshkumar R. , Arivoli R.

Identyfikatory

DOI

10.24425/ijet.2021.137836

• Języki publikacji: EN

Abstrakty

EN

The research of robotics needs a good and accurate control. The proposed concept is touch less and non-verbal communication with the use of leap motion controller. The concept has two major parts: first part is “device perceive hand finger moments and send signal”, second part is robotic hand interfaced with PIC microcontroller which receives signal and controls robotic hand. The paper aims to link virtual environment with real time environment. The virtual environment is consisting of leap motion controller and laptop, real time environment is consisting of microcontroller and robotic arm. In real time environment parodist is converts into virtual environment.

Słowa kluczowe

EN

gesture; leap motion controller; robotic arm

• Wydawca: Polish Academy of Sciences, Committee of Electronics and Telecommunication
• Czasopismo: International Journal of Electronics and Telecommunications
• Rocznik: 2021
• Tom: Vol. 67, No. 3
• Strony: 471--476
• Opis fizyczny: Bibliogr. 18 poz., il., rys., schem., tab., wykr.

Twórcy

autor

Satheeshkumar R.

• Annamalai University, India

autor

Arivoli R.

• Annamalai University, India

Bibliografia

• [1] A. Saudabayev, H.A. Varol, “Sensors for robotic hands: A survey of state of the art”. IEEE Access. 2015;3:1765-82.
• [2] J. Kofman, X. Wu, T.J. Luu, S. Verma, “Teleoperation of a robot manipulator using a vision-based human-robot interface”, IEEE transactions on industrial electronics. 2005 Oct;52(5):1206-19.
• [3] N.S. Chu, C.L. Tai, “Real-time painting with an expressive virtual Chinese brush”, IEEE Computer Graphics and applications. 2004 Sep;24(5):76-85.
• [4] D. Kruse, J.T. Wen, R.J. Radke, “A sensor-based dual-arm tele-robotic system”, IEEE Transactions on Automation Science and Engineering. 2015 Jan;12(1):4-18.
• [5] H. Jiang, B.S. Duerstock, J.P. Wachs. “A machine vision-based gestural interface for people with upper extremity physical impairments”, IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2013 Aug 8;44(5):630-41
• [6] A.S. Elons, M. Ahmed, H. Shedid, M.F. Tolba, “Arabic sign language recognition using leap motion sensor”, In 2014 9th International Conference on Computer Engineering & Systems (ICCES) 2014 Dec 22 (pp. 368-373). IEEE.
• [7] S. Hirche, M. Buss, “Human-oriented control for haptic teleoperation”, Proceedings of the IEEE. 2012 Mar;100(3):623-47.
• [8] K.M. Vamsikrishna, D.P. Dogra, M.S. Desarka, “Computer-vision-assisted palm rehabilitation with supervised learning”, IEEE Transactions on Biomedical Engineering. 2016 May;63(5):991-1001.
• [9] G. Ponraj, H. Ren, “Sensor Fusion of Leap Motion Controller and Flex Sensors Using Kalman Filter for Human Finger Tracking”, IEEE Sensors Journal. 2018 Mar 1;18(5):2042-9.
• [10] K. Aditya, P. Chacko, D. Kumari, S. Bilgaiyan, “Recent Trends in HCI: A survey on Data Glove, LEAP Motion and Microsoft Kinect”, In 2018 IEEE International Conference on System, Computation, Automation and Networking (ICSCA) 2018 Jul 6 (pp. 1-5). IEEE.
• [11] S. Mitra, T. Acharya, “Gesture recognition: A survey”. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 2007 May;37(3):311-24.
• [12] S. Waldherr, R. Romero, S.A. Thrun, A gesture based interface for hüman-robot interaction. Autonomous Robots”, 2000 Sep 1;9(2):151-73.
• [13] G. Marin, F. Dominio, P. Zanuttigh. Hand gesture recognition with leap motion and kinect devices. In 2014 IEEE International Conference on Image Processing (ICIP) 2014 Oct 27 (pp. 1565-1569). IEEE.
• [14] A. Sarkar, K.A. Patel, R.G. Ram, G.K. Capoor, “Gesture control of drone using a motion controller”. In 2016 International Conference on Industrial Informatics and Computer Systems (CIICS) 2016 Mar 13 (pp. 1-5). IEEE.
• [15] R. Satheeshkumar and R. Arivoli, ”Real Time Virtual Human Hand For Robotics. ”Journal of Computational Information Systems 15.1 (2019): 82-89.
• [16] R. Satheeshkumar and R. Arivoli, "Real Time Virtual Human Hand for Diagnostic Robot (DiagBot) Arm Using IOT" Journal of advanced research in dynamical and control system, Vol. 12, 01-Special Issue, 2020.
• [17] R. Satheeshkumar and R. Arivoli, "Real Time Robotic Arm Control Using Human Hand Gesture Measurement“, Journal of advanced research in dynamical and control system, Vol. 12, 04-Special Issue, 2020.
• [18] R. Satheeshkumar and R. Arivoli, "IOT Integrated Virtual Hand for Robotic Arm Using Leap Motion Controller" The Journal of Research on the Lepidoptera, Vol. 12, 04-Special Issue, 2020.

Uwagi

Opracowanie rekordu ze środków MNiSW, umowa Nr 461252 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2021).