Applying hand gesture recognition with time-of-flight camera for 3D medical data analysis

• Autorzy: Malawski F.
• Języki publikacji: EN

Abstrakty

EN

This paper describes a human-computer interface based on hand gesture recognition, intended for analysis of 3D medical data. The gestures are designed to minimize the required muscle tension when using the system. Gesture recognition is based on a 3D sensor. Depth maps are acquired by a time-of-flight camera, designed specifically for hand gestures recognition. The depth images are denoised and segmented to right and left hand. The contours of the hands are found and a modified Shape Context descriptor is utilized for each hand, providing a set of features, which are employed to train and test various classifiers. Naive Bayes, Random Forest and Support Vector Machine (SVM) classifiers are utilized, with search of optimal parameters using cross-validation. The best accuracy (95%) is achieved with the Support Vector Machine classifier. The gestures are mapped to various controls of a 3D medical visualization module. Two visualization methods are employed - isosurface and cut-planes. The left hand is assigned to switching between different control modes and the right hand gestures are corresponding to controlling various properties in each mode. The system is convenient to use and runs in real-time on a typical PC machine.

Słowa kluczowe

EN

human-computer interaction; hand gesture recognition; time-of-flight camera

PL

interakcja człowiek-komputer; rozpoznawanie gestów dłoni; czas przelotu kamery

• Wydawca: Foundation for Young Scientists
• Czasopismo: Challenges of Modern Technology
• Rocznik: 2014
• Tom: Vol. 5, no. 4
• Strony: 12--16
• Opis fizyczny: Bibliogr. 13 poz., rys., tab.

Twórcy

autor

Malawski F.

• AGH University of Science and Technology, Faculty of Computer Science, Electronics and Telecommunication, Department of Computer Science, al. Mickiewicza 30, 30-059 Krakow, Poland

Bibliografia

• [1] Li Y. T., Wachs, J. P. „HEGM: A hierarchical elastic graph matching for hand gesture recognition.„ Pattern Recognition, 47(1), 80-88, 2014
• [2] Premaratne P., Ajaz S., Premaratne M., „Hand gesture tracking and recognition system using Lucas–Kanade algorithms for control of consumer electronics.„ Neurocomputing, 116, 242-249, 2013
• [3] Stergiopoulou E., Papamarkos N., „Hand gesture recognition using a neural network shape fitting technique.„ Engineering Applications of Artificial Intelligence, 22(8), 1141-1158, 2009
• [4] Li H., Yang L., Wu X., Xu S., Wang Y. „Static hand gesture recognition based on hog with Kinect.„ In Intelligent Human-Machine Systems and Cybernetics (IHMSC), 2012 4th International Conference on (Vol. 1, pp. 271-273). Aug. 2012
• [5] Ren Z., Yuan J., Meng J., Zhang Z. „Robust part-based hand gesture recognition using Kinect sensor.„ IEEE Transactions on Multimedia, 15(5), 1110-1120, 2013
• [6] Yao Y., Fu Y., „Contour model based hand-gesture recognition using Kinect sensor.„ IEEE Transactions on Circuits and Systems for Video Technology, 99, 1-10, Jan 2014
• [7] Dominio F., Donadeo M., Zanuttigh P., „Combining multiple depth-based descriptors for hand gesture recognition.„ Pattern Recognition Letters, 2013
• [8] Suau X., Alcoverro M., López-Méndez A., Ruiz-Hidalgo J., Casas J.R., „Real-time Fingertip Localization Conditioned on Hand Gesture Classification.„ Image and Vision Computing, 2014
• [9] Li Z., Jarvis R., „Real time hand gesture recognition using a range camera.„ In Australasian Conference on Robotics and Automation (pp. 21-27), Dec. 2009.
• [10] Breuer P., Eckes C., Müller S., „Hand gesture recognition with a novel IR time-of-flight range camera–a pilot study.„ In Computer Vision/Computer Graphics Collaboration Techniques (pp. 247-260). Springer Berlin Heidelberg, 2007
• [11] Belongie S., Malik J., Puzicha J., „Shape context: A new descriptor for shape matching and object recognition.„ In NIPS (Vol. 2, p. 3), Nov. 2000.
• [12] Breiman L. „Random forests„. Machine learning, 45(1), 5-32., 2001
• [13] Cortes C., Vapnik V. „Support-vector networks.„ Machine learning, 20(3), 273-297, 1995