Cooling fan controlled by embedded vision system

• Autorzy: Kula Sebastian

Identyfikatory

DOI

10.21008/j.1897-0737.2020.104.0001

• Języki publikacji: EN

Abstrakty

EN

The HMI (human machine interaction) systems are widely used to control machines and variety of devices. Currently the HMI solutions, based on touch screens are almost commonly used in many domains, however the number of devices, which interaction with the user is based on speech recognition or user gesture recognition increases systematically. The paper focuses on the electromechanical system, which applies gestures and handwritten digits to control the speed of the DC cooling fan. The system crucial elements are the AVR microcontroller and the developer board, equipped with the embedded supercomputer NVIDIA Jetson TX1. To create the software part of the system artificial intelligence algorithms and deep neural networks were applied. The paper describes the complete routine of data preprocessing, deep neural network training and testing with the use of the GPU Tesla K20 and with the use of the DIGITS (Deep Learning GPU Training System), deployment of the trained model on Jetson TX1 board and the system execution. The system enables to control the fan through the two gestures (“stone”, ”paper”) or through four handwritten digits.

Słowa kluczowe

EN

computer vision; deep neural networks; electromechanical systems; human computer interaction

• Wydawca: Wydawnictwo Politechniki Poznańskiej
• Czasopismo: Poznan University of Technology Academic Journals. Electrical Engineering
• Rocznik: 2020
• Tom: No. 104
• Strony: 7--16
• Opis fizyczny: Bibliogr. 12 poz., rys.

Twórcy

autor

Kula Sebastian

• Kazimierz Wielki University, Bydgoszcz

Bibliografia

• [1] McCulloch W.S., Pitts W., A Logical Calculus of Ideas Immanent in Nervous Activity, Bulletin of Mathematical Biophysics, 5(4), pp. 115–133, 1943. https://doi.org/10.1007/BF02478259
• [2] He K., Zhang X., Ren S., Sun J., Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification, In: IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015, pp. 1026–1034. https://doi.org/10.1109/ICCV.2015.123
• [3] Arathi P.N., Arthika S., Ponmithra S., Srinivasan K., Rukkumani V., Gesture based home automation system, In: International Conference on Nextgen Electronic Technologies: Silicon to Software (ICNETS2), Chennai, India, 2017, pp. 198–201. https://doi.org/10.1109/ICNETS2.2017.8067929
• [4] Ohn-Bar E., Trivedi M.M., Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations, IEEE Tran. On Intelligent Transportation Systems, 15(6), pp. 2368–2377, 2014. https://doi.org/10.1109/TITS.2014.2337331
• [5] Memo A., Minto L., Zanuttigh P., Exploiting Silhouette Descriptors and Synthetic Data for Hand Gesture Recognition, In: STAG: Smart Tools and Apps in computer Graphics, Verona, Italy, 2015, pp. 15–23. https://doi.org/10.2312/stag.20151288
• [6] Memo A., Zanuttigh P., Head-mounted gesture controlled interface for human-computer interaction, Multimedia Tools & Applications, 77(1), pp. 27–53, 2018. https://doi.org/10.1007/s11042-016-4223-3
• [7] Krizhevsky A., Sutskever I., Hinton G., ImageNet Classification with Deep Convolutional Neural Networks, In: 26th Annual Conference on Neural Information Processing Systems, Lake Tahoe, Nevada, United States, 2012, pp. 1106–1114.
• [8] Szegedy C., Liu W., Jia Y., Sermanet P., Reed S., Anguelov D., Erhan D., Vanhoucke V., Rabinovich A., Going deeper with convolutions, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, United States, 2015, pp. 1–9. https://doi.org/10.1109/CVPR.2015.7298594
• [9] NVIDIA, The NVIDIA Deep Learning GPU Training System, [online] Available at: https://developer.nvidia.com/digits [Accessed: 22 April 2019].
• [10] NVIDIA, Guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson, [online] Available at: https://github.com/dusty-nv/jetson-inference [Accessed: 22 April 2019].
• [11] NVIDIA, A straightforward library to interface with the Jetson TX1 GPIO pins, [online] Available at: https://github.com/jetsonhacks/jetsonTX1GPIO [Accessed: 22 April 2019].
• [12] LeCun Y., Bottou L., Bengio Y., Haffner P., Gradient-based learning applied to document recognition, Proceedings of the IEEE, 86(11), pp. 2278–2324, 1998. https://doi.org/10.1109/5.726791

Uwagi

Opracowanie rekordu ze środków MNiSW, umowa Nr 461252 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2020).