Adaptation of the humanoid robot to speech disfluency therapy

• Autorzy: Kwaśniewicz Ł. , Kuniszyk-Jóźkowiak W. , Wójcik G. M. , Masiak J.

Identyfikatory

DOI

10.1515/bams-2016-0018

• Języki publikacji: EN

Abstrakty

EN

The paper describes an application that allows to use a humanoid robot as a stutterer’s assistant and therapist. Auditory and visual feedback has been used in the therapy with a humanoid robot. For this purpose, the common method of “echo” was modified. The modification is that the speaker hears delayed speech sounds uttered by the robot. The sounds of speech coming from an external microphone are captured and delayed by a computer and then, using User Datagram Protocol (UDP), sent to the robot’s system and played in its speakers. This system allows the elimination of negative feedback and external sound field’s noise. The effect of this therapy is enhanced by the fact that, in addition to the effect, relating to the action of the delayed feedback, the speaker has company during the difficult process of speaking. Visual feedback has been realized as changes in the robot’s hand movements according to the shape of the speech signal envelope and possibility of controlling speech with a metronome effect.

Słowa kluczowe

EN

echo method; humanoid robot; stuttering therapy; visual feedback

• Wydawca: Uniwersytet Jagielloński - Collegium Medicum ; Index Copernicus Sp. z o.o.
• Czasopismo: Bio-Algorithms and Med-Systems
• Rocznik: 2016
• Tom: Vol. 12, no. 4
• Strony: 169--177
• Opis fizyczny: Bibliogr. 32 poz., rys., wykr., tab.

Twórcy

autor

Kwaśniewicz Ł.

• Institute of Computer Science, Department of Neuroinformatics, Marie Curie-Skłodowska University, ul. Akademicka 9, 20-033 Lublin, Poland

autor

Kuniszyk-Jóźkowiak W.

• Faculty of Physical Education and Sport in BiałaPodlaska, JózefPiłsudski University of Physical Education in Warsaw, Akademicka 2, 21-500 Biała Podlaska, Poland

autor

Wójcik G. M.

• Institute of Computer Science, Department of Neuroinformatics, Marie Curie-Skłodowska University, ul. Akademicka 9, 20-033 Lublin, Poland

autor

Masiak J.

• Neurophysiological Independent Unit, Medical University in Lublin, Głuska 2, 20-439 Lublin, Poland

Bibliografia

• 1. Adamczyk B. Anwendung des Apparatesfür die Erzeugung von künstlichemWiderhallbei der Behandlung des Stotterns. Folia Phoniat 1959;11:216–8.
• 2. Adamczyk B. 30-Years of the “echo-method”. In: Stuttering. Proc. of IX Scientific Conference of the Polish Logopaedic Society, Lublin, 1987:7–14 (in Polish).
• 3. Adamczyk B. Speech correction method and a device by telephone to this method. Home Patent 47696, 1963.
• 4. Van Borsel J, Reunes G, Van den Bergh N. Delayed auditory feedback in the treatment of stuttering: clients as consumers. Int J Language CommunDisord 2003;38:119–29.
• 5. Radford N, Tanguma J, Gonzalez M, Nericcio MA, Newman D. A case study of mediated learning, delayed auditory feedback, and motor repatterning to reduce stuttering. Percept Motor Skills 2005;101:63–71.
• 6. Gallop RF, Runyan CM. Long-term effectiveness of the SpeechEasy fluency-enhancement device. J Fluency Disord 2012;37:334–43.
• 7. Botterill W. Developing the therapeutic relationship: from ‘expert’ professional to ‘expert’ person who stutter. J Fluency Disord 2011;36:158–73.
• 8. Packman A, Meredith G. Technology and the evolution of clinical methods for stuttering. J Fluency Disord 2011;36:76–85.
• 9. Van Borsel J, Drummond D, Medeiros de Britto Pereira M. Delayed auditory feedback and acquired neurogenic stuttering. J Neurolinguist 2010;23:479–87.
• 10. Foundas AL, Mock JR, Corey DM, Golob EJ, Comture EG. The SpeechEasy device in stuttering and nonstuttering adults: fluency effects while speaking and reading. Brain Language 2013;126:141–50.
• 11. Adamczyk B, Kuniszyk-Jóźkowiak W, Smołka E. Influence of echo and reverberation on the speech process. Folia Phoniat 1979;31:70–81.
• 12. Adamczyk B, Kuniszyk-Jóźkowiak W, Sadowska E. Correction effect in chorus speaking by stuttering people. In: XVIth International Congress of Logopedics and Phoniatrics, Interlaken, 1976:2–6.
• 13. Choe YK, Jung HT, Baird J, Grupen RA. Multidisciplinary stroke rehabilitation delivered by a humanoid robot: interaction between speech and physical therapies. Aphasiology 2013;27:252–70.
• 14. Kuniszyk-Jóźkowiak W, Dzieńkowski M, Smołka E, Suszyński W. Computer diagnosis and therapy of stuttering. Structures-Waves-Human Health 2003;XII:133–44.
• 15. Dzieńkowski M, Kuniszyk-Jóźkowiak W, Smołka E, Suszyński W. Computer speech echo corrector. Ann UMCS Inf 2004:315–322.
• 16. Kuniszyk-Jóźkowiak W, Smołka E, Adamczyk B. Effect of visual and tactile reverberation on speech fluency of stutterers. Folia PhoniatLogopaed 1997:49:26–34.
• 17. http://www.roboshop.pl/nao.html. Accessed: 7 June 2016.
• 18. https://www.aldebaran.com/en/more-about. Accessed: 7 June 2016.
• 19. Hunt C. TCP/IP-Network Administration. Oficyna Wydawnicza READ ME, 1996:24.
• 20. http://home.agh.edu.pl/∼opal/sieci/instrukcje/stream.pdf. Accessed: 7 June 2016.
• 21. Gardecki A, Kawala-Janik A. The application extending the capabilities of the human-robot interaction of the humanoid robot NAO. Prace Inst Elektrotech 2016;63:EN 45–54.
• 22. http://doc.aldebaran.com/2-1/family/robots/joints_robot.html. Accessed: 7 June 2016.
• 23. Miskam MA, Masnin NF, Jamhuri MH, Shamsuddin S, Omar AR, Yussof H. Encouraging children with autism to improve social and communication skills through the game-based approach. Procedia ComputSci 2014;42:93–8.
• 24. Ismail LI, Shamsudin S, Yussof H, Hanapiah FA, Zahari NI. Robotbased intervention program for autistic children with humanoid robot NAO: initial response in stereotyped behavior. Procedia Eng 2012;41:1441–7.
• 25. Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zahari NI. Initial response in HRI—a case study on evaluation of child with autism spectrum disorders interacting with a humanoid robot NAO. Procedia Eng 2012;41:1448–55.
• 26. Shamsuddin S, Yussof H, Ismail LI, Mohamed S, Hanapiah FA, Zahari NI. Humanoid robot NAO interacting with autistic children of moderately impaired intelligence to augment communication skills. Procedia Eng 2012;41:1533–8.
• 27. Fosnot SM, Jun S. Prosodic characteristics in children with stuttering or autism during reading and imitation. In: Proceedings of the 14th International Congress of Phonetic Sciences. Berkeley, CA: University of California, 1999:1925–8.
• 28. Duch W, Nowak W, Meller J, Osiński G, Dobosz K, Mikołajewski D, et al. Consciousness and attention in autism spectrum disorders. In: Proceedings of Cracow Grid Workshop, 2011;2010:202–11.
• 29. Duch W, Nowak W, Meller J, Osiński G, Dobosz K, Mikołajewski D, et al. Computational approach to understanding autism spectrum disorders. Computer Science 2012;13:47–61.
• 30. Dobosz K, Mikołajewski D, Wójcik GM, Duch W. Simple cyclic movements as a distinct autism feature-computational approach. ComputSci 2013;14:475–89.
• 31. Wojcik GM, Ważny M. Bray-Curtis metrics as measure of liquid state machine separation ability in function of connections density. ProcediaComputSci 2015;51:2979–83.
• 32. Kawala-Janik A, Gardecki A, Podpora M, Kolańska-Płuska J, Grochowicz B. Implementation of the LES systems and NAO humanoidrobots in children. In: Międzynarodowa Konferencja z Podstaw Elektrotechniki i Teorii Obwodów IC-SPETO, Gliwice-Ustron, 20–23 maj 2015.