McGurk effect in Polish listeners

• Autorzy: Majewski W.
• Języki publikacji: EN

Abstrakty

EN

The phenomenon of a multi-modal interaction between audio and video stimuli, called the McGurk effect, was investigated for the Polish subjects. Two experiments were performed. In the first experiment the occurrence of McGurk effect for Polish speech was examined. The results of the first experiment for which over 94% of listeners' answers were consistent with the audio stimuli indicated that generally it is very difficult to evoke the McGurk effect in Polish listeners. In the second experiment the stimuli for which the McGurk effect was distinctly present were subjected to different kind of audio or video distortions and presented to the listeners. The distortions in the visual signals resulted in an increase of the answers consistent with the audio stimuli while the distortions in the audio signals resulted in an increase of the answers consistent with the visual stimuli.

Słowa kluczowe

EN

McGurk effect; Polish speech

• Wydawca: Instytut Podstawowych Problemów Techniki PAN ; Komitet Akustyki PAN ; Polskie Towarzystwo Akustyczne
• Czasopismo: Archives of Acoustics
• Rocznik: 2008
• Tom: Vol. 33, No. 4
• Strony: 447--454
• Opis fizyczny: Bibliogr. 8 poz., tab.

Twórcy

autor

Majewski W.

• Wrocław University of Technology, Institute of Telecommunications, Teleinformatics and Acoustics, Wybrzeże Wyspiańskiego 27, 50-370 Wrocław, Poland,

Bibliografia

• [1] BRANCAZIO L., MILLER J., PARE M.A., Visual influence of the internal structure of phonetic categories, Perception & Psychophysics, 65, 591–601 (2003).
• [2] GREEN K., Face and mouth inversion effects on visual and audiovisual speech perception, J. Acoust. Soc. Amer., 97, 3286 (1995).
• [3] MASSARO D.W., STORK D.G., Visual influences on speech perception process, American Scientist, 86, 236–244 (1998).
• [4] MCGURK H., MACDONALD J., Hearing lips and seeing voices, Nature, 264, 746–748 (1976).
• [5] MUNHALL K.G., GRIBBLE P., SACCO L., WARD M., Temporal constrains on the McGurk effect, Perception & Psychophysics, 58, 351–362 (1996).
• [6] SEKIYAMA K., TOKHURA Y., McGurk effect in non-English listeners; Few visual effects of Japanese subjects hearing Japanese syllables of high auditory intelligibility, J. Acoust. Soc. Amer., 91, 1797–1805 (1991).
• [7] SUKAMOTO S., MISHIMA H., SUZUKI Y., Effects of consonance of a voice and talking face motion on the McGurk effect, Subjective and Objective Assessment of Sound, Pozna´n, 1–3 September 2004, SOAS Proceedings – CD.
• [8] ŻOŁYŃSKI M., Sight and hearing integration in speech understanding process [in Polish], Master’s Thesis, Wrocław University of Technology, 2007.