The role and use of speech gestures in discourse

• Autorzy: Campbell N.
• Języki publikacji: EN

Abstrakty

EN

This paper describes how a secondary level of discourse information can be processed in a speech signal for the automatic annotation of discourse progress and for producing an estimate of a speaker's participation status. In a semi-formal round-table meeting situation there is typically only one main speaker at any given moment, but several participants may be speaking simultaneously, expressing agreement (or otherwise), chatting, translating, etc., in addition to the main speaker.We are currently performing research into technology to process this `audio landscape' in order to detect the main speaker and to categorise the competing forms of speech in a given situation. Several speech gestures such as laughter, agreement, and feedback-responses can be recognised, isolated, and used to determine the progress of the meeting and the degrees and types of participation status among the members present. The technology exists to recognise these discourse events, but we still lack a model of their function in the mutual transfer of information through speech interaction.

Słowa kluczowe

EN

speech recognition; audio landscape; speech gestures

• Wydawca: Instytut Podstawowych Problemów Techniki PAN ; Komitet Akustyki PAN ; Polskie Towarzystwo Akustyczne
• Czasopismo: Archives of Acoustics
• Rocznik: 2007
• Tom: Vol. 32, No. 4
• Strony: 803--814
• Opis fizyczny: Bibliogr. 19 poz., rys.

Twórcy

autor

Campbell N.

• National Institute of Information and Communications Technology
• Spoken Language Communication Research Laboratory Advanced Telecommunications Research Institute International Keihanna Science City, Kyoto 619-0288, Japan

Bibliografia

• [1] KEENAN J., Intellectual Capital and Knowledge Management in Organization, Doctoral course at MidSweden University, April 1999.
• [2] ALLWOOD J., Linguistic Communication as Action and Cooperation, Goteburg Monographs in Linguistics, Goteborg University, Department of Linguistics, 1976.
• [3] The JST/CREST Expressive Speech Processing project, introductory web pages at: http://feast.atr.jp.
• [4] The SCOPE `robot's ears' project homepage: http://feast.atr.jp/non-verbal.
• [5] KENDON A., Movement coordination in social interaction: Some examples described, Acta Psychologica, 32, 2, 101–125 (1970).
• [6] CONDON W. S., Communication: Rhythm and Structure. Rhythm in Psychological, Linguistic and Musical Processes, pp. 55-78, J. R. Evans, M. Clynes [Eds.], Charles C Thomas Publisher, Spring-field, Illinois 1986.
• [7] MCCOWAN I., GATICA-PEREZ D., BENGIO S., LATHOUD G., BARNARD M., ZHANG D., Automatic analysis of multimodal group actions in meetings, IEEE Trans. on Pattern Analysis and Machine Intelligence, 27, 3, 305–317 (2005).
• [8] ZHANG D., et al., Multimodal group action clustering in meetings, VSSN'04, 54–62, 2004.
• [9] KATOH M., et al., State estimation of meetings by information fusion using bayesian network, INTERSPEECH2005, 113-116, 2005.
• [10] Mover - a software programme written in Tcl/Tk for the categorisation of speech utterances. Made available by ATR at http://feast.atr.jp/software/, 2005.
• [11] CAMPBELL N., ERICKSON D., What do people hear? A study of the perception of non-verbal affective information in conversational speech, Journal of the Phonetic Society of Japan, 7, 4, 9-28 (2004).
• [12] CAMPBELL W. N., A Multi-media Database for Meetings Research, [in:] Proc. Oriental COCOSDA, pp. 77-82, Jakarta, Indonesia 2006.
• [13] CAMPBELL W. N., Non-Verbal Speech Processing for a Communicative Agent, Proc. Eurospeech, pp. 769-772, Lisbon 2005.
• [14] CAMPBELL N., SUZUKI N., Working with Very Sparse Data to Detect Speaker and Listener Participation in a Meetings Corpus, [in:] Proc. Language Resources & Evaluation Conference, Genova, Italy 2006.
• [15] CAMPBELL W. N., Listening between the lines; a study of paralinguistic information carried by tone-of-voice, [in:] Proc. International Symposium on Tonal Aspects of Languages, pp. 13-16, TAL2004, Beijing, China 2004.
• [16] HANSON H.M., Glottal characteristics of female speakers: acoustic correlates, J. Acoust. Soc. Am, 101, 466-481, 1997.
• [17] WARNER T., Communication Research, Communication Skills for Information Systems, Vol. 19, No. 1, p. 52-90, Pitman Publishing, London 1996.
• [18] CAMPBELL N., Conversational Speech Synthesis and the Need for Some Laughter, IEEE Transactions on Audio, Speech, and Language Processing, 14, 4, July 2006.
• [19] CAMPBELL N., Speech Synthesis and Discourse Information, [in:] Proc. Fifth Slovenian and First International Language Technologies Conference, October 9-10, Ljubljana, Slovenia 2006.