The role of the iconicity of sound within the multisensory environment

• Autorzy: Haverkamp Michael

Identyfikatory

DOI

10.21008/j.0860-6897.2022.1.06

• Języki publikacji: EN

Abstrakty

EN

The iconicity of perceived content includes all associative aspects that are intuitively attributed to the stimuli. Sound thus communicates information on the nature of its source. Associative content is essential for the fit of specific sounds in the total background and in the whole multisensory environment. Psychoacoustic parameters of sound contribute to the overall perceptual appearance of auditory elements, but iconicity and semantic content are determining the meaning of sound, which is most important to the listener. An objective iconicity analysis is introduced for the assessment of multisensory aspects of an environment. It is configured for the intuitive selection of appropriate images from a large dataset. In contrast to the common procedure of image-based soundscape analysis, the pictures refer to perceived single aspects, features of materials touched, functional aspects of processes, and emotions. It has successfully been applied to visual and tactile stimuli. Its expected benefit for sound evaluations is discussed.

Słowa kluczowe

EN

sound perception; synesthetic design; iconicity; touch sound

PL

percepcja dźwięku; projekt synestetyczny; ikoniczność; dźwięk dotyku

• Wydawca: Poznan University of Technology. Institute of Applied Mechanics
• Czasopismo: Vibrations in Physical Systems
• Rocznik: 2022
• Tom: Vol. 33, nr 1
• Strony: art. no. 2022106
• Opis fizyczny: Bibliogr. 20 poz., il. kolor., fot., wykr.

Twórcy

autor

Haverkamp Michael

• Independent scientist, Bahnwärterweg 76, 50733 Köln, Germany

Bibliografia

• 1. M. Schafer; The tuning of the world; McCelland and Steward, Toronto, Canada, 1977.
• 2. ISO 12913-2:2018 Acoustics - Soundscape - Part 2: Data collection and reporting requirements; ISO, Geneva, 2014.
• 3. C. Spence; Crossmodal correspondences: A tutorial review; Atten Percept Psychophys, 2011, 73, 971-995. DOI 10.3758/s13414-010-0073-7.
• 4. M. Haverkamp; Synesthetic Design. Handbook for a Multisensory Approach; Birkhäuser, Basel, Switzerland, 2013.
• 5. M. Chion; Audio-Vision; Columbia University Press, New York, USA, 1994.
• 6. M. Haverkamp; Effects of Material Touch-Sounds on Perceived Quality of Surfaces; SAE World Congress WCX17, Detroit, USA, 2017, SAE Paper 2017-01-0495.
• 7. F. Aletta et al.; Soundscape assessment - Towards a validated translation of perceptual attributes in different languages; Proceedings of Internoise, 2020.
• 8. M. Haverkamp; Soft sounds in quiet cars - design with respect to subjective intensity of sounds; Proceedings of e-Forum Acusticum, 2020, 2377-84. DOI: 10.48465/fa.2020.0020
• 9. R. A. Kendall; Music and Video Iconicity - Theory and Experimental Design; J. Physiol. Anthropol. Appl. Human. Sci., 2005, 24(1), 143-49.
• 10. U. Jekosch; Assigning meaning to sound; In: Communication acoustics; J. Blauert (ed.), Springer, Berlin, Germany, 2005, 193-221.
• 11. W. Voss; Das Farbenhören bei Erblindeten; Psychologisch-Ästhetische Forschungsgesellschaft; Hamburg, 1930.
• 12. E. Özcan; R. van Egmond; Basic semantics of product sounds; International Journal of Design, 2012, 6(2), 41-54.
• 13. B. Flückiger; Sound Design - Die virtuelle Klangwelt des Films; Schüren, Marburg, 2, 2002.
• 14. M. Haverkamp; Beurteilung und Gestaltung von Geräuschen auf Basis inter-modaler Analogien; In: Subjektive Fahreindrücke sichtbar machen III. expert; K. Becker (ed.); Renningen, 2006.
• 15. M. Haverkamp; Advanced description of noise perception by analysis of cross-sensory interactions within soundscapes; Noise Control Eng. J., 2010, 58 (5), 540-50.
• 16. M. Masullo et al.; Preliminary qualification of a small audio-visual dataset for a multisensory study on urban parks; Proceedings of Internoise, 2020.
• 17. A. Radicchi; A Pocket Guide to Soundwalking - Some introductory notes on its origin, established methods and four experimental variations; In: Perspectives on Urban Economics; A. Besecke et al. (eds.); Universitätsverlag der TU Berlin, 2017, 70-73.
• 18. A. Gidlöf-Gunnarsson, E. Öhrström, M. Ögren; Noise annoyance and restoration in different courtyard settings - Laboratory experiments on audio-visual interactions; Proceedings of Internoise, 2007.
• 19. S. Basturk, L. Maffei, M. Masullo; Soundscape Approach for a holistic urban design; AESOP 26th Annual Congress, Ankara, METU, 2012.
• 20. senseengineers.de (24.6.2022)

Uwagi

Opracowanie rekordu ze środków MEiN, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2022-2023).