THE EFFECT OF MATERIAL SOUND ON MATERIAL PERCEPTION THROUGH TURKISH SOUND SYMBOLIC WORDS

2025-8
Tuncel, İrem
Research has shown that a subset of sound-symbolic words (SSWs), onomatopoeic words (e.g., splash) that imitate sounds, are strongly associated with perceived material properties. Moreover, semantic dimensions derived from visual and haptic materials align with those extracted from SSWs, indicating cross-modal consistency. In this thesis, natural material sounds and videos of everyday materials were to investigate material perception through SSWs. To select SSWs, in preliminary Study 1, participants wrote down their answers mimicking natural sounds. Following a letter frequency analysis for common phonetic patterns, SSWs including these phonemes are used in the main experiment. In Study 2, participants identified materials solely by listening to sounds representing materials, and high agreement responses were chosen. In the main experiment, materials were presented multiple times: across conditions of natural sound congruency and SSW congruency, and rated on SSWs. It is hypothesized that congruency between natural sound and SSWs would more strongly influence perception than visual congruency, predicting that audiovisual (AV) congruent stimuli would receive higher ratings for matching SSWs than AV incongruent stimuli. As expected, SSWs in the same dimensions with material videos got higher ratings on the congruent AV stimuli compared to incongruent AV stimuli. Furthermore, overall ratings between congruent and incongruent AV stimuli did not differ when SSWs were incongruent with material videos. However, for incongruent AV stimuli in certain material dimensions ratings increased for incongruent SSWs. These findings highlight the role of material sounds in perceived material characteristics and challenge the widespread notion of visual dominance in multisensory integration.
Citation Formats
İ. Tuncel, “THE EFFECT OF MATERIAL SOUND ON MATERIAL PERCEPTION THROUGH TURKISH SOUND SYMBOLIC WORDS,” M.S. - Master of Science, Middle East Technical University, 2025.