Towards designing audio assistance for comprehending haptic graphs A multimodal perspective

Date

2013-07-31

Author

DENİZ, OZAN
MEHMETCAN, FAL
Acartürk, Cengiz

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

191
views

0
downloads

Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present a review of multimodal interactions between gesture, language and graphical representations. We then focus on methodologies for investigating hard-to-encode information in graph comprehension. Finally, we present a case study to provide insight for designing audio assistance.

Subject Keywords

Haptic graph comprehension, Audio-verbal assistance

URI

https://hdl.handle.net/11511/31261

DOI

https://doi.org/10.1007/978-3-642-39188-0_44

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Towards a systematic understanding of graphical cues in communication through statistical graphs Acartürk, Cengiz (2014-04-01) Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...
Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (2014-08-31) Statistical graphs are tools for multimodal communication in daily life settings. For visually impaired people, haptic interfaces provide perceptual access to the information provided by the graph. Haptic comprehension is facilitated by audio and verbal assistance. We investigate the circumstances under which verbal assistance facilitates haptic comprehension of graphs. For this, we focus on cases where unaided haptic graph comprehension has limitations, such as when describing a global (rather than a local...
Gesture and language production in communication through bar graphs Özge, Alaçam; Christopher, Habel; Acartürk, Cengiz (Cognitive Science Society; 2013-08-31) Bar graphs and line graphs are commonly used ways of graphical communication. Due to the difference in their perceptual visuo-spatial properties, they facilitate comprehension of different events. Bar graphs are commonly used in the domain of precipitation although the data intrinsically carry information that is averaged over long time spans. In this study, we investigate how the presence of incongruence between consecutive graph pairs influences conceptualization of the represented information about preci...
Referring expressions in discourse about haptic line graphs Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2014-09-30) Statistical line graphs are widely used in multimodal communication settings and they are crucial elements of learning environments. For visually impaired people, haptic-audio interfaces that provide perceptual access to graphical representations seem as an effective tool to fulfill these needs. In an experimental study, we investigated referring expressions used in a collaborative joint activity between haptic explorers of graphs and verbal assistants who helped haptic explorers conceptualize local and non...
Learning Graph Signal Representations with Narrowband Spectral Kernels Kar, Osman Furkan; Turhan, Gülce; Vural, Elif (2022-01-01) In this work, we study the problem of learning graph dictionary models from partially observed graph signals. We represent graph signals in terms of atoms generated by narrowband graph kernels. We formulate an optimization problem where the kernel parameters are learnt jointly with the signal representations under a triple regularization scheme: While the first regularization term aims to control the spectrum of the narrowband kernels, the second term encourages the reconstructed graph signals to vary smoot...

Citation Formats

O. DENİZ, F. MEHMETCAN, and C. Acartürk, “Towards designing audio assistance for comprehending haptic graphs A multimodal perspective,” 2013, vol. 8009, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/31261.