Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity

Date

2014-08-31

Author

Deniz, Ozan
Mehmetcan, Fal
Acartürk, Cengiz

Metadata

Show full item record

Item Usage Stats

167
views

0
downloads

Statistical graphs are tools for multimodal communication in daily life settings. For visually impaired people, haptic interfaces provide perceptual access to the information provided by the graph. Haptic comprehension is facilitated by audio and verbal assistance. We investigate the circumstances under which verbal assistance facilitates haptic comprehension of graphs. For this, we focus on cases where unaided haptic graph comprehension has limitations, such as when describing a global (rather than a local) maximum. In an experiment that employed a joint activity setting, we observed two major aspects of verbal assistance for haptic graph comprehension, as indicated by post-exploration sketch production of the participants: First, the results revealed significant impact of the explorer as a dialogue initiator during the course of haptic exploration. Second, verbal assistance led to more successful graph comprehension when it was enriched by modifiers.

Subject Keywords

Haptic line graph comprehension, Sketching, Verbal assistance, Turn-taking

URI

https://courses.cs.ut.ee/t/multimodalcommunication2014/Main/AcceptedPapers
https://hdl.handle.net/11511/73698
https://acarturk.net/wp-content/uploads/Alacam_Habel_Acarturk_2014a.pdf

Conference Name

2nd European and the 5th Nordic Symposium on Multimodal Communication

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Towards designing audio assistance for comprehending haptic graphs A multimodal perspective DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2013-07-31) Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present...
Towards a systematic understanding of graphical cues in communication through statistical graphs Acartürk, Cengiz (2014-04-01) Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...
Eye tracking in multimodal comprehension of graphs Acartürk, Cengiz (2012-07-31) Eye tracking methodology has been a major empirical research approach for the study of online comprehension processes in reading and scene viewing. The use of eye tracking methodology for the study of diagrammatic representations, however, has been relatively limited so far. The investigation of specific types of diagrammatic representations, such as statistical graphs is even scarce. In this study, we propose eye tracking as an empirical research approach for a systematic analysis of multimodal comprehensi...
Investigation of haptic line graph comprehension through co production of gesture and language Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2013-06-30) In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The par...
Haptic exploration patterns in virtual line graph comprehension DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2015-08-07) Multi-modal interfaces that provide haptic access to statistical line graphs combined with verbal assistance are proposed as an effective tool to fulfill the needs of visually impaired people. Graphs do not only present data, they also provide and elicit the extraction of second order entities (such as maxima or trends), which are closely linked to shape properties of the graphs. In an experimental study, we investigated collaborative joint activities between haptic explorers of graphs and verbal assistants...

Citation Formats

O. Deniz, F. Mehmetcan, and C. Acartürk, “Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity,” presented at the 2nd European and the 5th Nordic Symposium on Multimodal Communication, Estonya, 2014, Accessed: 00, 2021. [Online]. Available: https://courses.cs.ut.ee/t/multimodalcommunication2014/Main/AcceptedPapers.