Haptic exploration patterns in virtual line graph comprehension

Date

2015-08-07

Author

DENİZ, OZAN
MEHMETCAN, FAL
Acartürk, Cengiz

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

130
views

0
downloads

Multi-modal interfaces that provide haptic access to statistical line graphs combined with verbal assistance are proposed as an effective tool to fulfill the needs of visually impaired people. Graphs do not only present data, they also provide and elicit the extraction of second order entities (such as maxima or trends), which are closely linked to shape properties of the graphs. In an experimental study, we investigated collaborative joint activities between haptic explorers of graphs and verbal assistants who helped haptic explorers to conceptualize local and non-local second-order concepts. The assistants have not only to decide what to say but in particular when to say it. Based on the empirical data of this experiment, we describe in the present paper the design of a feature set for describing patterns of haptic exploration, which is able to characterize the need for verbal assistance during the course of haptic exploration. We employed a (supervised) classification algorithm, namely the J48 decision tree. The constructed features within the range from basic (low-level) user-action features to complex (high-level) conceptual were categorized into four feature sets. All feature set combinations achieved high accuracy level. The best results in terms of sensitivity and specificity were achieved by adding the low-level graphical features.

Subject Keywords

A classifier for haptic exploration patterns, Haptic graph comprehension, Verbal assistance

URI

https://hdl.handle.net/11511/31996

DOI

https://doi.org/10.1007/978-3-319-20898-5_39

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Switching reference frame preferences during verbally assisted haptic graph comprehension Alacam, Oezge; Habel, Christopher; Acartürk, Cengiz (2015-09-01) Haptic-audio interfaces allow haptic exploration of statistical line graphs accompanied by sound or speech, thus providing access to exploration by visually impaired people. Verbally assisted haptic graph exploration can be seen as a task-oriented collaborative activity between two partners, a haptic explorer and an observing assistant, who are disposed to individual preferences for using reference frames. The experimental findings reveal that haptic explorers' spatial reference frames are mostly induced by...
Towards designing audio assistance for comprehending haptic graphs A multimodal perspective DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2013-07-31) Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present...
Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (2014-08-31) Statistical graphs are tools for multimodal communication in daily life settings. For visually impaired people, haptic interfaces provide perceptual access to the information provided by the graph. Haptic comprehension is facilitated by audio and verbal assistance. We investigate the circumstances under which verbal assistance facilitates haptic comprehension of graphs. For this, we focus on cases where unaided haptic graph comprehension has limitations, such as when describing a global (rather than a local...
Investigation of haptic line graph comprehension through co production of gesture and language Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2013-06-30) In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The par...
Developing a Verbal Assistance System for Line Graph Comprehension Acartürk, Cengiz; Habel, Christopher (2014-06-27) Statistical graphs have been designed for accessible use by visually impaired users. Haptic devices provide an appropriate interface for haptic exploration of statistical graphs. However, haptic exploration of statistical graphs reveals a more local and sequential inspection pattern compared to visual exploration. This difference between haptic exploration and visual exploration is usually attributed to different characteristics of the exploration processes, such as bandwidth of information extraction. To f...

Citation Formats

O. DENİZ, F. MEHMETCAN, and C. Acartürk, “Haptic exploration patterns in virtual line graph comprehension,” 2015, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/31996.