Referring expressions in discourse about haptic line graphs

Date

2014-09-30

Author

Deniz, Ozan
Mehmetcan, Fal
Acartürk, Cengiz

Metadata

Show full item record

Item Usage Stats

139
views

0
downloads

Statistical line graphs are widely used in multimodal communication settings and they are crucial elements of learning environments. For visually impaired people, haptic-audio interfaces that provide perceptual access to graphical representations seem as an effective tool to fulfill these needs. In an experimental study, we investigated referring expressions used in a collaborative joint activity between haptic explorers of graphs and verbal assistants who helped haptic explorers conceptualize local and non-local second-order concepts (such as extreme values, trends, or changes of trends). The results show that haptic exploration movements evoke deictically referential links that are essential for establishing common ground between explorers and assistants.

URI

http://www.macs.hw.ac.uk/InteractionLab/Semdial/
https://hdl.handle.net/11511/83661

Conference Name

18th Workshop on the Semantics and Pragmatics of Dialogue ,SemDial – DialWat (2014)

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Towards designing audio assistance for comprehending haptic graphs A multimodal perspective DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2013-07-31) Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present...
Verbally assisted haptic graph comprehension The role of taking initiative in a joint activity Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (2014-08-31) Statistical graphs are tools for multimodal communication in daily life settings. For visually impaired people, haptic interfaces provide perceptual access to the information provided by the graph. Haptic comprehension is facilitated by audio and verbal assistance. We investigate the circumstances under which verbal assistance facilitates haptic comprehension of graphs. For this, we focus on cases where unaided haptic graph comprehension has limitations, such as when describing a global (rather than a local...
Towards a systematic understanding of graphical cues in communication through statistical graphs Acartürk, Cengiz (2014-04-01) Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...
Investigation of haptic line graph comprehension through co production of gesture and language Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2013-06-30) In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The par...
Text Generation and Comprehension for Objects in Images and Videos Anayurt Özyeğin, Hazan; Kalkan, Sinan; Department of Computer Engineering (2021-9-09) Text generation from visual data is a problem often studied using deep learning, having a wide range of applications. This thesis focuses on two different aspects of this problem by proposing both supervised and unsupervised methods to solve it. In the first part of the thesis, we work on referring expression comprehension and generation from videos. We specifically work with relational referring expressions which we define to be expressions that describe an object with respect to another object. For this, ...

Citation Formats

O. Deniz, F. Mehmetcan, and C. Acartürk, “Referring expressions in discourse about haptic line graphs,” presented at the 18th Workshop on the Semantics and Pragmatics of Dialogue ,SemDial – DialWat (2014), Edinburgh, Scotland, 2014, Accessed: 00, 2021. [Online]. Available: http://www.macs.hw.ac.uk/InteractionLab/Semdial/.