Investigation of haptic line graph comprehension through co production of gesture and language

Date

2013-06-30

Author

Deniz, Ozan
Mehmetcan, Fal
Acartürk, Cengiz

Metadata

Show full item record

Item Usage Stats

226
views

0
downloads

In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The participants were asked to produce single sentence summaries of visual graphs and haptic graphs. The gestures that were produced during the course of verbal descriptions were analyzed. The results showed that directional gestures accompanied verbal descriptions of both visual graphs and haptic graphs. Further analyses revealed differences between visual graphs and haptic graphs in terms of type of gestures, as well as the production rates.

Subject Keywords

Gesture production, Haptic graph comprehension, Line graphs, Multimodal communication

URI

http://tiger.uvt.nl/
https://hdl.handle.net/11511/79357

Conference Name

TiGeR 2013 Tilburg Gesture Research Meeting. The combined meeting of the 10th International Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Estimation of partially observed multiple graph signals by learning spectrally concentrated graph kernels Turhan, Gülce; Vural, Elif; Department of Electrical and Electronics Engineering (2021-3-31) Graph models provide flexible tools for the representation and analysis of signals defined over domains such as social or sensor networks. However, in real applications data observations are often not available over the whole graph, due to practical problems such as broken sensors, connection loss, or storage problems. In this thesis, we study the problem of estimating partially observed graph signals on multiple graphs. We consider possibly multiple graph domains over which a set of signals is available wi...
Eye tracking in multimodal comprehension of graphs Acartürk, Cengiz (2012-07-31) Eye tracking methodology has been a major empirical research approach for the study of online comprehension processes in reading and scene viewing. The use of eye tracking methodology for the study of diagrammatic representations, however, has been relatively limited so far. The investigation of specific types of diagrammatic representations, such as statistical graphs is even scarce. In this study, we propose eye tracking as an empirical research approach for a systematic analysis of multimodal comprehensi...
Gestures in communication through line graphs Özge, Alaçam; Christopher, Habel; Acartürk, Cengiz (null; 2012-08-31) Line graphs are widely used in communication settings, for conveying information about states and processes that unfold in time. The communication is achieved by the contribution of other modalities than graphs, such as language and gestures. In a set of experimental investigations, we analyzed the production and comprehension of gestures during communication through line graphs. The findings reveal a systematic use of gestures as well as the limitations of cognitive resources due to the split of attention ...
ESTIMATION OF TIME VARYING GRAPH SIGNALS WITH GRAPH ARMA PROCESSES Güneyi, Eylem Tuğçe; Vural, Elif; Department of Electrical and Electronics Engineering (2021-9-8) Graph models provide efficient tools for analyzing data defined over irregular domains such as social networks, sensor networks, and transportation networks. Real-world graph signals are usually time-varying signals. The characterization of the joint behavior of time-varying graph signals in the time and the vertex domains has recently arisen as an interesting research problem, contrasted to the independent processing of graph signals acquired at different time instants. The concept of wide sense stationari...
Towards a systematic understanding of graphical cues in communication through statistical graphs Acartürk, Cengiz (2014-04-01) Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...

Citation Formats

O. Deniz, F. Mehmetcan, and C. Acartürk, “Investigation of haptic line graph comprehension through co production of gesture and language,” presented at the TiGeR 2013 Tilburg Gesture Research Meeting. The combined meeting of the 10th International Gesture Workshop (GW) and the 3rd Gesture and Speech in Interaction (GESPIN) conference, Tilburg, Hollanda, 2013, Accessed: 00, 2021. [Online]. Available: http://tiger.uvt.nl/.