Gesture and language production in communication through bar graphs

Özge, Alaçam
Christopher, Habel
Acartürk, Cengiz
Bar graphs and line graphs are commonly used ways of graphical communication. Due to the difference in their perceptual visuo-spatial properties, they facilitate comprehension of different events. Bar graphs are commonly used in the domain of precipitation although the data intrinsically carry information that is averaged over long time spans. In this study, we investigate how the presence of incongruence between consecutive graph pairs influences conceptualization of the represented information about precipitation. For this, we analyzed gestures and verbal descriptions produced by the participants as indicators of event conceptualizations. The results of the experimental investigation reveals that when incongruent graph pairs are presented, the participants show tendency to produce directional gestures that accompany the verbal descriptions of the specific regions represented by one/two bars, indicating that bar graphs presented in consecutive order facilitates comprehension of trend information as well as of discrete entities. Additionally, the presence of incongruence seems to enhance the production of comparative words accompanied with non-directional gestures.
Proceedings of the 35th Annual Meeting of the Cognitive Science Society, July 31-August 3, 2013


Gestures in communication through line graphs
Özge, Alaçam; Christopher, Habel; Acartürk, Cengiz (null; 2012-08-31)
Line graphs are widely used in communication settings, for conveying information about states and processes that unfold in time. The communication is achieved by the contribution of other modalities than graphs, such as language and gestures. In a set of experimental investigations, we analyzed the production and comprehension of gestures during communication through line graphs. The findings reveal a systematic use of gestures as well as the limitations of cognitive resources due to the split of attention ...
Towards a systematic understanding of graphical cues in communication through statistical graphs
Acartürk, Cengiz (2014-04-01)
Statistical graphs in particular, line graphs and bar graphs are efficient means of communication in a wide range of non-expert settings. In communication settings, statistical graphs do not only serve as visualizations of individual data points but also provide visual access to various aspects of the information contained in data. Moreover, specific types of graphs are better means for providing visual access to certain aspects of data. For instance, trend information is visually conveyed through line grap...
Towards designing audio assistance for comprehending haptic graphs A multimodal perspective
DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2013-07-31)
Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present...
Investigation of haptic line graph comprehension through co production of gesture and language
Deniz, Ozan; Mehmetcan, Fal; Acartürk, Cengiz (null; 2013-06-30)
In communication settings, statistical graphs accompany language by providing visual access to various aspects of domain entities, such as conveying information about trends. A similar and comparable means for providing perceptual access is to provide haptic graphs for blind people. In this study, we present the results of an experimental study that aimed to investigate visual line graphs and haptic line graphs in time domain by means of gesture production as an indicator of event conceptualization. The par...
Multimodal comprehension of graphics with textual annotations The role of graphical means relating annotations and graph lines
Acartürk, Cengiz; Çağıltay, Kürşat (2008-09-30)
Graphs are often accompanied by text, i.e. linguistically coded information. augmenting information presented diagrammatically. Thus graph comprehension by human Often Constitutes comprehension and integration of information provided by different representational modalities, namely graphical elements and Verbal Constituents. In this Study We focus on text annotations to line graphs providing information about events, processes and their temporal properties its well it temporal relations about the events and...
Citation Formats
A. Özge, H. Christopher, and C. Acartürk, “Gesture and language production in communication through bar graphs,” presented at the Proceedings of the 35th Annual Meeting of the Cognitive Science Society, July 31-August 3, 2013, Berlin, Germany, 2013, Accessed: 00, 2021. [Online]. Available: