Multimodal comprehension of graphics with textual annotations The role of graphical means relating annotations and graph lines

Graphs are often accompanied by text, i.e. linguistically coded information. augmenting information presented diagrammatically. Thus graph comprehension by human Often Constitutes comprehension and integration of information provided by different representational modalities, namely graphical elements and Verbal Constituents. In this Study We focus on text annotations to line graphs providing information about events, processes and their temporal properties its well it temporal relations about the events and processes in question. We present results of all experimental investigation on parameters which influence subject's interpretations concerning the temporal properties of the annotated events and oil eve movement behavior. In particular. we discuss the role of graph shape and the role of graphical means for relating, textual annotations and determined part of the graph line.


Gesture and language production in communication through bar graphs
Özge, Alaçam; Christopher, Habel; Acartürk, Cengiz (Cognitive Science Society; 2013-08-31)
Bar graphs and line graphs are commonly used ways of graphical communication. Due to the difference in their perceptual visuo-spatial properties, they facilitate comprehension of different events. Bar graphs are commonly used in the domain of precipitation although the data intrinsically carry information that is averaged over long time spans. In this study, we investigate how the presence of incongruence between consecutive graph pairs influences conceptualization of the represented information about preci...
Gestures in communication through line graphs
Özge, Alaçam; Christopher, Habel; Acartürk, Cengiz (null; 2012-08-31)
Line graphs are widely used in communication settings, for conveying information about states and processes that unfold in time. The communication is achieved by the contribution of other modalities than graphs, such as language and gestures. In a set of experimental investigations, we analyzed the production and comprehension of gestures during communication through line graphs. The findings reveal a systematic use of gestures as well as the limitations of cognitive resources due to the split of attention ...
Towards designing audio assistance for comprehending haptic graphs A multimodal perspective
DENİZ, OZAN; MEHMETCAN, FAL; Acartürk, Cengiz (2013-07-31)
Statistical graphs, such as line graphs are widely used in multimodal communication settings. Language accompanies graphs and humans produce gestures during the course of communication. For visually impaired people, haptic-audio interfaces provide perceptual access to graphical representations. The local and sequential character of haptic perception introduces limitations in haptic perception of hard-to-encode information, which can be resolved by providing audio assistance. In this article we first present...
Multi-view Face Detection with One Classifier for Video Analytics Systems
Kaya, Tunç Güven (2014-08-24)
In a video analytics for audience measurement system, dwell time, gaze, and opportunity-to-see statistics are required most of the time. To generate these statistics, more than one face detector is used in order to capture both profile and frontal faces. In this paper, we present a novel approach for face detection in video analytics. The assumption is that; the face occurrences are limited in such systems and one classifier is able to capture all of these occurrences. By using MB-LBP for feature extraction...
Bimodal visualisation: A financial trading case study
Taşkaya Temizel, Tuğba (2003-01-01)
A visualisation system that deals with two modalities of information - numerical and textual - is presented. The current application domain is that of prediction in financial trading. The system synthesises news stories and time series data to generate buy/sell signals for financial instruments.
Citation Formats
C. Acartürk and K. Çağıltay, “Multimodal comprehension of graphics with textual annotations The role of graphical means relating annotations and graph lines,” 2008, vol. 5223, Accessed: 00, 2020. [Online]. Available: