Eye tracking evidence for multimodal language graphics comprehension The role of integrated conceptual representations

Date

2009-05-31

Author

Deniz, Ozan
Fal, Mehmetcan
Bozkurt, Ufuk
Acartürk, Cengiz

Metadata

Show full item record

Item Usage Stats

139
views

0
downloads

In this paper, we propose a computational architecture for multimodal comprehension of text and graphics. A theoretical account of the integrated conceptual structures induced by linguistic and graphical entities is presented. We exemplify these structures with the analysis of an excerpt from a report published by Point Reyes Bird Observatory (PRBO). Experimental evidence, based on the analyses of subject’s eye movement recordings was evaluated under the framework of the architecture.

URI

https://hdl.handle.net/11511/85536

Conference Name

NODALIDA 2009 Workshop. Multimodal Communication - from Human Behaviour to Computational Models, (14 Mayıs 2009)

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

Applied supervisory control for a flexible manufacturing system Moor, Thomas; Schmidt, Klaus Verner; Perk, Sebastian (2010-12-01) This paper presents a case study in the design and implementation of a discrete event system (DES) of real-world complexity. Our DES plant is a flexible manufacturing system (FMS) laboratory model that consists of 29 interacting components and is controlled via 107 digital signals. Regarding controller design, we apply a hierarchical and decentralised synthesis method from earlier work in order to achieve nonblocking and safe closed-loop behaviour. Regarding implementation, we discuss how digital signals tr...
Parametric Urban Design Thinking: Shared Patterns in Design by Algorithm and Design by Drawing Çalışkan, Olgu; Ongun, Gokhan (2021-12-01) The paper suggests a focused examination of the processes of drafting-based design and parametric design in urbanism. It discusses how spatial design's settled cognition would differ by using algorithmic systems through the altered relationships between the basic operations in design. To reveal the commonalities and distinctions between the two design methods, the authors present the detailed documentation of the workshop series, which experimented with both techniques within similar design contexts. By the...
Verbal morphemes guide thematic role assignment in children Özge, Duygu; Arslan Uzundağ, Berna; Küntay Copty, Ayşe Aylin (null; 2014-09-03) Architectures and Mechanisms for Language Processing (AMLaP)
Exploitation of multi-camera configurations for visual surveillance Akman, Oytun; Alatan, Abdullah Aydın; Çiloğlu, Tolga (2008-06-20) In this paper, we propose novel methods for background modeling, occlusion. handling and event recognition by using multi-camera configurations. Homography-related positions are utilized to construct a mixture of multivariate Gaussians to generate a background model for each pixel of the reference camera. Occlusion handling is achieved by generation of the top-view via trifocal tensors, as a result of matching over-segmented regions instead of pixels. The resulting graph is segmented into objects after dete...
Performance-based parametric design explorations: A method for generating appropriate building components Ercan, Burak; Elias Özkan, Soofia Tahira (2015-05-01) Performance-based parametric design explorations depend on formulating custom-designed workflows that require reading, writing, interpreting and manipulating databases, as part of the design process. The possibilities of customization and parameterization offered by the user-friendly interfaces of advanced building-performance simulation software and digital design tools have now enabled architects to carry out performance-based design explorations without the help of simulation experts. This paper presents...

Citation Formats

O. Deniz, M. Fal, U. Bozkurt, and C. Acartürk, “Eye tracking evidence for multimodal language graphics comprehension The role of integrated conceptual representations,” Odense, Danimarka, 2009, vol. 6, p. 9, Accessed: 00, 2021. [Online]. Available: https://hdl.handle.net/11511/85536.