Communication through diagrams: division of labor between gestures and arrows

Coşkun, Melda
In this study, we aim at studying the relation between arrow production and gesture production in various multimedia teaching environments. Twenty-four participants, who were all experienced educators, were asked to teach a topic of their choice, as if he teaches to a learner audience. They taught the same topic in the same way in three experimental conditions: (i) Teaching on the board, (ii) Pen-and-paper teaching, (iii) Teaching by a tablet. All experiment sessions were videotaped. For the analysis, gestures and arrows were annotated. Arrows were classified into three groups: deictic arrows direct attention to the specific area, relational arrows connect two representations, and iconic arrows present motion, force, physical representations, and processes in a depiction. Gestures were also divided into three groups: deictic gestures point to entities, iconic gestures present picturable aspects of semantic content, and finally beat gestures are speech-related rhythmic hand movements. The results indicated that speakers produced more gestures and fewer arrows in the board session. This difference decreased in the paper session and reversed itself in the tablet session. Similar trends were also found in the relation between deictic and iconic gestures together compared to all arrows, and iconic gestures compared to iconic arrows. These results support the hypothesis that there is a trade-off between arrow and gesture production. These results also suggest that arrows and gestures are used for similar communicative purposes in different modalities.


Learning Mathematics with Interactive Whiteboards and Computer-Based Graphing Utility
Erbaş, Ayhan Kürşat; Kaya, Sukru (2015-04-01)
The purpose of this study was to explore the effect of a technology-supported learning environment utilizing an interactive whiteboard (IWB) and NuCalc graphing software compared to a traditional direct instruction-based environment on student achievement in graphs of quadratic functions and attitudes towards mathematics and technology. Sixty-five high school graduates attending cram schools (called dershane in Turkish) to study for the university entrance examination participated in the study. The signific...
Secondary-Task Effects on Learning With Multimedia: An Investigation Through Eye-Movement Analysis
Acartürk, Cengiz (2017-01-01)
This study investigates secondary-task interference on eye movements through learning with multimedia. We focus on the relationship between the influence of the secondary task on the eye movements of learners, and the learning outcomes as measured by retention, matching, and transfer. Half of the participants performed a spatial tapping task while studying the instructional materials, whereas the other half studied the materials, without spatial tapping. The results revealed suboptimal learning outcomes und...
Student Engagement in Blended Learning Environments with Lecture-Based and Problem-Based Instructional Approaches
This study investigates how blending of different instructional approaches with technology affects students' engagement. A computer networks course was designed and implemented for the first eight weeks of the semester as a lecture-based blended learning environment and for the second eight weeks of the semester as a problem-based blended learning environment. A single group repeated measures research design was carried out to understand if there are significant differences in measures of student engagement...
Eye tracking in multimodal comprehension of graphs
Acartürk, Cengiz (2012-07-31)
Eye tracking methodology has been a major empirical research approach for the study of online comprehension processes in reading and scene viewing. The use of eye tracking methodology for the study of diagrammatic representations, however, has been relatively limited so far. The investigation of specific types of diagrammatic representations, such as statistical graphs is even scarce. In this study, we propose eye tracking as an empirical research approach for a systematic analysis of multimodal comprehensi...
Preliminary results of a novel enhancement method for high-frequency hearing loss
Arioz, Umut; Arda, Kemal; Tuncel, Umit (Elsevier BV, 2011-06-01)
In this study, a software program was developed for high-frequency hearing loss subjects that includes a detailed audiogram and novel enhancement methods. The software performs enhancements of the audibility of high-frequency sounds according to the subject's detailed 31-point audiogram. This provides subject-specific gains in the entire frequency spectrum, and especially for high frequencies, of sounds. Amplification, compression, and transposition are the three main processing methods used to obtain the d...
Citation Formats
M. Coşkun, “Communication through diagrams: division of labor between gestures and arrows,” M.S. - Master of Science, Middle East Technical University, 2014.