An Eye Tracking Analysis of Conversational Violations in Dyadic and Collaborative Interaction

2022-01-01
Cagiltay, Bengisu
Acartürk, Cengiz
Linguistic principles are crucial in maintaining reliable and transparent communication for dyadic interactions. However, violating these principles might result in unwieldy and problematic communications. We use gaze as a medium to explore how visual attention and task performance changes when conversational violations occur. We conducted an eye-tracking study (N = 17) measuring changes in visual patterns in response to social communication errors, specifically Grice's Maxims violations. Our study investigates how social-communicative errors influence task performance and gaze during dyadic and collaborative social interactions. The results suggest participants' visual exploration patterns shift towards the violator when the maxim of Relation is violated in a task instruction. Gaze stays mainly within the task area after receiving instructions with Quantity, Quality, and Manner violations. Moreover, it takes longer to respond to task instructions that include Quantity and Quality violations, than the Manner and Relation violations. Finally, our qualitative analysis revealed participants' adaptive and non-adaptive strategies in response to the Quality violation. Our findings contribute to the design space of human performance in dyadic and collaborative interactions, with future work implications exploring human performance in joint system-human interactions.
16th International Conference on Augmented Cognition (AC) Held as Part of the 24th International Conference on Human-Computer Interaction (HCII)

Suggestions

An investigation of interactions with conversational violations: Insights from visual perception and Gricean Maxim violations
Çağıltay, Bengisu; Acartürk, Cengiz; Department of Cognitive Sciences (2020-11)
Linguistic principles at various levels are crucial in maintaining a reliable and transparent communication for dyadic interactions. However, violating these principles might result in unwieldy and problematic communications. Gaze can be a medium of reflecting the cognitive responses when conversational violations occur. An eye-tracking study was conducted to investigate visual patterns in communication in response to social communication errors, specifically Grice’s Maxims violations. This study investigat...
Expanding horizons of cross-linguistic research on reading: The Multilingual Eye-movement Corpus (MECO)
Siegelman, Noam; et. al. (2022-02-01)
Scientific studies of language behavior need to grapple with a large diversity of languages in the world and, for reading, a further variability in writing systems. Yet, the ability to form meaningful theories of reading is contingent on the availability of cross-linguistic behavioral data. This paper offers new insights into aspects of reading behavior that are shared and those that vary systematically across languages through an investigation of eye-tracking data from 13 languages recorded during text rea...
Applying the personalization principle of multimedia learning theory in second language listening classes
Yeşildağ, Ceren ; Sadık, Olgun (2021-08-01)
Earlier works in various contexts investigated the effectiveness of the personalization principle of Multimedia Learning Theory (MLT). According to MLT, better learning outcomes can be achieved when instructional material is delivered through a conversational speaking style rather than a formal style. However, no conclusion has been drawn on the issue that the personalization principle is effective in every condition. This study investigated whether the personalization principle has any effect on second lan...
Diversity Analysis of Hierarchical Modulation in Cooperative Communication
Yalcin, Ahmet Zahid; Yüksel Turgut, Ayşe Melda (2014-01-01)
In cooperative communication systems, hierarchical modulation is used to increase systems robustness and to send different information flows simultaneously. In cooperative communication systems which use hierarchical modulation, error propagation is the most important problem that prevents achieving full diversity gain. Thresholds that depend on the signal to noise ratio (SNR) value between the source and the relay can be used to mitigate error propagation. If the instantaneous SNR between the source and th...
Deictic gaze in virtual environments
Yılmaz, Efecan; Acartürk, Cengiz; Department of Cognitive Sciences (2018)
The research in human-robot interaction (HRI) involve topics, such as interlocutor collaboration in joint action, deixis in HRI, or the properties of shared environments. Moreover, referring expressions are particularly studied in joint action from both expression generation and resolution perspectives. Selective visual attention in gaze interaction and saliency patterns are also active topics in HRI. The present thesis investigated in a virtual reality (VR) environment an HRI and joint action situation wit...
Citation Formats
B. Cagiltay and C. Acartürk, “An Eye Tracking Analysis of Conversational Violations in Dyadic and Collaborative Interaction,” ELECTR NETWORK, 2022, vol. 13310, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/100587.