Demonstratives in the context of a collaborative problem solving task

Download
index.pdf
2018
Büyüktekin, Faruk
Show full item record
121
views
31
downloads
Multimodal user interfaces have become increasingly important. They are being used in various applications such as computer games, online education, simulations, and assistive technology. Such interfaces now can make use of inputs coming from different modalities such as speech and eye gaze. This multimodality enables situated dialogue between users and artificial agents, encouraging collaborative language use. Naturally, people need to refer to entities in the surrounding environment using demonstratives during the conversation. Multimodal interfaces must resolve these referring expressions for successful communication. However, demonstrative reference is still a challenging problem due to the complex nature of the phenomenon. Traditional accounts of demonstratives are individual and speaker-centric, suggesting a distance contrast. On the contrary, recent findings reveal it is a joint and multimodal action. Consequently, there is a need to study demonstratives in a situated and distributed framework to better understand the cognitive processes behind reference generation and resolution. To this end, this study investigated the relationship between demonstrative use and eye gaze of the participants collaborating in a situated environment. Our findings suggest demonstrative reference does not occur randomly, rather follows certain cognitive principles, which questions the prevailing speaker-centric view. They clearly show it is a joint activity in which both the speaker and the listener play active roles. They also indicate eye gaze proves to be a significant visual cue, which is temporally linked with demonstrative use.
Visual perception., Human-computer interaction., User interfaces (Computer systems)., Grammar, Comparative and general
http://etd.lib.metu.edu.tr/upload/12622508/index.pdf
https://hdl.handle.net/11511/27504
Graduate School of Informatics, Thesis

Suggestions

User experience over time with conversational agents: case study of woebot on supporting subjective well-being
Demirci, Hatice Merve; Töre Yargın, Gülşen; Department of Industrial Design (2018)
Technological advancements re-shaped user-product interactions by enabling people to make conversation with interactive systems. This new form of interaction led designers to create a new type of user interface: Conversational User Interface (CUI). Expensive psychological therapy fees and people’s increased awareness related to importance of well-being attracted the interactive system developers to create a domain specific Conversational Agent, which is particularly focusing on psychological terapy and has ...
Ubiquitous Cloud-based Monitoring via a Mobile App in Smartphones: An Overview
Al-Turjman, Fadi; Betin Can, Aysu; Ever, Enver; Alturjman, Sinem (2016-11-20)
The prevalence of wearable devices brought questions about their impact on user habits, use cases and future developments. Will users continue to use smart phones even if they have high capacity wearable devices? If that will be the case, for which reason people will continue to carry smartphones with them? User mobility and soft application usage correlation is an important research area for setting a base to answer these questions. In this literature review we focus on two subjects; smartphone usage patte...
SIMULATION CONCEPTS FOR INFORMATION-SYSTEM
MOURANT, RR; Tarı, Zehra Sibel (Elsevier BV, 1993-09-01)
Recent Improvements in document image systems and their low-cost implementation on networks of microcomputers is leading to the reengineering of many information systems. We describe how document image systems can be applied to information systems. In order to compare the performance of a conventional information system with one implemented with document imaging processing capability we conducted a discrete event simulation. We modeled the conventional information system for processing graduate student ...
Wireless and mobile security
Bicakci, K; Baykal, Nazife (2001-09-08)
User mobility is becoming an important and popular feature in today's network. This is especially evident in wireless environment. Security is one of the challenging problems introduced by mobile and wireless networking. There are many aspects to the provisioning of security that need to be addressed as part of the development and deployment of future wireless mobile networks. This paper discusses a wide range of issues related to security in wireless and mobile networking and reviews current state-of-the-a...
On-demand conversation customization for services in large smart environments
Elgedawy, I. (IBM, 2011-01-01)
Services in large smart environments, as defined in this paper, are "aware" of their users' contexts and goals and are able to automatically interact with one another in order to achieve these goals. Unfortunately, interactions between services (i.e., service conversations) are not necessarily compatible, as services could have different interfaces (i.e., signature incompatibilities), as well as different logic for message ordering (i.e., protocol incompatibilities). Such conversation incompatibilities crea...
Citation Formats
F. Büyüktekin, “Demonstratives in the context of a collaborative problem solving task,” M.S. - Master of Science, Middle East Technical University, 2018.
METU IIS - Integrated Information Service open@metu.edu.tr