Deictic gaze in virtual environments

Download
2018
Yılmaz, Efecan
The research in human-robot interaction (HRI) involve topics, such as interlocutor collaboration in joint action, deixis in HRI, or the properties of shared environments. Moreover, referring expressions are particularly studied in joint action from both expression generation and resolution perspectives. Selective visual attention in gaze interaction and saliency patterns are also active topics in HRI. The present thesis investigated in a virtual reality (VR) environment an HRI and joint action situation with the assistance of eye tracking in a head-mounted display device in order to explore the augmentation of non-verbal communication in HRI. For this purpose, we employed a multimodal approach in communication with both non-verbal deictic expressions (gaze) and explicit verbal references in a multi-robot agent, single human experiment setting. The number of robot agents varied during experiments in order to investigate the social robotics influence of this measure on our metrics. We also utilized two distinct robot agent designs to explore an interaction effect with the number of robot agents as we evaluated participants’ deixis resolution time and accuracy, as well as their gaze interaction patterns. The results of the research showed that the participants’ accuracy, gaze interaction, and response time in deixis resolution were significantly influenced by the varying number of robot agents. However, this effect was not present when the participants were presented with explicit verbal references. Participants’ gaze interaction results also showed that the number of robot agents significantly influence the saliency of the robot agents. Moreover, the participants interacted with the robot agents even when the joint task did not require gaze interaction.

Suggestions

Guidelines and principles for efficient interaction on large touchscreens with collaborative usage
Pekin, Tacettin Sercan; İşler, Veysi; Günel Kılıç, Banu; Department of Information Systems (2017)
Understanding collaborative usage of large-size screen systems is important for advancing the general study of human-computer interaction (HCI) as well as for guiding the designers while creating efficient interactive large-size systems. This thesis aims to provide guidance for the designers of collaborative large-size screen systems. It therefore gives background information about such systems, defines similarities and differences in existing systems, compares existing design guidelines and principles, tes...
Knowledge discovery in microarray data of bioinformatics
Kocabaş, Fahri Salih; Baykal, Nazife; Department of Health Informatics (2012)
This thesis analyzes major microarray repositories and presents a metadata framework both to address the current issues and to promote the main operations such as knowledge discovery, sharing, integration, and exchange. The proposed framework is demonstrated in a case study on real data and can be used for other high throughput repositories in biomedical domain. Not only the number of microarray experimentation increases, but also the size and complexity of the results rise in response to biomedical inquiri...
Trust attribution in collaborative robots: An experimental investigation of non-verbal cues in a virtual human-robot interaction setting
Ahmet Meriç, Özcan; Şahin, Erol; Acartürk, Cengiz; Department of Bioinformatics (2021-6)
This thesis reports the development of non-verbal HRI (Human-Robot Interaction) behaviors on a robotic manipulator, evaluating the role of trust in collaborative assembly tasks. Towards this end, we developed four non-verbal HRI behaviors, namely gazing, head nodding, tilting, and shaking, on a UR5 robotic manipulator. We used them under different degrees of trust of the user to the robot actions. Specifically, we used a certain head-on neck posture for the cobot using the last three links along with the gr...
The Effect of kinemorphs on F-formation shapes: an investigation on human robot interaction in virtual reality
Özen, Gizem; Acartürk, Cengiz; Department of Cognitive Sciences (2019)
The main goal of this thesis is to study how kinemorphs influence F-formation shapes by focusing on the occurrences of one-to-one F-formation shapes in a virtual environment social interaction setting. The problem statement relies three aspects of this investigation. Firstly, it has been known that the proximity is affected by kinemorphs; however, it is not clear whether the shape of a social group’s spatial arrangement is also influenced by kinemorphs. In the present study, F-formation shape of two facial ...
Examination of Computer Supported Collaborative Business Process Modeling with Activity Theory
FINDIK COŞKUNÇAY, DUYGU; Çakır, Murat Perit (2014-09-10)
Activity Theory provides a framework to examine and explain human-human and human-computer interactions. In this study, Activity Theory was used to examine both interactions in depth in the context of Computer Supported Collaborative Business Process Modeling (CSCBPM) in which geographically dispersed multiple users interact with each other and with the system. This framework enabled us to examine the activities of CSCBPM in detail and understand the process of CSCBPM. During the CSCBPM, some difficulties w...
Citation Formats
E. Yılmaz, “Deictic gaze in virtual environments,” M.S. - Master of Science, Middle East Technical University, 2018.