Elderly Speech-Gaze Interaction State of the Art and Challenges for Interaction Design

Date

2015-08-07

Author

Acartürk, Cengiz
Fal, Mehmetcal
Dias, Miguel Sales

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

16
views

0
downloads

Elderly people face problems when using current forms of Human-Computer Interaction (HCI). Developing novel and natural methods of interaction would facilitate resolving some of those issues. We propose that HCI can be improved by combining communication modalities, in particular, speech and gaze, in various ways. This study presents elderly speech-gaze interaction as a novel method in HCI, a review of literature for its potential of use, and discusses possible domains of application for further empirical investigations.

Subject Keywords

Multimodal, Gaze, Eye tracking, Speech, Elderly, Interaction

URI

https://hdl.handle.net/11511/30883

DOI

https://doi.org/10.1007/978-3-319-20678-3_1

Collections

Graduate School of Informatics, Conference / Seminar

Suggestions

OpenMETU
Core

"Read That Article": Exploring Synergies between Gaze and Speech Interaction Vieira, Diogo; Freitas, Joao Dinis; Acartürk, Cengiz; Teixeira, Antonio; Sousa, Luis; Silva, Samuel; Candeias, Sara; Dias, Miguel Sales (2015-10-28) Gaze information has the potential to benefit Human-Computer Interaction (HCI) tasks, particularly when combined with speech. Gaze can improve our understanding of the user intention, as a secondary input modality, or it can be used as the main input modality by users with some level of permanent or temporary impairments. In this paper we describe a multimodal HCI system prototype which supports speech, gaze and the combination of both. The system has been developed for Active Assisted Living scenarios.
Secondary-Task Effects on Learning With Multimedia: An Investigation Through Eye-Movement Analysis Acartürk, Cengiz (2017-01-01) This study investigates secondary-task interference on eye movements through learning with multimedia. We focus on the relationship between the influence of the secondary task on the eye movements of learners, and the learning outcomes as measured by retention, matching, and transfer. Half of the participants performed a spatial tapping task while studying the instructional materials, whereas the other half studied the materials, without spatial tapping. The results revealed suboptimal learning outcomes und...
Portable obstructive sleep apnea detection and mobile monitoring Cakmak, Duygu Demirkol; Eyüboğlu, Behçet Murat (2017-04-10) Obstructive sleep apnea syndrome is becoming a prevalent disease for both adults and children. It is described as the cessation of breath for at least 10 seconds during sleep. Detecting sleep apnea is considered as a troublesome and time-consuming method, which requires the patients to stay one or more nights in dedicated sleep disorder rooms with sensors physically attached to their body. Undiagnosed thereby untreated sleep apnea patients are under high risk of hypertension, heart attack, traffic accident ...
Eye tracking for interactive accessibility: a usability analysis of communication interfaces Arslan, Kaan Sergen; Acartürk, Cengiz; Department of Cognitive Sciences (2020) At the late stages of ALS, i.e., Amyotrophic Lateral Sclerosis, individuals may lose their ability to speak, eat, move, and even breathe without ventilator support. Alternative modalities of communication, such as gaze, may have a potential to provide a communication interface that may increase the quality of life in cases as such. This study aims at developing interactive interfaces for gaze-based communication, and it reports a small-scale usability analysis for a comparison of the interfaces. In particul...
Demonstratives in the context of a collaborative problem solving task Büyüktekin, Faruk; Çakır, Murat Perit; Temürcü, Ceyhan; Department of Cognitive Sciences (2018) Multimodal user interfaces have become increasingly important. They are being used in various applications such as computer games, online education, simulations, and assistive technology. Such interfaces now can make use of inputs coming from different modalities such as speech and eye gaze. This multimodality enables situated dialogue between users and artificial agents, encouraging collaborative language use. Naturally, people need to refer to entities in the surrounding environment using demonstratives d...

Citation Formats

C. Acartürk, M. Fal, and M. S. Dias, “Elderly Speech-Gaze Interaction State of the Art and Challenges for Interaction Design,” 2015, vol. 9175, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/30883.