Multi-sensory perception in virtual world animation using mcgurk effect

Download

index.pdf

Date

2019

Author

Allahgholipour, Babak

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

117
views

114
downloads

Information about multisensory perception and brain cognition mechanism lead to a better virtual world creation. Brain store visual and auditory information to use in predicting future events. Image memory takes information from visual clues which during speech recognition happens by recording visual information and its auditory mappings. Based on this process, brain create prediction mechanism for future events. In speech recognition brain record sound and its visual presentation. When brain encounter difficulty in perception an auditory stimulus, it looks for visual mappings to guess the result. Considering the fact that some completely unrelated similarity may exist, some mapping may not lead to better understanding the world around. When previous information misleads the brain to understand the situation cognitive biases happen. McGurk Effect discusses how different lip movements affect auditory perception to get disparate information. Variety of factors influence amount of dependency on visual clues. Tracking speaking, especially in challenging environments, can be increased by visual clues such as face expressions, tongue and lips movements. Considering these elements in virtual world and game designing lead to improving believability. Perception processes, brain nature, designing factors, graphical elements, and visual structures are discussed to find out improved ways in designing realistic auditory and visual components.

Subject Keywords

Perception., Multisensory Perception, Auditory and Visual Process, Virtual World Animation, McGurk Effect .

URI

http://etd.lib.metu.edu.tr/upload/12625081/index.pdf
https://hdl.handle.net/11511/45100

Collections

Graduate School of Informatics, Thesis

Suggestions

OpenMETU
Core

Sound Perception in Virtual Environments Doğan, Aslı Zeynep; Sorguç, Arzu; Department of Building Science in Architecture (2022-12-20) Virtual environments have been developing for a long time and are changing the understanding of a space by means of how we design, perceive and use it. This new understanding of space requires people to adapt by gaining a new type of spatial cognition that can help people to combine the possibilities of a virtual space with the physical space they are used to: by making use of their different sensory skills. The aim of this study is to contribute to the literature on the improvement of the auditory percepti...
Prototype Hardware Design for Brain Computer Interface Applications Erdogan, Balkar; Akinci, Berna; Acar, Erman; Usakli, Ali Buelent; Gençer, Nevzat Güneri (2009-01-01) Brain Computer Interface (BCI) is an alternative communication pathway between the human brain and outside world in which only the brain activity is interpreted in a special way. These systems are based on the electrical activity of the brain that can be measured via Electroencephalography (EEG) devices. BCI enables people with severe motor disorders (like ALS) to communicate with their environment or control a wheelchair for their movement by using the EEG signals. In this study, a prototype data acquisito...
Brain Computer Interfaces for Silent Speech TABAR, Yousef Rezaei; Halıcı, Uğur (2017-05-01) Brain Computer Interface (BCI) systems provide control of external devices by using only brain activity. In recent years, there has been a great interest in developing BCI systems for different applications. These systems are capable of solving daily life problems for both healthy and disabled people. One of the most important applications of BCI is to provide communication for disabled people that are totally paralysed. In this paper, different parts of a BCI system and different methods used in each part ...
Optimal and human eye movements to clustered low value cues to increase decision rewards during search ECKSTEIN, Miguel P.; SCHOONVELD, Wade; ZHANG, Sheng; MACK, Stephen C.; Akbaş, Emre (Elsevier BV, 2015-08-01) Rewards have important influences on the motor planning of primates and the firing of neurons coding visual information and action. When eye movements to a target are differentially rewarded across locations, primates execute saccades towards the possible target location with the highest expected value, a product of sensory evidence and potentially earned reward (saccade to maximum expected value model, sMEV). Yet, in the natural world eye movements are not directly rewarded. Their role is to gather informa...
Language learning from the perspective of nonlinear dynamic systems Hohenberger, Annette Edeltraud; Peltzer-Karpf, Annemarie (Walter de Gruyter GmbH, 2009-01-01) This article outlines a nonlinear dynamic systems approach to language learning on the basis of developmental cognitive neuroscience. Language learning, on this view, is a process of experience-dependent shaping and selection of broadly defined domain-general and domain-specific genetic predispositions. The central concept of development is (neuro) cognitive,e growth in terms of self-organization. Linguistic structure-building is synergetic and emergent insofar as the acquisition of a critical mass of eleme...

Citation Formats

B. Allahgholipour, “Multi-sensory perception in virtual world animation using mcgurk effect,” Thesis (M.S.) -- Graduate School of Informatics. Multimedia Informatics., Middle East Technical University, 2019.