Optimal and human eye movements to clustered low value cues to increase decision rewards during search

ZHANG, Sheng
MACK, Stephen C.
Akbaş, Emre
Rewards have important influences on the motor planning of primates and the firing of neurons coding visual information and action. When eye movements to a target are differentially rewarded across locations, primates execute saccades towards the possible target location with the highest expected value, a product of sensory evidence and potentially earned reward (saccade to maximum expected value model, sMEV). Yet, in the natural world eye movements are not directly rewarded. Their role is to gather information to support subsequent rewarded search decisions and actions. Less is known about the effects of decision rewards on saccades. We show that when varying the decision rewards across cued locations following visual search, humans can plan their eye movements to increase decision rewards. Critically, we report a scenario for which five of seven tested humans do not preferentially deploy saccades to the possible target location with the highest reward, a strategy which is optimal when rewarding eye movements. Instead, these humans make saccades towards lower value but clustered locations when this strategy optimizes decision rewards consistent with the preferences of an ideal Bayesian reward searcher that takes into account the visibility of the target across eccentricities. The ideal reward searcher can be approximated with a sMEV model with pooling of rewards from spatially clustered locations. We also find observers with systematic departures from the optimal strategy and inter-observer variability of eye movement plans. These deviations often reflect multiplicity of fixation strategies that lead to near optimal decision rewards but, for some observers, it relates to suboptimal choices in eye movement planning.


Seeing through transparent layers.
Dövencioğlu, Nahide Dicle; Koenderink, J; Doerschner, K (Association for Research in Vision and Ophthalmology (ARVO), 2018-09-04)
The human visual system is remarkably good at decomposing local and global deformations in the flow of visual information into different perceptual layers, a critical ability for daily tasks such as driving through rain or fog or catching that evasive trout. In these scenarios, changes in the visual information might be due to a deforming object or deformations due to a transparent medium, such as structured glass or water, or a combination of these. How does the visual system use image deformations to make...
Mood, Memory, and Motor Performance and the Severity of Tardive Dyskinesia
Gilleard, C. J.; Vaddadi, KS (SAGE Publications, 1986-12)
<jats:p> This study tested the hypothesis that the features of tardive dyskinesia were associated with motor slowing, memory impairment, and depressive apathy all of which are considered to characterize the so-called subcortical dementias. In a sample of 48 psychiatric patients all fulfilling research criteria for tardive dyskinesia and without other signs of organic illness age-independent correlations were observed between severity of orofacial dyskinesia and measures of memory, motor performance and mood...
Free gait generation with reinforcement learning for a six-legged robot
Erden, Mustafa Suphi; Leblebicioğlu, Mehmet Kemal (Elsevier BV, 2008-03-31)
In this paper the problem of free gait generation and adaptability with reinforcement learning are addressed for a six-legged robot. Using the developed free gait generation algorithm the robot maintains to generate stable gaits according to the commanded velocity. The reinforcement learning scheme incorporated into the free gait generation makes the robot choose more stable states and develop a continuous walking pattern with a larger average stability margin. While walking in normal conditions with no ext...
Sensory Weighting in a Rhythmic Ball Bouncing Task
Nickl, Robert; Ankaralı, Mustafa Mert; Cowan, Noah (2015-07-24)
The role of sensory information in walking remains unclear despite its relevance to understanding human locomotor deficits and as a source of insight for robotics. System identification experiments using sinusoidal perturbations of a visual scene have yielded insights into control of human standing posture [2]. We propose a framework through which similar techniques can be used to identify estimator and controller structures used by humans during rhythmic movement. A key challenge in translating these techn...
Strategies and difficulties in solving spatial visualization problems: a case study with adults
Kayhan, Emine Banu; Bulut, Safure; Department of Secondary Science and Mathematics Education (2012)
The purpose of the present study is to investigate the spatial strategies of adults and the difficulties they experience while solving spatial visualization problems. To achieve this purpose, a case study is conducted and the case of this study is the group of five adults studying secondary or elementary mathematics education in a public university in Ankara. Spatial Ability Test (SAT) and task based interviews are utilized to determine the participants’ spatial abilities; and to interpret their strategies,...
Citation Formats
M. P. ECKSTEIN, W. SCHOONVELD, S. ZHANG, S. C. MACK, and E. Akbaş, “Optimal and human eye movements to clustered low value cues to increase decision rewards during search,” VISION RESEARCH, pp. 137–154, 2015, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/35576.