Combining Trending Scan Paths with Arousal to Model Visual Behaviour on the Web: A Case Study of Neurotypical People vs People with Autism

Matthews, Oludamilare
Eraslan, Sukru
Yaneva, Victoria
Davies, Alan
Yesilada, Yeliz
Vigo, Markel
Harper, Simon
People with autism often exhibit different visual behaviours from neurotypical users. To explore how these differences are exhibited on the Web, we model visual behaviour by combining pupillary response, which is an unobtrusive measure of physiological arousal, with eye-tracking scan paths that indicate visual attention. We evaluated our approach with two populations: 19 neurotypical users and 19 users with autism. We observe differences in their visual behaviours as, in certain instances, individuals with autism exhibit a lower arousal response to affective contents. While this is consistent with the literature on autism, we confirm this phenomenon on the Web. We discuss how our modelling method can be used to identify possible UX issues such as the presence of stress, cognitive load and differences in the perception of Web elements in relation to physiological arousal.
27th ACM Conference on User Modeling, Adaptation and Personalization (ACM UMAP)


Khalaji, Erfan; Yesilada Yilmaz, Yeliz; Eraslan, Sukru; Computer Engineering (2021-7-14)
Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder that causes social, communication and behavioral challenges with different severity levels. Studies report a considerable increase in ASD prevalence during the past two decades, and clinical psychologists face difficulties identifying individuals with ASD. Researchers have been using different techniques such as eye-tracking to help address ASD diagnosis. A previous study shows that training a logistic regression model with eye-tr...
Can young people with autism refer to knowledge states? Evidence from their understanding of "know" and "guess"
Kazak Berument, Sibel; Lewis, V (1997-11-01)
A number of studies have reported that most individuals with autism have difficulty in attributing mental states. The primary aim of the present study was to compare the ability of children with autism to refer to knowledge states with that of mainstream school children and children with Down's syndrome. The second aim was to investigate the role of verbal mental age in referring to knowledge states. The third aim was to compare the ease with which the children referred to their own mental state and to that...
Disruption of an Evolutionarily Novel Synaptic Expression Pattern in Autism
Liu, Xiling; Han, Dingding; Somel, Mehmet; Jiang, Xi; Hui, Haiyang; Guijarro, Patricia; Zhang, Ning; Mitchell, Amanda; Halene, Tobias; Ely, John J.; Sherwood, Chet C.; Hof, Patrick R.; Qiu, Zilong; Paeaebo, Svante; Akbarian, Schahram; Khaitovich, Philipp (2016-09-01)
Cognitive defects in autism spectrum disorder (ASD) include socialization and communication: key behavioral capacities that separate humans from other species. Here, we analyze gene expression in the prefrontal cortex of 63 autism patients and control individuals, as well as 62 chimpanzees and macaques, from natal to adult age. We show that among all aberrant expression changes seen in ASD brains, a single aberrant expression pattern overrepresented in genes involved synaptic-related pathways is enriched in...
A family genetic study of autism associated with profound mental retardation
Starr, E; Kazak Berument, Sibel; Pickles, A; Tomlins, M; Bailey, A; Papanikolaou, K; Rutter, M (2001-02-01)
We sought to determine if the family loading for either the broader autism phenotype or for cognitive impairment differed according to whether or not autism was accompanied by severe mental retardation. The sample comprised 47 probands with autism meeting ICD-IO criteria, as assessed by the Autism Diagnostic Interview and the Autism Diagnostic Observation Schedule. Family history interview and findings were compared with those for the higher IQ autism and Down syndrome samples in the Bolton et al. (1994) st...
Investigating the design, development, and evaluation of a high-tech alternative and augmentative communication (AAC) application for communication needs of individuals with autism spectrum disorders
Polat, Hamza; Delialioğlu, Ömer; Department of Computer Education and Instructional Technology (2019)
Autism Spectrum Disorder (ASD) is a type of neurodevelopmental disorder that has two core symptoms; (i) absence of social communication and interaction, and (ii) presence of atypical behaviors. To deal with these symptoms, different treatment approaches such as Alternative and Augmentative Communication (AAC) are used for teaching communication skills to individuals with ASD. With the advancements in mobile technologies, practitioners in special education started to use high-tech aided AAC systems for commu...
Citation Formats
O. Matthews et al., “Combining Trending Scan Paths with Arousal to Model Visual Behaviour on the Web: A Case Study of Neurotypical People vs People with Autism,” Larnaca, Cyprus, 2019, p. 86, Accessed: 00, 2020. [Online]. Available: