Engaging with the Scenario: Affect and Facial Patterns from a Scenario-Based Intelligent Tutoring System

2018-06-20
Nye, Benjamin
Karumbaiah, Shamya
Tokel, Saniye Tuğba
Mark, Core
Giota, Stratou
Auerbach, Daniel
Kallirroi, Georgila
Facial expression trackers output measures for facial action units (AUs), and are increasingly being used in learning technologies. In this paper, we compile patterns of AUs seen in related work as well as use factor analysis to search for categories implicit in our corpus. Although there was some overlap between the factors in our data and previous work, we also identified factors seen in the broader literature but not previously reported in the context of learning environments. In a correlational analysis, we found evidence for relationships between factors and self-reported traits such as academic effort, study habits, and interest in the subject. In addition, we saw differences in average levels of factors between a video watching activity, and a decision making activity. However, in this analysis, we were not able to isolate any facial expressions having a significant positive or negative relationship with either learning gain, or performance once question difficulty and related factors were also considered. Given the overall low levels of facial affect in the corpus, further research will explore different populations and learning tasks to test the possible hypothesis that learners may have been in a pattern of “Over-Flow” in which they were engaged with the system, but not deeply thinking about the content or their errors.

Suggestions

Spatio-Temporal Analysis of Facial Actions using Lifecycle-Aware Capsule Networks
Churamani, Nikhil; Kalkan, Sinan; Güneş, Hatice (2021-12-26)
Most state-of-the-art approaches for Facial Action Unit (AU) detection rely on evaluating static frames, encoding a snapshot of heightened facial activity. In real-world interactions, however, facial expressions are more subtle and evolve over time requiring AU detection models to learn spatial as well as temporal information. In this work, we focus on both spatial and spatio-temporal features encoding the temporal evolution of facial AU activation. We propose the Action Unit Lifecycle-Aware Capsule Network...
Comparative case study on the use of laser scanners for construction quality control and progress monitoring
Atasoy Özcan, Güzide; Akinci, Burcu (2009-10-01)
Laser scanning is an emerging technology used on construction sites for defect detection and progress monitoring. Most previous studies in this domain use data from a single scanner while discussing various data collection, processing and accuracy analysis strategies. With the purpose of comparing the tech-nical characteristics of two scanners and identifying the challenges of using them on construction sites, we conducted a case study on indoor laser-scanning of one floor of a five-storey commercial buildi...
Comparison of 3D local and global descriptors for similarity retrieval of range data
Bayramoglu, Neslihan; Alatan, Abdullah Aydın (2016-04-05)
Recent improvements in scanning technologies such as consumer penetration of RGB-D cameras lead obtaining and managing range image databases practical. Hence, the need for describing and indexing such data arises. In this study, we focus on similarity indexing of range data among a database of range objects (range-to-range retrieval) by employing only single view depth information. We utilize feature based approaches both on local and global scales. However, the emphasis is on the local descriptors with the...
Fine‐grained recognition of maritime vessels and land vehicles by deep feature embedding
Solmaz, Berkan; Gundogdu, Erhan; Yucesoy, Veysel; Koc, Aykut; Alatan, Abdullah Aydın (2018-12-01)
Recent advances in large-scale image and video analysis have empowered the potential capabilities of visual surveillance systems. In particular, deep learning-based approaches bring in substantial benefits in solving certain computer vision problems such as fine-grained object recognition. Here, the authors mainly concentrate on classification and identification of maritime vessels and land vehicles, which are the key constituents of visual surveillance systems. Employing publicly available data sets for ma...
OBJECT RECOGNITION AND LOCALIZATION WITH ULTRASONIC-SCANNING
KIRAGI, H; Ersak, Aydın (1994-04-14)
In this paper an object recognition and localization system based on ultrasonic range imaging to be used in optically opaque environments is introduced. The system is especially designed for robotics applications. The ultrasonic image is acquired by scanning ultrasonic transducers in two dimensions above the area where objects are located. The features that are used for recognition and localization processes are extracted from the outermost boundaries of the objects present in the input scene. Experimental ...
Citation Formats
B. Nye et al., “Engaging with the Scenario: Affect and Facial Patterns from a Scenario-Based Intelligent Tutoring System,” 2018, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/36294.