Investigating the impact of testing and spacing on students' achievement in an undergraduate course: Utilizing a learning analytics application

2024-7-5
Ulus, Beste
This study utilizes learner data from the Pearson MyLab system, incorporating learning analytics (LA) technologies. It also employs Bjork's theory of disuse (1999), introducing desirable difficulties. Learners repeat through automated quizzes reinforcing the concepts learned in class with the system's Dynamic Study Modules (DSM). They receive actionable interventions based on their progress. Learning metrics are generated based on learners' DSM assignment attempts.The study found that using DSM quizzes as a learning analytics intervention enhanced student performance. Furthermore, regression analysis indicated that DSM quizzes, as a form of retrieval practice, significantly improved retention for both midterm and final exams, supporting the testing effect.The process mining results revealed that students who struggled with DSM assignments required more time to complete them and participated in fewer refresher activities. These findings highlighted the significance of retrieval practice in improving student exam performance. Similarly, sequence analysis demonstrated the relation between how students distributed their DSM quizzes throughout the semester and their achievement. When students spaced out their studies more evenly, they tended to achieve better results.The study's findings demonstrate that innovative data analytics methods, such as process mining and sequence analysis, informed by learning theories, can potentially enhance our understanding of student performance. In addition, these methods provided insight into the effectiveness of a learning analytics application that incorporates retrieval practice.
Citation Formats
B. Ulus, “Investigating the impact of testing and spacing on students’ achievement in an undergraduate course: Utilizing a learning analytics application,” Ph.D. - Doctoral Program, Middle East Technical University, 2024.