Validating aspects of a reading test

Download
2018
Akşit, Zeynep
This study investigated three aspects of validity (i.e., context, cognitive and scoring) of a reading test: First, the reading test construct was defined based on the cognitive processing model and its criterial features were presented in the test specifications. Secondly, to establish cognitive validity, the cognitive processes that were activated during test taking were investigated through retrospective and introspective verbal data. The results revealed whether the test elicited behavior reflective of reading activities beyond the testing situation. Finally, the scoring validity of the test was examined through item analysis. The findings revealed that the performances were generalizable: the tasks elicited behavior similar to those in real-life reading, and that the criterial parameters of the test were at an acceptable level for the intended population. Moreover, the majority of the item parameters were within the expected ranges. This study and its findings have important implications. At the organizational level, the results have implications for improvement in testing practice: the sociocognitive framework provides a systematic approach and encourages the generation of evidence for validity at all stages of test development. Moreover, test scores that reliably reflect test takers’ ability on relevant aspects of reading help improve reading instruction. Instruction that is grounded in theory and supported with established needs can help students be equipped with skills required for successful academic reading. Implications at the theoretical level are: The cognitive processing reading model, which was originally based on L1 reading, successfully defines L2 academic reading within the context of this study

Suggestions

Assessing a model of cognitive test anxiety: the role of rumination, self-forgiveness, perfectionism cognitions, and cognitive defusion through the indirect effect of psychological flexibility
Aydın, Gökçen; Güneri, Oya; Department of Educational Sciences (2017)
The aim of this study was to test a model investigating the role of rumination, self-forgiveness, perfectionism cognitions, and cognitive defusion in predicting cognitive test anxiety through the indirect effect of psychological flexibility. The sample included 715 (351 females and 364 males) students from a state university in Turkey. The data collection instruments used in the study were Demographic Information Form, Cognitive Test Anxiety Scale-Revised, State Self-Forgiveness Scale, Perfectionism Cogniti...
A philosophical analysis of computational modeling in cognitive science
Ürgen, Burcu Ayşen; Bağçe, Samet; Department of Cognitive Sciences (2007)
This study analyses the methodology of computational cognitive modeling as one of the ways of conducting research in cognitive science. The aim of the study is to provide an understanding of the place of computational cognitive models in understanding human cognition. Considering the vast number of computational cognitive models which have been just given to account for some cognitive phenomenon by solely simulating some experimental study and fitting to empirical data, a practice-oriented approach is adopt...
Investigation of Students’ Cognitive Processes in Computer Programming: A Cognitive Ethnography Study
Doğan, Sibel; Aslan, Orhan; Yıldırım, İbrahim Soner (2019-01-01)
The aim of the current study is to investigate how cognitive processes of students categorized as novice, semi-expert and expert differ in terms of creating pseudocode for a given programming task. To conduct this aim, cognitive ethnography research design was employed to reveal the cognitive process of the participants behind the specified task. In the study, three undergraduate students from a Computer Education and Instructional Technology (CEIT) department were included as participants. These students w...
Mood, Memory, and Motor Performance and the Severity of Tardive Dyskinesia
Gilleard, C. J.; Vaddadi, KS (SAGE Publications, 1986-12)
<jats:p> This study tested the hypothesis that the features of tardive dyskinesia were associated with motor slowing, memory impairment, and depressive apathy all of which are considered to characterize the so-called subcortical dementias. In a sample of 48 psychiatric patients all fulfilling research criteria for tardive dyskinesia and without other signs of organic illness age-independent correlations were observed between severity of orofacial dyskinesia and measures of memory, motor performance and mood...
Seventh Graders' Statistical Literacy: an Investigation on Bar and Line Graphs
Çatman Aksoy, Emine; Işıksal Bostan, Mine (2020-02-10)
The aim of the current study was to investigate the statistical literacy of seventh grade students regarding the concepts of average and variation on bar and line graphs presented in alternative real-life contexts. To this end, the statistical literacy levels of the seventh grade students were initially determined. Subsequently, definitions, interpretations and evaluations generated by the students at varying levels of statistical literacy were examined in further depth. More specifically, a qualitative sur...
Citation Formats
Z. Akşit, “Validating aspects of a reading test,” Ph.D. - Doctoral Program, Middle East Technical University, 2018.