Validating aspects of a reading test

Download
2018
Akşit, Zeynep
This study investigated three aspects of validity (i.e., context, cognitive and scoring) of a reading test: First, the reading test construct was defined based on the cognitive processing model and its criterial features were presented in the test specifications. Secondly, to establish cognitive validity, the cognitive processes that were activated during test taking were investigated through retrospective and introspective verbal data. The results revealed whether the test elicited behavior reflective of reading activities beyond the testing situation. Finally, the scoring validity of the test was examined through item analysis. The findings revealed that the performances were generalizable: the tasks elicited behavior similar to those in real-life reading, and that the criterial parameters of the test were at an acceptable level for the intended population. Moreover, the majority of the item parameters were within the expected ranges. This study and its findings have important implications. At the organizational level, the results have implications for improvement in testing practice: the sociocognitive framework provides a systematic approach and encourages the generation of evidence for validity at all stages of test development. Moreover, test scores that reliably reflect test takers’ ability on relevant aspects of reading help improve reading instruction. Instruction that is grounded in theory and supported with established needs can help students be equipped with skills required for successful academic reading. Implications at the theoretical level are: The cognitive processing reading model, which was originally based on L1 reading, successfully defines L2 academic reading within the context of this study

Suggestions

Assessing a model of cognitive test anxiety: the role of rumination, self-forgiveness, perfectionism cognitions, and cognitive defusion through the indirect effect of psychological flexibility
Aydın, Gökçen; Güneri, Oya; Department of Educational Sciences (2017)
The aim of this study was to test a model investigating the role of rumination, self-forgiveness, perfectionism cognitions, and cognitive defusion in predicting cognitive test anxiety through the indirect effect of psychological flexibility. The sample included 715 (351 females and 364 males) students from a state university in Turkey. The data collection instruments used in the study were Demographic Information Form, Cognitive Test Anxiety Scale-Revised, State Self-Forgiveness Scale, Perfectionism Cogniti...
Hybrid statistical and machine learning modeling of cognitive neuroscience data
Çakar, Serenay; Gökalp Yavuz, Fulya (2023-01-01)
The nested data structure is prevalent for cognitive measure experiments due to repeatedly taken observations from different brain locations within subjects. The analysis methods used for this data type should consider the dependency structure among the repeated measurements. However, the dependency assumption is mainly ignored in the cognitive neuroscience data analysis literature. We consider both statistical, and machine learning methods extended to repeated data analysis and compare distinct algorithms ...
A philosophical analysis of computational modeling in cognitive science
Ürgen, Burcu Ayşen; Bağçe, Samet; Department of Cognitive Sciences (2007)
This study analyses the methodology of computational cognitive modeling as one of the ways of conducting research in cognitive science. The aim of the study is to provide an understanding of the place of computational cognitive models in understanding human cognition. Considering the vast number of computational cognitive models which have been just given to account for some cognitive phenomenon by solely simulating some experimental study and fitting to empirical data, a practice-oriented approach is adopt...
Investigation of Students’ Cognitive Processes in Computer Programming: A Cognitive Ethnography Study
Doğan, Sibel; Aslan, Orhan; Yıldırım, İbrahim Soner (2019-01-01)
The aim of the current study is to investigate how cognitive processes of students categorized as novice, semi-expert and expert differ in terms of creating pseudocode for a given programming task. To conduct this aim, cognitive ethnography research design was employed to reveal the cognitive process of the participants behind the specified task. In the study, three undergraduate students from a Computer Education and Instructional Technology (CEIT) department were included as participants. These students w...
Performance tests of a novel electroencephalographic data-acquisition system
Usakli, Ali Bulent; Gençer, Nevzat Güneri (2007-02-16)
The aim of the this study is to present some performance tests of a novel 256-channel electroencephalographic data-acquisition system. The common mode rejection ratio of the system was measured as 102 dB for signals in the electroencephalography frequency range and 154 dB for de signals. System electrical noise (referred-to-input) is 1.76 mu V (rms) (0.21 mu V/root Hz for 70-Hz bandwidth). The cross-talk rejection was found to be at 58 dB. The dynamic range of the system was found 108 dB. The performance te...
Citation Formats
Z. Akşit, “Validating aspects of a reading test,” Ph.D. - Doctoral Program, Middle East Technical University, 2018.