Construct validity and factor structure of student selection examination across subgroups

Download
2010
Arıkan, Serkan
In developing countries, there is a great demand for university education. In order to select students to universities a standardized test score is used. In Turkey, the Student Selection Test (SST) have important role in admission to universities. However, there is very limited knowledge about what SST mathematics sections actually measures. The main purpose of the present study is to evaluate the content of the mathematics subtest of the SST in line with mathematical cognitive skills and eventually provide construct related evidence for dimensionality of the test items. Within this framework, it is aimed to cross validate the mathematics subtest across gender groups, school types and two consecutive years. Also relations among mathematical abilities are investigated. This study is first in investigating what is measured by SST Mathematics sections and analyzing construct validity by testing several nested confirmatory factor models. Comparison of fit indices of five competitive models showed three-factor model has better fit indices in which Basic Computation Ability, Advanced Computation Ability and Geometry Ability is measured. It is concluded that problem solving items are not measuring a different process, but measures some sort of computation ability. There is a problem related to the content of the mathematics subtests of the SST in line with mathematical cognitive skills. Higher order cognitive skills are not measured properly. Three-factor model is tested about the invariance of the factors across gender, school types and years. It is concluded that invariant factor structure indicates that SST mathematics section is operating similarly for subgroups and years. The relations among mathematical abilities on three-factor model are investigated by item mapping and structural equation models. It is seen that Basic Computation Ability is a prerequisite to acquire Geometry Ability and Advanced Computation Ability.

Suggestions

Psychometric evaluation of entry assessment in higher education: A case study
Berberoglu, G; Dochy, FJRC; Moerkerke, G (Springer Science and Business Media LLC, 1996-03-01)
Entry assessment for higher education is a managerial and research topic in many European countries at this moment. Due to the increased claim for higher quality in education and the decreasing finances, universities seek for means to establish a high quality instream. Research has shown that types of entry examinations good possibilities to put ''the right man on the right place''. Not only the quality of these examinations is an important issue, also systematic differences between student groups is a main...
CURRICULAR POLICYMAKING PROCESS IN TÜRKİYE: PERCEPTIONS OF TEACHERS, ACADEMICIANS AND GOVERNMENT OFFICIALS
Baştürk, Mustafa; Akar, Hanife; Department of Curriculum and Instruction (2022-10)
One of the prerequisites for improving the quality of school education is to have high-quality education policies. In this context, scientific information from stakeholders on curricular policies can contribute to improving the calibre of educational policies. In line with this understanding, this study aimed to investigate the perceptions of three significant stakeholder groups – teachers, academicians and related government officials – regarding the curricular policymaking processes in Türkiye. This qual...
Instructional technology adoption od medical school faculty in teaching and learning : faculty characteristics and differentiating factors in adaptor categories
Zayim, Neşe; Yıldırım, İbrahim Soner; Department of Computer Education and Instructional Technology (2004)
Despite large investment by higher education institutions in technology for faculty and student use, instructional technology is not being integrated into instructions in the higher education institutions including medical education institutions. While diffusion of instructional technologies has been reached a saturation pint with early adopters of technology, it has remained limited among mainstream faculty. This investigation explored instructional technology patterns and characteristics of medical school...
The Students' perceptions about e-learning in ahigher education institution in Turkey
Selman, Abdullah; Özkan Yıldırım, Sevgi; Özden, Yaşar; Department of Information Systems (2013)
E-learning is one of the common education types in Turkey elsewhere in the world because it has been a necessity for higher and continuous education of people but what about its quality? There are a diverse number of factors which affect the quality of e-learning education but one of the most important factors is the student. Because students are at the center of education and all of the teaching-learning operations are performed for them, their impressions are very important to gain idea about the quality ...
The differential item functioning(dif) analysis of mathematics items in the international assessment programs
Yıldırım, Hüseyin Hüsnü; Berberoğlu, Halil Giray; Department of Secondary Science and Mathematics Education (2006)
Cross-cultural studies, like TIMSS and PISA 2003, are being conducted since 1960s with an idea that these assessments can provide a broad perspective for evaluating and improving education. In addition countries can assess their relative positions in mathematics achievement among their competitors in the global world. However, because of the different cultural and language settings of different countries, these international tests may not be functioning as expected across all the countries. Thus, tests may ...
Citation Formats
S. Arıkan, “Construct validity and factor structure of student selection examination across subgroups,” Ph.D. - Doctoral Program, Middle East Technical University, 2010.