A study of the predictive validity of the Başkent University English proficiency exam through the use of the two-parameter IRT model's ability estimates

Download
index.pdf
2003
Yapar, Taner
Show full item record
183
views
0
downloads
The purpose of this study is to analyze the predictive power of the ability estimates obtained through the two-parameter IRT model on the English Proficiency Exam administered at Baskent University in September 2001 (BUSPE 2001). As prerequisite analyses the fit of one- and two-parameter models of IRT were investigated. The data used for this study were the test data of all students (727) who took BUSPE 2001 and the departmental English course grades of the passing students. At the first stage, whether the assumptions of IRT were met was investigated. Next, the observed and theoretical distribution of the test data was reviewed by using chi square statistics. After that, the invariance of ability estimates across different sets of items and invariance of item parameters across different groups of students were examined. At the second stage, the predictive validity of BUSPE 2001 and its subtests was analyzed by using both classical test scores and ability estimates of the better fitting IRT model. The findings revealed that the test met the assumptions of unidimensionality, local independence and nonspeededness, the assumptions of equal discrimination indices was not met. Whether the assumption of minimal guessing was met remained vague. The chi square statistics indicated that only the two parameter model fitted the test data. The ability estimates were found to be invariant across different item sets and the item parameters were found to be invariant across different groups of students. The IRT estimated predictive validity outweighed the predictive validity calculated through classical total scores both for the whole test and its subtests. The reading subtest was the best predictor of future performance in departmental English courses among all subtests.
Item response theory, Educational tests and measurements, Psychological tests
http://etd.lib.metu.edu.tr/upload/1217629/index.pdf
https://hdl.handle.net/11511/13368
Graduate School of Social Sciences, Thesis

Suggestions

The preditive validity of Başkent University proficiency exam (BUEPE) through the use of the three-parameter IRT model's ability estimates
Yeğin, Oya Perim; Berberoğlu, Halil Giray; Department of Educational Sciences (2003)
The purpose of the present study is to investigate the predictive validity of the BUEPE through the use of the three-parameter IRT model̕s ability estimates. The study made use of the BUEPE September 2000 data which included the responses of 699 students. The predictive validity was established by using the departmental English courses (DEC) passing grades of a total number of 371 students. As for the prerequisite analysis the best fitted model of IRT was determined by first, checking the assumptions of IRT...
The analyses of secondary education institutions students selection and placement test's verbal section with respect to item response theory models
Can, Seda; Berberoğlu, Halil Giray; Department of Educational Sciences (2003)
The purpose of this study is to analyze the Verbal Section (Turkish and Social Sciences subtests) of MONE- Secondary Education Institutions Student Selection and Placement Exam by using Item Response Theory. The results of the MONE- Secondary Education Institutions Student Selection and Placement Exam, which was administered in 2001, were used as the data in the study. The sample included 5585 examinees composed of 2693 (48.2%) male and 2892 (51.8%) female examinees. First of all, whether the assumptions of...
A micro-analytic investigation into EFL teachers' language test item reviewing interactions
Can, Hümeyra; Hatipoğlu, Çiler; Department of English Language Teaching (2020-9)
This study brings an interactional perspective to the construction of syllabus-based language tests and the stage of item reviewing (IR) in particular by using Conversation Analysis (CA). Drawing on a corpus of video-recordings of IR sessions (25 hours) in an English preparatory school at a state university in Turkey, it investigates how EFL teachers review language test items prepared for their students in and through interaction with the item writer who is one of the teachers assigned in the testing offic...
The effects of problem solving approaches on students’ performance and self-regulated learning in mathematics
Polat, Zeynep Sonay; Bulut, Safure; Department of Secondary Science and Mathematics Education (2009)
The main purpose of this study was to investigate the effects of problem solving approaches on pre-service elementary teachers’ basic mathematics achievement, problem- solving performance and their self regulated learning. The study was conducted as quasi - experimental design with 110 elementary school pre-service teachers at a public university in Central Anatolia Region in the 2007-2008 academic year during the second semester. The time duration of the study was 12 weeks. Experimental group was instructe...
A structural equation modeling study : factors related to mathematics and geometry achievement across grade levels
Gökçe, Semirhan; Berbeoğlu, Halil Giray; Department of Secondary Science and Mathematics Education (2005)
The factors related to mathematics and geometry achievement were modeled in this study. It was based on the data obtained from the Student Assessment Program carried out by Ministry of National Education. Mathematics achievement tests and student questionnaires of each grade were analyzed by using principal component analysis to obtain different dimensions that are expected to be related with student achievement. Before the principal component analysis, a content based evaluation of the content of the mathe...
Citation Formats
T. Yapar, “A study of the predictive validity of the Başkent University English proficiency exam through the use of the two-parameter IRT model’s ability estimates,” M.S. - Master of Science, Middle East Technical University, 2003.
METU IIS - Integrated Information Service open@metu.edu.tr