The preditive validity of Başkent University proficiency exam (BUEPE) through the use of the three-parameter IRT model's ability estimates

Download

index.pdf

Date

2003

Author

Yeğin, Oya Perim

Metadata

Show full item record

Item Usage Stats

208
views

0
downloads

The purpose of the present study is to investigate the predictive validity of the BUEPE through the use of the three-parameter IRT model̕s ability estimates. The study made use of the BUEPE September 2000 data which included the responses of 699 students. The predictive validity was established by using the departmental English courses (DEC) passing grades of a total number of 371 students. As for the prerequisite analysis the best fitted model of IRT was determined by first, checking the assumptions of IRT; second, by analyzing the invariance of ability parameters and item parameters and thirdly, by interpreting the chi-square statistics. After the prerequisite analyses, the best fitted model̕s estimates were correlated with DEC passing grades to investigate the predictive power of BUEPE on DEC passing grades. The findings indicated that the minimal guessing assumption of the one- and two-parameter models was not met. In addition, the chi-square statistics indicated a better fit to the three-parameter model. Therefore, it was concluded that the best fitted model was the three-parameter model. The findings of the predictive validity analyses revealed that the best predictors for DEC passing grades were the three-parameter model ability estimates. The second best predictor was the ability estimates obtained from sixty high information items. In the third place BUEPE total scores and the total scores obtained from sixty high information items followed with nearly the same correlation coefficients. Among the three sub-tests, the reading sub-test was found to be the best predictor of DEC passing grades.

Subject Keywords

Item response theory, Educational tests and measurements, Ability, Predictive validity, Item characteristic curves, Parameter estimates, Başkent University English Proficiency Exam

URI

http://etd.lib.metu.edu.tr/upload/1013507/index.pdf
https://hdl.handle.net/11511/13367

Collections

Graduate School of Social Sciences, Thesis

Suggestions

OpenMETU
Core

A study of the predictive validity of the Başkent University English proficiency exam through the use of the two-parameter IRT model's ability estimates Yapar, Taner; Berberoğlu, Halil Giray; Department of Educational Sciences (2003) The purpose of this study is to analyze the predictive power of the ability estimates obtained through the two-parameter IRT model on the English Proficiency Exam administered at Baskent University in September 2001 (BUSPE 2001). As prerequisite analyses the fit of one- and two-parameter models of IRT were investigated. The data used for this study were the test data of all students (727) who took BUSPE 2001 and the departmental English course grades of the passing students. At the first stage, whether the ...
The Effects of Test Length and Sample Size on Item Parameters in Item Response Theory Sahin, Alper; ANIL, DUYGU (2017-02-01) This study investigates the effects of sample size and test length on item-parameter estimation in test development utilizing three unidimensional dichotomous models of item response theory (IRT). For this purpose, a real language test comprised of 50 items was administered to 6,288 students. Data from this test was used to obtain data sets of three test lengths (10, 20, and 30 items) and nine different sample sizes (150, 250, 350, 500, 750, 1,000, 2,000, 3,000 and 5,000 examinees). These data sets were the...
The relationship between ideal L2 self, achievement attributions and L2 achievement / Çağatay, Sibel (2020-12-01) This study examines whether learners’ (high vs. low) ‘ideal L2 self’ exerts an effect on causal attributions and which of these causal attributions could predict future L2 achievement. To this end, 1006 EFL students were invited from a state university in Ankara, Turkey. The data were collected with an attribution scale composed of 29 questions and with a questionnaire containing 10 items measuring learners’ ideal L2 self. The researchers also collected the students’ achievement scores to measure the predic...
Validation of the mathematical knowledge for teaching statistics instrument Mercimek, Oktay; Erbaş, Ayhan Kürşat (2017-01-01) The purpose of this study is to assess preserviceteachers’ mathematical knowledge forteaching statistics (MKT-S) and identify the relationship between the components of this knowledge. For this purpose, MKT-S instrument consisting of two dimensions, ‘content knowledge’ (CK) and ‘pedagogical content knowledge’ (PCK) was developed, and applied to659 preservice middle school mathematics teachers (PTs). Confirmatory factor analysis showed that CK and PCK are two different dimensions of mathematical knowledge of...
The analyses of secondary education institutions students selection and placement test's verbal section with respect to item response theory models Can, Seda; Berberoğlu, Halil Giray; Department of Educational Sciences (2003) The purpose of this study is to analyze the Verbal Section (Turkish and Social Sciences subtests) of MONE- Secondary Education Institutions Student Selection and Placement Exam by using Item Response Theory. The results of the MONE- Secondary Education Institutions Student Selection and Placement Exam, which was administered in 2001, were used as the data in the study. The sample included 5585 examinees composed of 2693 (48.2%) male and 2892 (51.8%) female examinees. First of all, whether the assumptions of...

Citation Formats

O. P. Yeğin, “The preditive validity of Başkent University proficiency exam (BUEPE) through the use of the three-parameter IRT model’s ability estimates,” M.S. - Master of Science, Middle East Technical University, 2003.