Effects of different computerized adaptive testing strategies on recovery of ability

Download

index.pdf

Date

2011

Author

Kalender, İlker

Metadata

Show full item record

Item Usage Stats

319
views

161
downloads

The purpose of the present study is to compare ability estimations obtained from computerized adaptive testing (CAT) procedure with the paper and pencil test administration results of Student Selection Examination (SSE) science subtest considering different ability estimation methods and test termination rules. There are two phases in the present study. In the first phase, a post-hoc simulation was conducted to find out relationships between examinee ability levels estimated by CAT and paper and pencil test versions of the SSE. Maximum Likelihood Estimation and Expected A Posteriori were used as ability estimation method. Test termination rules were standard error threshold and fixed number of items. Second phase was actualized by implementing a CAT administration to a group of examinees to investigate performance of CAT administration in an environment other than simulated administration. Findings of post-hoc simulations indicated CAT could be implemented by using Expected A Posteriori estimation method with standard error threshold value of 0.30 or higher for SSE. Correlation between ability estimates obtained by CAT and real SSE was found to be 0.95. Mean of number of items given to examinees by CAT is 18.4. Correlation between live CAT and real SSE ability estimations was 0.74. Number of items used for CAT administration is approximately 50% of the items in paper and pencil SSE science subtest. Results indicated that CAT for SSE science subtest provided ability estimations with higher reliability with fewer items compared to paper and pencil format.

Subject Keywords

Computer adaptive testing.

URI

http://etd.lib.metu.edu.tr/upload/12613132/index.pdf
https://hdl.handle.net/11511/21135

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

Effects of Content Balancing and Item Selection Method on Ability Estimation in Computerized Adaptive Tests Sahin, Alper; ÖZBAŞI, DURMUŞ (2017-01-01) Purpose: This study aims to reveal effects of content balancing and item selection method on ability estimation in computerized adaptive tests by comparing Fisher's maximum information (FMI) and likelihood weighted information (LWI) methods. Research Methods: Four groups of examinees (250, 500, 750, 1000) and a bank of 500 items with 10 different content domains were generated through Monte Carlo simulations. Examinee ability was estimated by fixing all settings except for the item selection methods mention...
Effect of instruction supplied with the investigative-oriented laboratory approach on achievement in a science course Ertepinar, H; Geban, Ömer (Informa UK Limited, 1996-12-01) This study examines the differential effectiveness of the laboratory method based on the investigative approach and the worksheet study, both used as a supplement to the regular class work on achievement in science subject-matter. Subjects were 43 students (8th grade) enrolled in two science classes of a secondary school. Each teaching strategy was randomly assigned to one class. The experimental group utilized supplementary instruction through the investigative-oriented activities; the control group receiv...
Effects of Combined Peer-Teacher Feedback on Second Language Writing Development Demirel, Elif; Enginarlar, Hüsnü (2016-10-01) This study attempts to test the effectiveness of a feedback model which combines teacher and peer feedback systematically on improving students' writing ability in the context of a multiple draft writing course. 57 Turkish EFL students participated in the study which lasted for a 15-week semester. The experimental and control groups were provided different feedback treatments and then statistically compared in terms of the revisions they made in their essay drafts and their writing improvement. A total of 1...
EFFECTS OF COMPUTER-SIMULATIONS AND PROBLEM-SOLVING APPROACHES ON HIGH-SCHOOL-STUDENTS Geban, Ömer; Özkan, İlker (1992-09-01) The purpose of this study was to investigate the effects of the computer-simulated experiment (CSE) and the problem-solving approach on students' chemistry achievement, science process skills, and attitudes toward chemistry at the high school level. For this purpose, two experimental groups were compared, with the control group using the conventional approach. The sample consisted of 200 ninth-grade students. The treatment for all groups was carried out over 9 weeks. Four instruments were used in the study:...
The effect of testing accommodations on ninth grade sighted and blind students’ achievement about motion and some affective characteristics Öden Acar, Arzu; Eryılmaz, Ali; Department of Secondary Science and Mathematics Education (2021-8-26) The purpose of this study is revealing the problems of blind students in examinations and determining how testing accommodations affect sighted and blind students’ achievement and some affective characteristics. The study was designed with the transformative mixed method. In the qualitative phase, eight blind students in Bursa were interviewed. Considering the results of qualitative phase, quantitative phase was planned and conducted in three inclusive classrooms. Two of the classrooms were in Sakarya and o...

Citation Formats

İ. Kalender, “Effects of different computerized adaptive testing strategies on recovery of ability,” Ph.D. - Doctoral Program, Middle East Technical University, 2011.