The differential item functioning(dif) analysis of mathematics items in the international assessment programs

Download

index.pdf

Date

2006

Author

Yıldırım, Hüseyin Hüsnü

Metadata

Show full item record

Item Usage Stats

366
views

224
downloads

Cross-cultural studies, like TIMSS and PISA 2003, are being conducted since 1960s with an idea that these assessments can provide a broad perspective for evaluating and improving education. In addition countries can assess their relative positions in mathematics achievement among their competitors in the global world. However, because of the different cultural and language settings of different countries, these international tests may not be functioning as expected across all the countries. Thus, tests may not be equivalent, or fair, linguistically and culturally across the participating countries. In this conte! ! xt, the present study aimed at assessing the equivalence of mathematics items of TIMSS 1999 and PISA 2003 across cultures and languages, to fin! d out if mathematics achievement possesses any culture specifi! c aspect s. For this purpose, the present study assessed Turkish and English versions of TIMSS 1999 and PISA 2003 mathematics items with respect to, (a) psychometric characteristics of items, and (b) possible sources of Differential Item Functioning (DIF) between these two versions. The study used Restricted Factor Analysis, Mantel-Haenzsel Statistics and Item Response Theory Likelihood Ratio methodologies to determine DIF items. The results revealed that there were adaptation problems in both TIMSS and PISA studies. However it was still possible to determine a subtest of items functioning fairly between cultures, to form a basis for a cross-cultural comparison. In PISA, there was a high rate of agreement among the DIF methodologies used. However, in TIMSS, the agree! ment ra! te decreased considerably possibly because the rate o! f differ e! ntially functioning items within TIMSS was higher, and differential guessing and differential discriminating were also issues in the test. The study! also revealed that items requiring competencies of reproduction

Subject Keywords

Educational tests and measurements.

URI

http://etd.lib.metu.edu.tr/upload/12607135/index.pdf
https://hdl.handle.net/11511/15871

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

The effects of problem solving approaches on students’ performance and self-regulated learning in mathematics Polat, Zeynep Sonay; Bulut, Safure; Department of Secondary Science and Mathematics Education (2009) The main purpose of this study was to investigate the effects of problem solving approaches on pre-service elementary teachers’ basic mathematics achievement, problem- solving performance and their self regulated learning. The study was conducted as quasi - experimental design with 110 elementary school pre-service teachers at a public university in Central Anatolia Region in the 2007-2008 academic year during the second semester. The time duration of the study was 12 weeks. Experimental group was instructe...
Effect of conceptual change texts accompanied with analogies on promoting conceptual change in acid and base concepts Tamer, Püren İpek; Geban, Ömer; Department of Secondary Science and Mathematics Education (2006) This study was conducted to compare the effectiveness of conceptual change text oriented instruction accompanied with analogies over traditional instruction on tenth grade students’ understanding of the acid and base concepts and attitude toward science as a school subject. In addition, effect of the gender difference and science process skills on students’ understanding of acid and base concepts and effect of gender difference on students’ attitudes toward chemistry as a school subject were also investigat...
The analyses of secondary education institutions students selection and placement test's verbal section with respect to item response theory models Can, Seda; Berberoğlu, Halil Giray; Department of Educational Sciences (2003) The purpose of this study is to analyze the Verbal Section (Turkish and Social Sciences subtests) of MONE- Secondary Education Institutions Student Selection and Placement Exam by using Item Response Theory. The results of the MONE- Secondary Education Institutions Student Selection and Placement Exam, which was administered in 2001, were used as the data in the study. The sample included 5585 examinees composed of 2693 (48.2%) male and 2892 (51.8%) female examinees. First of all, whether the assumptions of...
University preparatory class EFL Students' attitudes towards electronic portfolios as a method of alternative assessment Yaşar, Engin; Enginarlar, Hüsnü; Department of English Language Teaching (2005) This study aims to investigate university preparatory class students̕ attitudes towards the assessment system by which they are evaluated and alternative assessment before and after the implementation of the electronic portfolio, their attitudes towards the electronic portfolio before and after keeping it for two months, their suggestions about improving the electronic portfolio and how keeping the electronic portfolio affects their computer literacy. For this purpose, 19 intermediate level EFL students in ...
Identifying factors that affect students' acceptance of web-based assessment tools within the context of higher education Alkış, Nurcan; Özkan Yıldırım, Sevgi; Department of Information Systems (2010) The main aim of this thesis study is to identify the factors that affect higher education students’ perceptions of computerized assessment for learning. This study additionally aims to help effective use of computers in assessment activities by guiding the teachers or educational organization by interpreting the factors that affect students’ attitudes toward computer use in examinations. Quantitative research design has been used in this study. When choosing the participants, nonprobability sampling strateg...

Citation Formats

H. H. Yıldırım, “The differential item functioning(dif) analysis of mathematics items in the international assessment programs,” Ph.D. - Doctoral Program, Middle East Technical University, 2006.