Evaluating the effectiveness of an online standardization platform for english as a foreign language (EFL) oral examiners

Download

index.pdf

Date

2019

Author

Yıldız, Gökhan

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

194
views

129
downloads

This study aimed to evaluate the effectiveness of an online standardization platform prior to speaking exams at a foundation university in Ankara. The study was conducted in December 2018 and twenty-four instructors of English participated in the study. This study investigated how consistent instructors were in face-to-face and online standardization groups in grading ten sample oral exams within their groups. Intraclass Correlation Coefficient (ICC) analysis was conducted for both groups. The results demonstrated that online and face-to-face standardization groups scored ten sample exams consistently with excellent agreement values (ICC > .90). This study also aimed to find out whether there was a significant difference between the scores of oral exams given by the raters trained in a face-to-face standardization training and the ones trained on an online standardization platform. The results of the study showed that there was no significant difference considering the abovementioned condition. Another objective of the study was to see whether there was an agreement (consistency) between instructors in the official oral examination of the school. The Kappa statistics suggested that the majority of pairs in the official examination scored students consistently with a substantial agreement value (K > .60). In addition, semi-structured interviews with the instructors from both mediums revealed that instructors appreciated the content of the training to a great extent. Instructors in the online standardization platform reported their positive feelings about the platform such as instructional design, layout and practicality of the platform, and the flexibility of time and place.

Subject Keywords

Computer-assisted instruction., Online Standardization, Standardizing Speaking Exams, Teacher Professional Development, Inter-rater Reliability (Agreement), Testing Speaking.

URI

http://etd.lib.metu.edu.tr/upload/12623640/index.pdf
https://hdl.handle.net/11511/43996

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

Evaluation of an english language teaching program at A Public University using CIPP model Tunç, Ferda; Engin Demir, Cennet; Department of Educational Sciences (2010) This study aimed to evaluate the effectiveness of Ankara University Preparatory School program through the perspectives of instructors and students. To this end, the CIPP (context, input, process, and product) evaluation model developed by Stufflebeam (1971) was utilized. 406 students attending the preparatory school in the 2008-2009 academic year and 12 instructors teaching in the program participated in the study. The data were gathered through a self-reported student questionnaire and an interview schedu...
Investigation of the effect of student and school background variables, teaching and learning variables and non-cognitive outcomes on the components of scientific literacy in programme for international student assessment (PISA 2015) Orhan, Burcu; Geban, Ömer; Department of Secondary Science and Mathematics Education (2020-9) This study aims to explore science-related student and school factors and their effects on 15-year-old Turkish students’ scientific literacy skills by using the data from Programme for International Student Assessment (PISA 2015). PISA 2015 was implemented with the participation of 187 schools and 5895 students from Turkey. Student-level variables of the study are out-of-school study time for science, science activities, science self-efficacy, interest in broad science topics, enjoyment of science, instrume...
Proctored vs Unproctored Online Exams in Language Courses: A Comparative Study Celikbag, Mehmet Ali; Delialioğlu, Ömer (2021-01-01) This study investigates online exams of online language courses at a distance education center of a public university in Turkey. Causal comparative research design was followed to examine issues in online language courses with the aim to better develop online exams. Participants were 105 students from spring semester of 2019 and 116 students from spring semester of 2020 from six different programs at associate degree level at a public university. The overall findings indicated that there were varied results...
Analysis of the Problem Based Learning Implementations Students and Tutors Perceptions and Actions Ateş, Özlem; Eryılmaz, Ali (2015-03-01) This study aims to analyze the implementation of problem-based learning (PBL) in engineering education regarding perceptions and actions of tutors and students. A case study design was employed in this study. To this end, four tutors, their five PBL modules, and fourteen students were selected. Observations and interviews were used to collect qualitative data. The results indicated that there was a difference between participants’ perception of PBL and their actions during tutorials. Participants’ level of ...
Transition to higher education examination outcomes: Does high school matter? Yanık İlhan, Bengi; Öz, Sumru (Orta Doğu Teknik Üniversitesi (Ankara, Turkey), 2014-8) This paper estimates the impact of school quality on the transition to higher education examination (abbreviated as YGS in Turkey) outcomes by controlling for the student quality. Either the class size or the teacher-pupil ratio in main branches is used as a proxy for the quality of schools. Due to data limitations we concentrate on the Anatolian High Schools (AHS) in Istanbul. This choice gives us the opportunity to control for the student quality by making use of the minimum OKS score required for admissi...

Citation Formats

G. Yıldız, “Evaluating the effectiveness of an online standardization platform for english as a foreign language (EFL) oral examiners,” Thesis (M.S.) -- Graduate School of Natural and Applied Sciences. Computer Education and Instructional Technology., Middle East Technical University, 2019.