Show/Hide Menu
Hide/Show Apps
Logout
Türkçe
Türkçe
Search
Search
Login
Login
OpenMETU
OpenMETU
About
About
Open Science Policy
Open Science Policy
Open Access Guideline
Open Access Guideline
Postgraduate Thesis Guideline
Postgraduate Thesis Guideline
Communities & Collections
Communities & Collections
Help
Help
Frequently Asked Questions
Frequently Asked Questions
Guides
Guides
Thesis submission
Thesis submission
MS without thesis term project submission
MS without thesis term project submission
Publication submission with DOI
Publication submission with DOI
Publication submission
Publication submission
Supporting Information
Supporting Information
General Information
General Information
Copyright, Embargo and License
Copyright, Embargo and License
Contact us
Contact us
Evaluating the effectiveness of an online standardization platform for english as a foreign language (EFL) oral examiners
Download
index.pdf
Date
2019
Author
Yıldız, Gökhan
Metadata
Show full item record
This work is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
.
Item Usage Stats
243
views
157
downloads
Cite This
This study aimed to evaluate the effectiveness of an online standardization platform prior to speaking exams at a foundation university in Ankara. The study was conducted in December 2018 and twenty-four instructors of English participated in the study. This study investigated how consistent instructors were in face-to-face and online standardization groups in grading ten sample oral exams within their groups. Intraclass Correlation Coefficient (ICC) analysis was conducted for both groups. The results demonstrated that online and face-to-face standardization groups scored ten sample exams consistently with excellent agreement values (ICC > .90). This study also aimed to find out whether there was a significant difference between the scores of oral exams given by the raters trained in a face-to-face standardization training and the ones trained on an online standardization platform. The results of the study showed that there was no significant difference considering the abovementioned condition. Another objective of the study was to see whether there was an agreement (consistency) between instructors in the official oral examination of the school. The Kappa statistics suggested that the majority of pairs in the official examination scored students consistently with a substantial agreement value (K > .60). In addition, semi-structured interviews with the instructors from both mediums revealed that instructors appreciated the content of the training to a great extent. Instructors in the online standardization platform reported their positive feelings about the platform such as instructional design, layout and practicality of the platform, and the flexibility of time and place.
Subject Keywords
Computer-assisted instruction.
,
Online Standardization
,
Standardizing Speaking Exams
,
Teacher Professional Development
,
Inter-rater Reliability (Agreement)
,
Testing Speaking.
URI
http://etd.lib.metu.edu.tr/upload/12623640/index.pdf
https://hdl.handle.net/11511/43996
Collections
Graduate School of Natural and Applied Sciences, Thesis
Suggestions
OpenMETU
Core
Evaluation of an english language teaching program at A Public University using CIPP model
Tunç, Ferda; Engin Demir, Cennet; Department of Educational Sciences (2010)
This study aimed to evaluate the effectiveness of Ankara University Preparatory School program through the perspectives of instructors and students. To this end, the CIPP (context, input, process, and product) evaluation model developed by Stufflebeam (1971) was utilized. 406 students attending the preparatory school in the 2008-2009 academic year and 12 instructors teaching in the program participated in the study. The data were gathered through a self-reported student questionnaire and an interview schedu...
Investigation of the effect of student and school background variables, teaching and learning variables and non-cognitive outcomes on the components of scientific literacy in programme for international student assessment (PISA 2015)
Orhan, Burcu; Geban, Ömer; Department of Secondary Science and Mathematics Education (2020-9)
This study aims to explore science-related student and school factors and their effects on 15-year-old Turkish students’ scientific literacy skills by using the data from Programme for International Student Assessment (PISA 2015). PISA 2015 was implemented with the participation of 187 schools and 5895 students from Turkey. Student-level variables of the study are out-of-school study time for science, science activities, science self-efficacy, interest in broad science topics, enjoyment of science, instrume...
Proctored vs Unproctored Online Exams in Language Courses: A Comparative Study
Celikbag, Mehmet Ali; Delialioğlu, Ömer (2021-01-01)
This study investigates online exams of online language courses at a distance education center of a public university in Turkey. Causal comparative research design was followed to examine issues in online language courses with the aim to better develop online exams. Participants were 105 students from spring semester of 2019 and 116 students from spring semester of 2020 from six different programs at associate degree level at a public university. The overall findings indicated that there were varied results...
Analysis of the Problem Based Learning Implementations Students and Tutors Perceptions and Actions
Ateş, Özlem; Eryılmaz, Ali (2015-03-01)
This study aims to analyze the implementation of problem-based learning (PBL) in engineering education regarding perceptions and actions of tutors and students. A case study design was employed in this study. To this end, four tutors, their five PBL modules, and fourteen students were selected. Observations and interviews were used to collect qualitative data. The results indicated that there was a difference between participants’ perception of PBL and their actions during tutorials. Participants’ level of ...
Transition to higher education examination outcomes: Does high school matter?
Yanık İlhan, Bengi; Öz, Sumru (Orta Doğu Teknik Üniversitesi (Ankara, Turkey), 2014-8)
This paper estimates the impact of school quality on the transition to higher education examination (abbreviated as YGS in Turkey) outcomes by controlling for the student quality. Either the class size or the teacher-pupil ratio in main branches is used as a proxy for the quality of schools. Due to data limitations we concentrate on the Anatolian High Schools (AHS) in Istanbul. This choice gives us the opportunity to control for the student quality by making use of the minimum OKS score required for admissi...
Citation Formats
IEEE
ACM
APA
CHICAGO
MLA
BibTeX
G. Yıldız, “Evaluating the effectiveness of an online standardization platform for english as a foreign language (EFL) oral examiners,” Thesis (M.S.) -- Graduate School of Natural and Applied Sciences. Computer Education and Instructional Technology., Middle East Technical University, 2019.
