An investigation of the validity and reliability of the speaking exam at a Turkish university

Download
2008
Sak, Gonca
This thesis aims to investigate the validity and reliability of the speaking exam at a Turkish University. For this study, data were obtained through questionnaires, interviews, the students’ speaking exam results, TOEFL exam results and departmental speaking exam scores. The results of the questionnaire were used to explore the face validity of the speaking exam. The interviews conducted to examine the content validity of the exam were analyzed in detail and common points from each interview were highlighted. To determine the predictive validity of the exam, Pearson Product Moment Correlation Coefficient and Simple Linear Regression Analysis were conducted. Furthermore, to investigate the construct validity of the exam correlation coefficients between speaking test scores and TOEFL subtest scores were calculated. To estimate the intra and inter-rater reliability level of the exam, correlation coefficients were calculated as well. The analysis of the results of the questionnaire indicated that the exam has satisfactory face validity. Moreover, the results of the interviews showed that the exam possesses the quality of content validity to a moderately high degree. It was found out that the speaking exam given in preparatory year education does not seem to predict the performances of the students in the departmental speaking exam. Moreover, the statistical analyses done to investigate the construct validity of the exam indicated that there are very low correlations between the speaking exam scores and the other subtests. It was discovered that the inter-rater reliability of the exam was not as satisfactory as it was expected as the inter-rater reliability of one pair was found relatively low. However, the speaking exam seemed to have satisfactory intra-rater reliability.

Suggestions

Professional development and competence profiles of English language teacher educators in Turkey
Ataş, Ufuk; Daloğlu, Ayşegül; Department of English Language Teaching (2018)
This study aims to investigate the definition, competence, and professional development profiles of English language teacher educators in Turkey. With this general aim, this study looks into three components; definitions, competences, and professional development of teacher educators. It specifically focuses on how the profession of teacher educator is defined, what professional characteristics and personality traits teacher educators need to have, and what roles and responsibilities university-based teache...
Exploring technology integration approaches and practices of preservice and in-service english language teachers
Akcaoğlu, Mete; Eröz Tuğa, Betil; Department of English Literature (2008)
In this study, three aspects of technology integration in English Language Teaching within the context of private universities in Ankara, Turkey were investigated. Firstly, preservice and in-service teachers’ computer usage frequencies/types, computer competence levels, perceived barriers to technology integration and attitudes toward computers were explored. Then, factors (age, gender, work experience, institutional factors being preservice or in-service) that might potentially affect the findings of the f...
Receptive multilingualism in Turkish-Turkmen academic counseling sessions
Sağın Şimşek, Sultan Çiğdem (2014-04-01)
This study examines a case of receptive multilingual communication in academic counseling sessions with participants of Turkish and Turkmen languages. In particular, the study aims to explore the contribution of linguistic and extralinguistic factors that might facilitate and/or constraint interlocutors' understanding in receptive multilingual communications. To this end, elicited conversations of a Turkish academic advisor and a Turkmen university student were video recorded and analyzed. The analysis show...
An Analysis of the needs and perceptions of english language teachers and students in an EAP course
Demir, Müslüme; Eröz Tuğa, Betil; Department of English Language Teaching (2015)
The purpose of this study is to investigate the perceptions and needs of English language teachers and students pertaining to an EAP course -Professional Communication Skills (PCS 406)- and propose an In-Service Teacher Training Module for EFL teachers working in the Foreign Languages Unit at a private university in Ankara. Hence, a case study was designed to investigate the needs of the stakeholders: the learners, teachers and principal. The study undertook a multifaceted needs analysis including questionn...
Investigating perceived competences of english language teachers in Turkey with regard to educational background and experience
Taner, Gülden; Seferoğlu, Gölge; Department of English Language Teaching (2017)
This survey study reports on the perceived competence levels of teachers of English working at state schools in Turkey with respect to their background, and proposes a new competence framework that meets international standards and matches local definitions. For this, European Profiling Grid (EPG) was translated into Turkish through a team-translation project, and adapted to Turkish context through teacher interviews. This adapted framework was used as part of the Language Teacher Competences Survey, which ...
Citation Formats
G. Sak, “An investigation of the validity and reliability of the speaking exam at a Turkish university,” M.A. - Master of Arts, Middle East Technical University, 2008.