An investigation of the validity and reliability of the speaking exam at a Turkish university

Download
2008
Sak, Gonca
This thesis aims to investigate the validity and reliability of the speaking exam at a Turkish University. For this study, data were obtained through questionnaires, interviews, the students’ speaking exam results, TOEFL exam results and departmental speaking exam scores. The results of the questionnaire were used to explore the face validity of the speaking exam. The interviews conducted to examine the content validity of the exam were analyzed in detail and common points from each interview were highlighted. To determine the predictive validity of the exam, Pearson Product Moment Correlation Coefficient and Simple Linear Regression Analysis were conducted. Furthermore, to investigate the construct validity of the exam correlation coefficients between speaking test scores and TOEFL subtest scores were calculated. To estimate the intra and inter-rater reliability level of the exam, correlation coefficients were calculated as well. The analysis of the results of the questionnaire indicated that the exam has satisfactory face validity. Moreover, the results of the interviews showed that the exam possesses the quality of content validity to a moderately high degree. It was found out that the speaking exam given in preparatory year education does not seem to predict the performances of the students in the departmental speaking exam. Moreover, the statistical analyses done to investigate the construct validity of the exam indicated that there are very low correlations between the speaking exam scores and the other subtests. It was discovered that the inter-rater reliability of the exam was not as satisfactory as it was expected as the inter-rater reliability of one pair was found relatively low. However, the speaking exam seemed to have satisfactory intra-rater reliability.

Suggestions

Exploring technology integration approaches and practices of preservice and in-service english language teachers
Akcaoğlu, Mete; Eröz Tuğa, Betil; Department of English Literature (2008)
In this study, three aspects of technology integration in English Language Teaching within the context of private universities in Ankara, Turkey were investigated. Firstly, preservice and in-service teachers’ computer usage frequencies/types, computer competence levels, perceived barriers to technology integration and attitudes toward computers were explored. Then, factors (age, gender, work experience, institutional factors being preservice or in-service) that might potentially affect the findings of the f...
Professional development and competence profiles of English language teacher educators in Turkey
Ataş, Ufuk; Daloğlu, Ayşegül; Department of English Language Teaching (2018)
This study aims to investigate the definition, competence, and professional development profiles of English language teacher educators in Turkey. With this general aim, this study looks into three components; definitions, competences, and professional development of teacher educators. It specifically focuses on how the profession of teacher educator is defined, what professional characteristics and personality traits teacher educators need to have, and what roles and responsibilities university-based teache...
Receptive multilingualism in Turkish-Turkmen academic counseling sessions
Sağın Şimşek, Sultan Çiğdem (2014-04-01)
This study examines a case of receptive multilingual communication in academic counseling sessions with participants of Turkish and Turkmen languages. In particular, the study aims to explore the contribution of linguistic and extralinguistic factors that might facilitate and/or constraint interlocutors' understanding in receptive multilingual communications. To this end, elicited conversations of a Turkish academic advisor and a Turkmen university student were video recorded and analyzed. The analysis show...
Investigating perceived competences of english language teachers in Turkey with regard to educational background and experience
Taner, Gülden; Seferoğlu, Gölge; Department of English Language Teaching (2017)
This survey study reports on the perceived competence levels of teachers of English working at state schools in Turkey with respect to their background, and proposes a new competence framework that meets international standards and matches local definitions. For this, European Profiling Grid (EPG) was translated into Turkish through a team-translation project, and adapted to Turkish context through teacher interviews. This adapted framework was used as part of the Language Teacher Competences Survey, which ...
An investigation on stress factors and coping strtegies of english instructors at the English Preparatory Schools of Metu and Ankara University
Petek, Elçin; Yemenici, Petek; Department of English Literature (2008)
The study aimed at investigation the sources of stress that english instructors who work at the English Preparatory Schools of the Middle East Technical University and Ankara University experience and the strategies that they use to cope with stress related to their professions. Two scales which consist of a demographic inventory, two questionnaires and a semi structured interwiew were developed by the researces the first scale is "stress factors and coping strategies questionnaire for english instructors" ...
Citation Formats
G. Sak, “An investigation of the validity and reliability of the speaking exam at a Turkish university,” M.A. - Master of Arts, Middle East Technical University, 2008.