An investigation of the validity and reliability of the speaking exam at a Turkish university

Download
2008
Sak, Gonca
This thesis aims to investigate the validity and reliability of the speaking exam at a Turkish University. For this study, data were obtained through questionnaires, interviews, the students’ speaking exam results, TOEFL exam results and departmental speaking exam scores. The results of the questionnaire were used to explore the face validity of the speaking exam. The interviews conducted to examine the content validity of the exam were analyzed in detail and common points from each interview were highlighted. To determine the predictive validity of the exam, Pearson Product Moment Correlation Coefficient and Simple Linear Regression Analysis were conducted. Furthermore, to investigate the construct validity of the exam correlation coefficients between speaking test scores and TOEFL subtest scores were calculated. To estimate the intra and inter-rater reliability level of the exam, correlation coefficients were calculated as well. The analysis of the results of the questionnaire indicated that the exam has satisfactory face validity. Moreover, the results of the interviews showed that the exam possesses the quality of content validity to a moderately high degree. It was found out that the speaking exam given in preparatory year education does not seem to predict the performances of the students in the departmental speaking exam. Moreover, the statistical analyses done to investigate the construct validity of the exam indicated that there are very low correlations between the speaking exam scores and the other subtests. It was discovered that the inter-rater reliability of the exam was not as satisfactory as it was expected as the inter-rater reliability of one pair was found relatively low. However, the speaking exam seemed to have satisfactory intra-rater reliability.

Suggestions

Key Experiences in Becoming an Independent Mathematics Education Researcher
Haser, Çiğdem (Springer Science and Business Media LLC, 2018-03-01)
The key experiences in becoming an independent mathematics education researcher were investigated through interviews with eight doctoral students with academic job intentions at a Turkish university. Findings showed that doctoral students conceptualized a mathematics education researcher with several types of knowledge, skills, and attitudes, including research methods, mathematics, critical thinking, and being ethical and patient. They felt like a researcher when they collected and analyzed data at a resea...
Communication in an academic context
Gizir, S; Simsek, H (Springer Science and Business Media LLC, 2005-09-01)
The purpose of this qualitative case study is to investigate the most common communication problems from the views of faculty members at the Middle East Technical University in Ankara, Turkey. The sample of this study consists of 50 faculty members including professors, associate professors, assistant professors, and instructors from five largest departments representing five colleges at the Middle East Technical University. The data were gathered by utilizing interview method, including 19 interview questi...
The Views of Undergraduate Students and Academic Advisors on the Academic Advising Process
Çapa Aydın, Yeşim; Eret, Esra (2019-08-01)
The current study investigated the views of both students and academic advisors regarding the academic advising in a state university in Ankara. The study utilized survey and correlational research design methods. The data were collected from 840 undergraduate students and 130 advisors through an online survey, and were analyzed using descriptive and inferential statistics. The findings indicated that the advisors and their students met once or twice during an academic semester, mostly to talk about issues ...
The views of undergraduatestudents and academic advisors on the academic advising process
Çapa Aydın, Yeşim; Güneri, Oya; Eret, Esra; Barutçu Yıldırım, Kadriye Funda (2020-08-01)
The current study investigated the views of both students and academic advisors regarding the academic advising in a state university in Ankara. The study utilized survey and correlational research design methods. The data were collected from 840 undergraduate students and 130 advisors through an online survey, and were analyzed using descriptive and inferential statistics. The findings indicated that the advisors and their students met once or twice during an academic semester, mostly to talk about issues ...
Evaluation of an english language teaching program at A Public University using CIPP model
Tunç, Ferda; Engin Demir, Cennet; Department of Educational Sciences (2010)
This study aimed to evaluate the effectiveness of Ankara University Preparatory School program through the perspectives of instructors and students. To this end, the CIPP (context, input, process, and product) evaluation model developed by Stufflebeam (1971) was utilized. 406 students attending the preparatory school in the 2008-2009 academic year and 12 instructors teaching in the program participated in the study. The data were gathered through a self-reported student questionnaire and an interview schedu...
Citation Formats
G. Sak, “An investigation of the validity and reliability of the speaking exam at a Turkish university,” M.A. - Master of Arts, Middle East Technical University, 2008.