Rethinking the assessment of the quality of teacher refection by validating an innovative vignette‑based instrument and an analytic coding scheme

Yilmaz, Elanur
Akar, Hanife
This study introduces the development of a new, transferable, customizable, authentic, and analytic framework for addressing different dimensions of teacher reflection. Given the emphasis on teacher reflection as a socially situated practice spawned by cognitive and affective aspects, this study covers four dimensions (i.e., breadth, depth, dialog, and affectivity). Ultimately and importantly, this empirical study constructs and validates an innovative vignette-based instrument and its analytic coding scheme on the basis of this framework for assessing the quality of reflection of elementary science teachers. The instrument includes eight vignettes, which include various authentic science teaching contexts, followed by three open-ended questions for each vignette to prompt teacher reflection on (1) the issues raised in the vignette, (2) the actions that could be taken to solve the problems, and (3) teacher emotions concerning the problems encountered. The instrument is validated through content, construct, internal, and face validity; and audit trial and inter-coder reliability are used to ensure the reliability of the data and findings. In summary, the study recruits 81 elementary science teachers from 24 public elementary schools in urban and suburban schools in Ankara for two reasons: (1) to ensure that the vignettes are clear and authentic as intended and (2) to develop a coding scheme involving descriptions and indicators of behaviors for each dimension of reflection quality accordingly to assess the quality of teacher reflection. For data analysis, once statistical conclusion validity and inter-coder reliability are established and a high percentage of agreement is obtained for each dimension across all vignettes (a > 0.70), content validity is once again explored by assessing whether the guiding framework of the instrument capture teacher reflections. The results indicate that the instrument can be an effective tool for assessing the quality of reflection of elementary science teachers. The preliminary validity and reliability of the vignettes and the coding scheme suggest that the vignettes warrant further testing.


The Comparative Effects of Prediction/Discussion-Based Learning Cycle, Conceptual Change Text, and Traditional Instructions on Student Understanding of Genetics
Yilmaz, Diba; Öztekin, Ceren; Sungur, Semra (Informa UK Limited, 2011-01-01)
The present study examined the comparative effects of a prediction/discussion-based learning cycle, conceptual change text (CCT), and traditional instructions on students' understanding of genetics concepts. A quasi-experimental research design of the pre-test-post-test non-equivalent control group was adopted. The three intact classes, taught by the same science teacher, were randomly assigned as prediction/discussion-based learning cycle class (N = 30), CCT class (N = 25), and traditional class (N = 26). ...
An inspection approach for conceptual models in notations derived from UML: A case study
Tanrioever, Oezeguer; Bilgen, Semih (2007-11-09)
This paper presents an overview of a proposed framework for improving the quality of conceptual models developed in notations derived from UML. To this aim, wellness properties of a UML model are described shortly. Through a case study, we show that an ad hoc inspection process in accordance with this framework can be defined and performed depending on the conceptual modeling notation and typical real models. This study showed us that the application of the defined inspection process, which adopts concepts ...
A conceptual model of relationships among constructivist learning environment perceptions, epistemological beliefs, and learning approaches
Özkal, Kudret; Öztekin, Ceren; Çakıroğlu, Jale; Sungur, Semra (2009-01-01)
This study proposed a conceptual model of relationships among constructivist learning environment perception variables (Personal Relevance, Uncertainty, Critical Voice, Shared Control. and Student Negotiation), scientific epistemological belief variables (fixed and tentative), and learning approach. It was proposed that learning environment perceptions predict learning approach directly and indirectly through scientific epistemological beliefs. Constructivist Learning Environment Survey, Scientific Epistemo...
The interplay between students’ understandings of proportional and functional relationships
Stephens, Ana; Strachota, Susanne; Knuth, Eric; Blanton, Maria; İşler Baykal, Işıl; Gardiner, Angela Murphy (Association of Mathematics Teacher Educators; 2017-10-08)
This research explores the interplay between students’ understandings of proportional and functional relationships. Approximately 90 students participated in an early algebra intervention in Grades 3– 5. Before the intervention and after each year of the intervention, we evaluated their understandings of proportional and functional relationships. Data revealed that among Grades 4 and 5 students who identified a correct function rule, a higher percentage were unsuccessful solving a proportional reasoning pro...
Extending the reach of the models and modelling perspective: a course-sized research site
Brady, Corey; Lesh, Richard; Sevinç, Şerife (null, 2015-01-01)
For over 30 years, researchers have engaged in inquiry within the Models and Modelling Perspective (MMP), taking as a fundamental principle that learners’ ideas develop in coherent conceptual systems called models. Under appropriate conditions, such as in Model Eliciting Activities (MEAs), this research has shown how learners’ models can grow through rapid cycles of development toward solutions involving creative mathematics. These externalized models, and other thought-revealing artifacts, can become rich ...
Citation Formats
E. Yilmaz and H. Akar, “Rethinking the assessment of the quality of teacher refection by validating an innovative vignette‑based instrument and an analytic coding scheme,” ASIA PACIFIC EDUCATION REVIEW, vol. 1, no. 1, pp. 1–18, 2022, Accessed: 00, 2022. [Online]. Available: