AI, Instructor, Observer, and Peer Feedback in Online Microteaching: A Multi-Rater Comparison Study

Authors

  • Veronika Vrábelová Constantine the Philosopher University in Nitra
  • Zuzana Sándorová Constantine the Philosopher University in Nitra
  • Zdena Kráľová Constantine the Philosopher University in Nitra
  • Elena Kováčiková Constantine the Philosopher University in Nitra

DOI:

https://doi.org/10.34190/ecel.25.1.5040

Keywords:

online microteaching, AI assessment, peer feedback, multi-rater comparison, EFL teacher education

Abstract

Feedback is central to the effectiveness of microteaching as a teacher training method, yet how different feedback sources compare when evaluating the same performance is an underdeveloped area. In online environments, peer feedback, instructor assessment, external observation, and AI-generated evaluation can all operate alongside one another. Understanding which sources produce meaningful and consistent judgements has practical consequences for teacher educators. This paper presents a case study conducted at Constantine the Philosopher University in Nitra, Slovakia, within a master's-level course on the Didactics of Distance Online Education. Students of the course each delivered an online microteaching session via Google Meet, incorporating at least one AI tool connected to their lesson objective. All sessions were recorded and re-analysed by an external observer. Five rater sources evaluated each microteaching against a shared four-criterion rubric: course peers, the course instructor, the external observer, and two AI models applied under three distinct evaluation conditions: isolated, sequential, and simultaneous. The study investigates how these rater sources compare in their assessments of the same teaching events and whether AI-generated feedback converges with trained human judgement depending on evaluation structure. Findings reveal differences between rater sources. Peer feedback shows a pattern of inflation and an inverse relationship with expert judgement, raising questions about its reliability as a standalone formative instrument. AI evaluation is highly sensitive to evaluation conditions. Isolated assessment produces variable and unreliable results. Sequential evaluation, in which all presenters are assessed in a single continuous conversation, converges closely with the judgements of trained human raters. This convergence was confirmed across both AI models tested. These findings have implications for feedback design in online teacher education. Rater source is as consequential as rubric design. Peer feedback requires pedagogical framing and should not function as a standalone assessment instrument. AI can serve as a supplementary tool when deployment conditions are understood in advance. Pedagogical expert judgement remains the validity benchmark against which any automated or peer-based system must be measured. The study contributes empirical data to a field where AI tools are being adopted faster than the research can evaluate them.

Author Biographies

Veronika Vrábelová, Constantine the Philosopher University in Nitra

The author is affiliated with the Constantine the Philosopher University in Nitra (CPU), Faculty of Education, where she is a PhD student at the Department of English Language and Literature. Her doctoral research centers on the implementation of Artificial Intelligence and technological innovations in EFL (English as a Foreign Language) teaching, with a particular focus on distance education. Her broader research interests include the interdisciplinary intersection of pedagogy and educational technology, as well as the pedagogical preparation of pre-service teachers.

Zuzana Sándorová, Constantine the Philosopher University in Nitra

Doc. Mgr. Zuzana Sándorová, PhD., is an Associate Professor at the Department of English Language and Culture, Faculty of Education, Constantine the Philosopher University in Nitra, where she teaches courses on intercultural competence, English for Specific Purposes, and distance language pedagogy. Her research focuses on intercultural communicative competence, EFL course-book design, and innovative teaching methods such as design thinking in tourism and language education, work reflected in numerous publications in journals indexed in Web of Science and Scopus, a monograph, and several textbooks. She has led and contributed to multiple national (KEGA, VEGA) and international (Erasmus+) research and mobility projects, with teaching and training experience across institutions in Europe, Asia, and beyond.

Zdena Kráľová, Constantine the Philosopher University in Nitra

Prof. PaedDr. Zdena Kráľová, PhD., is a Professor of Language Pedagogy at the Faculty of Education, Constantine the Philosopher University in Nitra, Slovakia, and also affiliated with the Faculty of Humanities, Tomas Bata University in Zlín, Czechia. Her research centers on foreign language phonetics and pronunciation, contrastive linguistics, and the psycho-emotional dimensions of language learning, including foreign language anxiety and, more recently, AI-based approaches to EFL pronunciation assessment. A prolific author of monographs, textbooks, and articles published in journals such as System, Frontiers in Psychology, and Sage Open, she has led numerous national and international research projects (KEGA, VEGA, Erasmus+) and serves as guarantor of the B.A., M.A., and Ph.D. programs at the Department of English Language and Culture, as well as reviewer for leading international journals in her field.

Elena Kováčiková, Constantine the Philosopher University in Nitra

Doc. Mgr. Elena Kováčiková, PhD., is an Associate Professor at the Department of English Language and Culture, Faculty of Education, Constantine the Philosopher University in Nitra, Slovakia. Her research and teaching focus on English teacher education, CLIL (Content and Language Integrated Learning) methodology, and teaching English for Specific Purposes, as reflected in her monograph English for Specific Purposes in Higher Education through Content and Language Integrated Learning and numerous publications in national and international journals. She has been actively involved in international projects such as the COST Action CLIL NetLE, and combines her academic work with practical teaching experience, having taught English at both university and primary school levels.

Downloads

Published

2026-10-07