Evaluating the evaluators: A comparative study of AI and teacher assessments in Higher Education

Basit Öğe Kaydı
dc.contributor.authorCoskun, Tugra Karademir
dc.contributor.authorAlper, Ayfer
dc.date.accessioned2025-03-23T19:48:07Z
dc.date.available2025-03-23T19:48:07Z
dc.date.issued2024
dc.departmentSinop Üniversitesi
dc.description.abstractThis study aims to examine the potential differences between teacher evaluations and artificial intelligence (AI) tool-based assessment systems in university examinations. The research has evaluated a wide spectrum of exams including numerical and verbal course exams, exams with different assessment styles (project, test exam, traditional exam), and both theoretical and practical course exams. These exams were selected using a criterion sampling method and were analyzed using BlandAltman Analysis and Intraclass Correlation Coefficient (ICC) analyses to assess how AI and teacher evaluations performed across a broad range. The research findings indicate that while there is a high level of proficiency between the total exam scores assessed by artificial intelligence and teacher evaluations; medium consistency was found in the evaluation of visually based exams, low consistency in video exams, high consistency in test exams, and low consistency in traditional exams. This research is crucial as it helps to identify specific areas where artificial intelligence can either complement or needs improvement in educational assessment, guiding the development of more accurate and fair evaluation tools.
dc.identifier.endpage139
dc.identifier.issn2013-9144
dc.identifier.issue45
dc.identifier.scopusqualityQ2
dc.identifier.startpage124
dc.identifier.urihttps://hdl.handle.net/11486/7516
dc.identifier.wosWOS:001270470900016
dc.identifier.wosqualityN/A
dc.indekslendigikaynakWeb of Science
dc.language.isoen
dc.publisherUniv Barcelona, Res Group Educ & Virtual Learning, Digital Educ Observatory
dc.relation.ispartofDigital Education Review
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.snmzKA_WOS_20250323
dc.subjectArtificial intelligence tool-based assessment systems
dc.subjectteacher evaluation
dc.subjectassessments in higher education
dc.titleEvaluating the evaluators: A comparative study of AI and teacher assessments in Higher Education
dc.typeArticle

Dosyalar

Koleksiyon

WoS İndeksli Yayınlar Koleksiyonu