Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education
A qualitative study at a Saudi public university examined 13 male undergraduate computing students' reflections after being told ChatGPT graded their handwritten writing task using a rubric-based prompt. Inductive thematic analysis identified four themes from student reflections.
Researchers conducted a pedagogical inquiry in an undergraduate technical communication course for computing students at a Saudi public university. Thirteen male students completed an in-class handwritten writing task, which was then evaluated by ChatGPT using a rubric-based prompt aligned with task objectives. Students were explicitly informed that ChatGPT generated the score and feedback and were invited to reflect in writing. Inductive thematic analysis of these reflections identified four themes related to perceived usefulness, fairness, trust, and emotional response.
The study uses a rubric-based prompt to evaluate handwritten student work, demonstrating a practical application of large language models for formative assessment. The qualitative analysis focuses on student interpretation of AI-mediated evaluation, providing insight into how transparency about AI grading affects learner perceptions.
This research highlights growing interest in AI-assisted assessment in higher education, particularly in technical communication courses. It suggests that institutions exploring AI grading tools must consider student trust and perceived fairness, which may influence adoption and acceptance.
The study provides evidence for edtech companies and universities developing AI grading tools, emphasizing the need for transparent communication and student-centered design to ensure acceptance and effectiveness.
Future work may compare student perceptions across different disciplines, genders, and cultural contexts, and investigate how AI feedback quality and transparency mechanisms affect learning outcomes. The findings could inform guidelines for responsible AI use in educational assessment.