The integration of generative artificial intelligence (AI) into Higher Education has intensified debates about the role of technology in formative assessment. This study examines the effectiveness and practical comparability of AI-generated feedback in a project-based university course, comparing two large language models (GPT-o4-mini and DeepSeek R1) with feedback provided by an expert human teacher. Adopting a quasi-experimental design, 47 student groups (N = 238) were randomly assigned to one of three feedback conditions. Changes in project performance were analysed using non-parametric tests, robust models, and non-inferiority and equivalence analyses. Students’ perceptions were also assessed through a validated questionnaire (N = 200). Results showed significant improvement in project performance from pre- to post-feedback across all conditions (rrb = 0.77), with no significant differences between feedback sources. Equivalence analyses indicated practical comparability between GPT-o4-mini and teacher feedback, while DeepSeek R1 demonstrated non-inferiority. Students’ perceptions of mastery, emotions, and satisfaction were similarly high across conditions. Findings suggest that feedback effectiveness depends less on its source than on the pedagogical architecture in which it is embedded. When supported by strong assessment literacy and explicit criteria, AI-generated feedback can function as a credible component of formative assessment in higher education.

Artificial intelligence and feedback in university education: effectiveness and student perceptions / Grion, V., Doria, B., Agostini, D., Slaviero, G.. - In: ASSESSMENT AND EVALUATION IN HIGHER EDUCATION. - ISSN 0260-2938. - 2026:(2026), pp. 1-20. [10.1080/02602938.2026.2697962]

Artificial intelligence and feedback in university education: effectiveness and student perceptions

Valentina Grion;Daniele Agostini;
2026-01-01

Abstract

The integration of generative artificial intelligence (AI) into Higher Education has intensified debates about the role of technology in formative assessment. This study examines the effectiveness and practical comparability of AI-generated feedback in a project-based university course, comparing two large language models (GPT-o4-mini and DeepSeek R1) with feedback provided by an expert human teacher. Adopting a quasi-experimental design, 47 student groups (N = 238) were randomly assigned to one of three feedback conditions. Changes in project performance were analysed using non-parametric tests, robust models, and non-inferiority and equivalence analyses. Students’ perceptions were also assessed through a validated questionnaire (N = 200). Results showed significant improvement in project performance from pre- to post-feedback across all conditions (rrb = 0.77), with no significant differences between feedback sources. Equivalence analyses indicated practical comparability between GPT-o4-mini and teacher feedback, while DeepSeek R1 demonstrated non-inferiority. Students’ perceptions of mastery, emotions, and satisfaction were similarly high across conditions. Findings suggest that feedback effectiveness depends less on its source than on the pedagogical architecture in which it is embedded. When supported by strong assessment literacy and explicit criteria, AI-generated feedback can function as a credible component of formative assessment in higher education.
2026
Grion, Valentina; Doria, Beatrice; Agostini, Daniele; Slaviero, Giorgia
Artificial intelligence and feedback in university education: effectiveness and student perceptions / Grion, V., Doria, B., Agostini, D., Slaviero, G.. - In: ASSESSMENT AND EVALUATION IN HIGHER EDUCATION. - ISSN 0260-2938. - 2026:(2026), pp. 1-20. [10.1080/02602938.2026.2697962]
File in questo prodotto:
File Dimensione Formato  
Artificial intelligence and feedback in university education effectiveness and student perceptions.pdf

accesso aperto

Descrizione: Online First
Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Creative commons
Dimensione 1.74 MB
Formato Adobe PDF
1.74 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/494590
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact