University of Twente Student Theses

Login

Influence of human-in-the-loop on the acceptance of AI-driven evaluation of essay questions by students.

Balickis, K. (2022) Influence of human-in-the-loop on the acceptance of AI-driven evaluation of essay questions by students.

[img] PDF
631kB
Abstract:Artificial intelligence (AI) is developing rapidly in the various fields of our lives. The education field could benefit from AI-based systems as well. Introducing AI-based evaluation systems for essay questions in higher education could benefit universities and their staff. Yet this area is underexplored. The existing research focuses on the technical aspects of AI-based systems for grading and not on the human side. This research finds the acceptance levels of AI-based evaluation from a student perspective. This would be important since the acceptance of the evaluation process in universities highly correlates with their reputation. A survey with Likert-type items was conducted. Participants answered the same questions three times for three different implementation scenarios of AI-driven evaluation. The first scenario is fully AI grading, and the two others include human-in-the-loop AI (HitAI). The result shows higher overall acceptance for scenarios with HitAI compared to a scenario with solely AI evaluation. Lastly, the discussion states limitations, and suggestions for future research. Practical implications for universities that planning to adopt such AI systems would be to keep humans in the loop.
Item Type:Essay (Bachelor)
Faculty:BMS: Behavioural, Management and Social Sciences
Subject:85 business administration, organizational science
Programme:International Business Administration BSc (50952)
Link to this item:https://purl.utwente.nl/essays/91297
Export this item as:BibTeX
EndNote
HTML Citation
Reference Manager

 

Repository Staff Only: item control page