Exploring the integration of Generative AI in assessment in a tertiary context

A case study

Abstract

The unprecedented advancements of Generative Artificial Intelligence (GenAI) tools have generated controversies surrounding their potential for transforming educational practices, and democratising knowledge sharing, while acknowledging risks to current educational practices. In order to understand the potential and risks of GenAI tools on educational practices, recent research point to the need to develop student and teacher AI literacy skills and to investigate the impact of GenAI integration in learning and assessment practices. In addressing the call for more research in the field, this study reports on the integration of GenAI tools in an academic assessment in a postgraduate course for pre-service language teachers at an Australian university. Data were collected from students’ reflections of their adoption of GenAI tools for planning their assessment and from qualitative surveys. Thematic analysis was employed to identify students’ perceived challenges and benefits in adopting GenAI for essay writing. Pre-service teachers recognised benefits in adopting GenAI for planning and generating ideas for academic writing but recognised the importance of mitigating risks created by inaccuracies or biases in content. The findings confirm the importance of transparency in the integration of GenAI and developing student awareness of and training in ethical use of GenAI for higher education.