Evaluating an online assessment framework through the lens of Generative AI

Authors

DOI:

https://doi.org/10.14742/apubs.2024.1423

Keywords:

quality assessment, online assessment, generative AI, evaluation

Abstract

Since the general public’s ability to access generative AI in November 2022, higher education faces significant challenges and opportunities. This paper examines how generative AI affects a framework for quality online assessment, which includes academic integrity, authenticity, equity of access, information integrity, quality feedback, and student experience. Drawing on feedback from survey respondents and focus group/interview participants from a range of stakeholder groups, the study provides qualitative insights on the impact of generative AI on assessment. Findings highlight both potential benefits, such as improved performance and efficiency, and challenges, including threats to academic integrity and equity of access. The paper explores the implications of generative AI and discusses the trade-offs educators and assessment designers face when designing assessments that must balance innovation and preparing students for the generative AI-enhanced workplace, with the need for integrity and fairness.

Author Biography

Amanda White, University of Technology Sydney

Dr Amanda White OAM is an accounting and audit educator and communicator who is passionate about helping students learn and develop a career in the accounting profession. As a lover of edtech, she is focused on creating active learning experiences to prepare students for a diverse and agile workplace.

Amanda promotes the sharing of open access, high-quality resources by academics and has a keen interest in the use of social media in teaching. Her YouTube channel, AmandaLovesToAudit, contains videos of diagrams and explanations she uses in her classes, interviews with people in the accounting profession and study hints and tips, and has more than 99,000 subscribers. Her introductory accounting textbook, Accounting and Accountability, is a FREE open textbook that anyone can access and use. It contains interactive self-testing elements, personal stories and an audiobook for flexible learning.

Amanda’s research focuses on the teaching and learning aspects of accounting education and academic integrity. Initiatives developed within the subjects she teaches have been adopted across UTS and other universities include ice-breaker activities, structures for learning management system sites and resources to support academic integrity. Her expertise in academic integrity is recognised by her appointment by TEQSA as an academic integrity masterclass trainer.

In recognition of her dedication to teaching and learning practices, she was awarded an AAUT Citation in 2017 for her contribution to the support of student learning. In 2021, she was recognised with the Australian Awards for University Teaching (AAUT) Teaching Excellence Award for Law, Economics, Business and related studies. She was also runner-up to Australian Teacher of the Year.

Amanda previously held positions as a trainee at Coopers and Lybrand and as a Senior Consultant at PWC. Her professional experience has focused on providing operational risk management to the financial services and services industries.

Downloads

Published

2024-11-23

Issue

2024: ASCILITE 2024 Conference Proceedings

Section

ASCILITE Conference - Concise Papers

License

Copyright (c) 2024 Amanda White, Elaine

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.