Integrating ICAP theory in learning analytics

A model for evaluating student engagement in online courses

Abstract

This paper introduces a conceptual evaluation learning analytics (LA) model developed by Keypath Education and Melbourne Business School to analyse student engagement in an online learning environment. The paper describes how a targeted LA intervention was grounded within the ICAP theory for active learning to identify, visualise and analyse student engagement metrics in a 100% online setting. The architecture of the model, including its design principles and underlying assumptions, are broadly examined against the latest research in educational, LA, and data analytics research. This includes a discussion of our initial phase testing results of captured student data alongside a discussion of key questions and desired study outcomes for the upcoming phase 2 of the data intervention. As a result, this paper provides both specific insights into how we created an evidence based and pedagogically sound evaluation model of online student engagement within a specific suite of asynchronous educational tools, as well as more general and practical insights into how other universities could develop similar approaches to enhance understanding and support of a growing online student population.