Analytics4Action Evaluation Framework: A Review of Evidence-Based Learning Analytics Interventions at the Open University UK

Authors

  • Bart Rienties Open University UK Milton Keynes https://orcid.org/0000-0003-3749-9629
  • Avinash Boroowa Open University UK
  • Simon Cross Open University UK
  • Chris Kubiak Open University UK
  • Kevin Mayles Open University UK
  • Sam Murphy Open University UK

DOI:

https://doi.org/10.5334/jime.394

Keywords:

learning analytics, evidence-based research, evaluation, online learning, data

Abstract

There is an urgent need to develop an evidence-based framework for learning analytics whereby stakeholders can manage, evaluate, and make decisions about which types of interventions work well and under which conditions. In this article, we will work towards developing a foundation of an Analytics4Action Evaluation Framework (A4AEF) that is currently being tested and validated at the Open University UK. By working with 18 introductory large-scale modules for a period of two years across the five faculties and disciplines within the OU, Analytics4Action provides a bottom-up-approach for working together with key stakeholders within their respective contexts. A holistic A4AEF has been developed to unpack, understand and map the six key steps in the evidence-based intervention process. By means of an exemplar in health and social science, a practical illustration of A4AEF is provided. In the next 3–5 years, we hope that a rich, robust evidence-base will be presented to show how learning analytics can help teachers to make informed, timely and successful interventions that will help each learner to achieve the module’s learning outcomes.

Author Biographies

Bart Rienties, Open University UK Milton Keynes

Dr. Bart Rienties is Reader in Learning Analytics at the Institute of Educational Technology at the Open University UK. As educational psychologist, he conducts multi-disciplinary research on work-based and collaborative learning environments and focuses on the role of social interaction in learning, which is published in leading academic journals and books. His primary research interests are focussed on Learning Analytics, Computer-Supported Collaborative Learning, and the role of motivation in learning. Furthermore, Bart is interested in broader internationalisation aspects of higher education. He successfully led a range of institutional/national/European projects and received several awards for his educational innovation projects.

Avinash Boroowa, Open University UK

Avinash Boroowa is project manager of learning analytics at the Open University UK

Simon Cross, Open University UK

Dr Simon Cross is Lecturer at the Institute of Educational Technology at the Open University UK. His work within IET is focused on several areas including assessment and badges, learning design and issues associated with adaptive/visualisatised learning, and international and open learning design.

Chris Kubiak, Open University UK

Dr Chris Kubiak is a senior lecturer in health and social care with a particular interest in practice, practice-based learning and pedagogy at the Open University UK. He was originally trained in community psychology in New Zealand. His career has included services for people with intellectual and psychiatric disabilities, volunteer-run telephone counselling and advice services and lecturing in psychology and communication studies. He have been a full time researcher researching school-based learning networks and have also run an education and advocacy service.

Kevin Mayles, Open University UK

Kevin Mayles is head of analytics at the Learning and Teaching Unit, Open University UK

Sam Murphy, Open University UK

Dr Sam Murphy joined the Open University in June 2010 to work on K260, Death and dying. She is also a member of the course teams for K303, Managing care and K309, Communication in health and social care. She is co-convenor of the Brish Sociological Association's Human Reproduction Study Group and chair of the OU's Birth and Death research group. Her specific interest in the area of death and dying is pregnancy loss and my ESRC-funded doctoral research, undertaken at the University of Surrey, was a sociological exploration of parental experiences of stillbirth. She is also a member of the Association for the Study of Death and Society. She is also a guest lecturer at Imperial College, London where she delivers several lectures on the Sociology course for first year medical students.

Downloads

Published

2016-01-19

Issue

Vol. 2016 No. 1

Section

Articles

Categories

License

Copyright (c) 2016 The Author(s)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms (if a submission is rejected or withdrawn prior to publication, all rights return to the author(s)):

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).

Submitting to the journal implicitly confirms that all named authors and rights holders have agreed to the above terms of publication. It is the submitting author's responsibility to ensure all authors and relevant institutional bodies have given their agreement at the point of submission.

Note: some institutions require authors to seek written approval in relation to the terms of publication. Should this be required, authors can request a separate licence agreement document from the editorial team (e.g. authors who are Crown employees).

Creative Commons License
Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution 4.0 License