Digital Transformation Where It Matters: A Four Pillar Maturity Model for Diverse Assessment Practices in Higher Education

Authors

DOI:

https://doi.org/10.34190/ecel.25.1.5227

Keywords:

Digital Assessment Maturity, Higher Education, Education Transformation, Assessment practices

Abstract

Digital transformation in higher education has been widely conceptualised through institutional frameworks such as those developed by EDUCAUSE and Jisc. While these offer robust lenses for analysing organisation-wide change, assessment transformation within disciplines is an ongoing process that requires continuous measurement and validation at a meso level. Assessment, as a core pedagogical and regulatory function, is closely linked to institutional structures but enacted primarily at the course and teacher levels. Consequently, nuanced transformations in assessment practices may not be fully captured by high-level organisational frameworks. This study addresses the gap by introducing the Digital Assessment Maturity Index (DAMI), a framework for analysing assessment transformation within higher education. The model was developed through an iterative abductive process that combined institutional digital transformation frameworks, contemporary assessment literature, and a contextual analysis of assessment practices at a technical university in Sweden. Rather than adopting organisation-wide dimensions, the study selectively synthesised concepts relevant to the local enactment of digital assessment at course and programme levels. This process identified four interrelated constructs: (1) Adoption & Coverage; (2) Efficiency & Throughput; (3) Authenticity & Learning Alignment; and (4) Trust & Reliability. Institution-wide dimensions such as governance, finance, and policy alignment aspects were excluded because they operate beyond the assessment enactment. The resulting four-pillar DAMI model was operationalised using an institution-wide survey of teachers at the bachelor’s and master's levels, enabling an initial empirical mapping of the university’s digital assessment maturity. The findings from 314 responses from faculty demonstrate that digital assessment at the university in 2024 is characterised by substantial adoption and efficiency gains, alongside persistent trust and reliability concerns and uneven pedagogical transformation. The model also demonstrates sensitivity to both barriers and enablers of assessment transformation, offering actionable insights to inform programme-level improvements. These outcomes reveal that the DAMI model can isolate assessment as a distinct unit of analysis and derive its dimensions through cross-framework conceptual reduction rather than institutional abstraction. As a next step, DAMI will be evaluated longitudinally through repeated institution-wide surveys.

Author Biographies

Thashmee Karunaratne, KTH-Royal Institute of Technology

Thashmee Karunaratne is an Associate Professor in Digital Learning at KTH Royal Institute of Technology. Her research focuses on analytics-based design for digital transformation and data-informed education. With a PhD in machine learning from Stockholm University, she leads international projects and advances educational innovation, data literacy, and collaborative digital ecosystems.

Fredrik Enoksson, Digital Learning Unit, KTH Royal Institute of Technology

Fredrik Enoksson is a researcher in Digital Learning at KTH Royal Institute of Technology. His research focuses on technologically mediated learning, including online and blended environments, using socio-cultural perspectives such as Activity Theory and Community of Inquiry. He also leads digital learning research-based development.

Richard Lee Davis, Digital Learning Unit, KTH Royal Institute of Technology

Richard Lee Davis is an Assistant Professor in Digital Learning at KTH Royal Institute of Technology. With a PhD from Stanford, his research explores constructionist learning through technologies such as AI, XR, and digital fabrication. He designs and evaluates educational tools that support creative, hands-on learning across diverse domains.

Anna Land , Digital Learning Unit, KTH Royal Institute of Technology

Anna Land is a doctoral student and educational developer in Digital Learning at KTH Royal Institute of Technology. Her current research mainly focuses on AI’s role in teacher education, specifically how teaching practitioners’ visions of teacher education can inform efforts to reshape education with a focus on AI integration.

Caroline Bern, Digital Learning Unit, KTH Royal Institute of Technology

Caroline Bern is an educational developer in Digital Learning at KTH Royal Institute of Technology. With a background as an engineer and teacher, she works with digital learning tools, supports staff through workshops on generative AI and pedagogy, and teaches courses in mathematics education and higher education teaching.

Downloads

Published

2026-10-07