Trust or mistrust in algorithmic grading? : An embedded agency perspective

Jackson, Stephen and Panteli, Niki (2023) Trust or mistrust in algorithmic grading? : An embedded agency perspective. International Journal of Information Management, 69: 102555. ISSN 0268-4012

Full text not available from this repository.

Abstract

Artificial Intelligence (AI) has the potential to significantly impact the educational sector. One application of AI that has increasingly been applied is algorithmic grading. It is within this context that our study takes a focus on trust. While the concept of trust continues to grow in importance among AI researchers and practitioners, an investigation of trust/mistrust in algorithmic grading across multiple levels of analysis has so far been under-researched. In this paper, we argue the need for a model that encompasses the multi-layered nature of trust/mistrust in AI. Drawing on an embedded agency perspective, a model is devised that examines top-down and bottom-up forces that can influence trust/mistrust in algorithmic grading. We illustrate how the model can be applied by drawing on the case of the International Baccalaureate (IB) program in 2020, whereby an algorithm was used to determine student grades. This paper contributes to the AI-trust literature by providing a fresh theoretical lens based on institutional theory to investigate the dynamic and multi-faceted nature of trust/mistrust in algorithmic grading—an area that has seldom been explored, both theoretically and empirically. The study raises important implications for algorithmic design and awareness. Algorithms need to be designed in a transparent, fair, and ultimately a trustworthy manner. While an algorithm typically operates like a black box, whereby the underlying mechanisms are not apparent to those impacted by it, the purpose and an understanding of how the algorithm works should be communicated upfront and in a timely manner.

Item Type:
Journal Article
Journal or Publication Title:
International Journal of Information Management
Additional Information:
Publisher Copyright: © 2022 Elsevier Ltd
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/1400/1404
Subjects:
?? algorithmic gradingembedded agencymistrustmulti-level analysistrustmanagement information systemsinformation systemscomputer networks and communicationsinformation systems and managementmarketinglibrary and information sciencesartificial intelligence ??
ID Code:
214036
Deposited By:
Deposited On:
05 Feb 2024 14:55
Refereed?:
Yes
Published?:
Published
Last Modified:
07 Oct 2024 00:29