Explainable AI for HCI : A Systematic Review of a Decade of Studies on XAI Tools

Yehia, Ahmad and Sas, Corina (2026) Explainable AI for HCI : A Systematic Review of a Decade of Studies on XAI Tools. Interacting with Computers. ISSN 0953-5438 (In Press)

Text (Explainable AI for HCI A Systematic Review of a Decade of Studies on XAI Tools)
Explainable_AI_for_HCI_A_Systematic_Review_of_a_Decade_of_Studies_on_XAI_Tools.pdf - Accepted Version
Available under License Creative Commons Attribution.
Download (817kB)

Abstract

Despite their increasing adoption, understanding black-box models which underpin AI technologies is not trivial. To address this challenge, explainable AI (XAI) tools have received increased interest, albeit their HCI exploration is limited. We report a systematic review of 142 papers focused on the design, use, or evaluation of XAI tools, and in particular the types of XAI tools, their exploration, the type of data input and output, type of explanation, available XAI interfaces, and evaluation of XAI tools. Our outcomes highlight a large number of XAI tools, albeit a small number is commonly used, most often by AI experts as users rather than novice users. Our findings led to four research, design, and methodological implications including the call for more HCI-driven, user interaction with XAI tools, for designing richer portfolios of user-data interaction scenarios for XAI tools, and of novel XAI user interfaces, and for leveraging hybrid methods & measures for XAI tools evaluation.