Akademska digitalna zbirka SLovenije - logo
E-resources
Peer reviewed Open access
  • Human-centered XAI: Develop...
    Schoonderwoerd, Tjeerd A.J.; Jorritsma, Wiard; Neerincx, Mark A.; van den Bosch, Karel

    International journal of human-computer studies, October 2021, 2021-10-00, Volume: 154
    Journal Article

    •Human-centered XAI design is required to create human-understandable explanations.•We present a human-centered design approach to develop explanations for AI systems.•User requirements for explanations from clinical support systems are derived.•A set of re-usable explanation design patterns for decision-support systems is created. Display omitted Much of the research on eXplainable Artificial Intelligence (XAI) has centered on providing transparency of machine learning models. More recently, the focus on human-centered approaches to XAI has increased. Yet, there is a lack of practical methods and examples on the integration of human factors into the development processes of AI-generated explanations that humans prove to uptake for better performance. This paper presents a case study of an application of a human-centered design approach for AI-generated explanations. The approach consists of three components: Domain analysis to define the concept & context of explanations, Requirements elicitation & assessment to derive the use cases & explanation requirements, and the consequential Multi-modal interaction design & evaluation to create a library of design patterns for explanations. In a case study, we adopt the DoReMi-approach to design explanations for a Clinical Decision Support System (CDSS) for child health. In the requirements elicitation & assessment, a user study with experienced paediatricians uncovered what explanations the CDSS should provide. In the interaction design & evaluation, a second user study tested the consequential interaction design patterns. This case study provided a first set of user requirements and design patterns for an explainable decision support system in medical diagnosis, showing how to involve expert end users in the development process and how to develop, more or less, generic solutions for general design problems in XAI.