000 04860naa a22005777i 4500
001 UMUN-OA-20261005-IS-046
003 local
005 20261005174831.0
006 m o d
007 cr||||||||||||
008 261005s2021 xx o u000 0 eng d
024 7 _a10.3390/app11115088
_2doi
035 _a(local)OpenAlex:W3172362366
040 _alocal
_beng
_clocal
041 0 _aeng
100 0 _aAnna Markella Antoniadi
_eauthor.
245 1 0 _aCurrent Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review /
_cAnna Markella Antoniadi; Yuhan Du; Yasmine Guendouz [and others].
264 1 _a[Place of publication not identified] :
_bMultidisciplinary Digital Publishing Institute,
_c2021.
300 _a1 online resource (1 article).
336 _atext
_btxt
_2rdacontent
337 _acomputer
_bc
_2rdamedia
338 _aonline resource
_bcr
_2rdacarrier
500 _aPublication type: Review article.
500 _aLinked open-access copy: published version.
506 0 _aOpen access; no subscription required for the linked open-access version.
_fUnrestricted online access
_2star
520 3 _aMachine Learning and Artificial Intelligence (AI) more broadly have great immediate and future potential for transforming almost all aspects of medicine. However, in many applications, even outside medicine, a lack of transparency in AI applications has become increasingly problematic. This is particularly pronounced where users need to interpret the output of AI systems. Explainable AI (XAI) provides a rationale that allows users to understand why a system has produced a given output. The output can then be interpreted within a given context. One area that is in great need of XAI is that of Clinical Decision Support Systems (CDSSs). These systems support medical practitioners in their clinic decision-making and in the absence of explainability may lead to issues of under or over-reliance. Providing explanations for how recommendations are arrived at will allow practitioners to make more nuanced, and in some cases, life-saving decisions. The need for XAI in CDSS, and the medical field in general, is amplified by the need for ethical and fair decision-making and the fact that AI trained with historical data can be a reinforcement agent of historical actions and biases that should be uncovered. We performed a systematic literature review of work to-date in the application of XAI in CDSS. Tabular data processing XAI-enabled systems are the most common, while XAI-enabled CDSS for text analysis are the least common in literature. There is more interest in developers for the provision of local explanations, while there was almost a balance between post-hoc and ante-hoc explanations, as well as between model-specific and model-agnostic techniques. Studies reported benefits of the use of XAI such as the fact that it could enhance decision confidence for clinicians, or generate the hypothesis about causality, which ultimately leads to increased trustworthiness and acceptability of the system and potential for its incorporation in the clinical workflow. However, we found an overall distinct lack of application of XAI in the context of CDSS and, in particular, a lack of user studies exploring the needs of clinicians. We propose some guidelines for the implementation of XAI in CDSS and explore some opportunities, challenges, and future research needs.
540 _aCreative Commons Attribution (licence family recorded by the source; version not supplied in metadata).
_uhttps://openalex.org/W3172362366
546 _aIn English.
588 0 _aDescription generated from OpenAlex bibliographic metadata retrieved on 5 October 2026; full text linked from the source.
590 _aCourse allocation: B. Sc. Information Systems.
650 4 _aexplainable AI
650 4 _aclinical decision support systems
650 4 _amachine learning in medicine
650 4 _aAI transparency
650 4 _alocal explanations
650 4 _apost-hoc explanation
653 _aB. Sc. Information Systems
653 _aUMUN open access collection
653 _adecision support systems
655 4 _aReview articles.
700 0 _aYuhan Du
_eauthor.
700 0 _aYasmine Guendouz
_eauthor.
700 0 _aLan Wei
_eauthor.
700 0 _aClaudia Mazo
_eauthor.
700 0 _aBrett A. Becker
_eauthor.
700 0 _aCatherine Mooney
_eauthor.
773 0 _tApplied Sciences
_gVol. 11, no. 11, (2021), pages/article 5088
_x2076-3417
856 4 0 _uhttps://www.mdpi.com/2076-3417/11/11/5088/pdf?version=1622439587
_yRead open-access publication
_zOpen access.
_70
_qapplication/pdf
884 _aCourse selection and automated MARC21 enrichment from OpenAlex metadata.
_g20261005
_khttps://openalex.org/W3172362366
_qlocal
942 _n0
999 _c668
_d668