000 05312naa a22005417i 4500
001 UMUN-OA-20261005-AI-031
003 local
005 20261005174825.0
006 m o d
007 cr||||||||||||
008 261005s2024 xx o u000 0 eng d
024 7 _a10.2196/53207
_2doi
035 _a(local)OpenAlex:W4403914562
040 _alocal
_beng
_clocal
041 0 _aeng
100 0 _aRikard Rosenbacke
_eauthor.
245 1 0 _aHow Explainable Artificial Intelligence Can Increase or Decrease Clinicians’ Trust in AI Applications in Health Care: Systematic Review /
_cRikard Rosenbacke; Åsa Melhus; Martin McKee [and others].
264 1 _a[Place of publication not identified] :
_bJMIR Publications Inc.,
_c2024.
300 _a1 online resource (1 article).
336 _atext
_btxt
_2rdacontent
337 _acomputer
_bc
_2rdamedia
338 _aonline resource
_bcr
_2rdacarrier
500 _aPublication type: Review article.
500 _aLinked open-access copy: published version.
506 0 _aOpen access; no subscription required for the linked open-access version.
_fUnrestricted online access
_2star
520 3 _aBACKGROUND: Artificial intelligence (AI) has significant potential in clinical practice. However, its "black box" nature can lead clinicians to question its value. The challenge is to create sufficient trust for clinicians to feel comfortable using AI, but not so much that they defer to it even when it produces results that conflict with their clinical judgment in ways that lead to incorrect decisions. Explainable AI (XAI) aims to address this by providing explanations of how AI algorithms reach their conclusions. However, it remains unclear whether such explanations foster an appropriate degree of trust to ensure the optimal use of AI in clinical practice. OBJECTIVE: This study aims to systematically review and synthesize empirical evidence on the impact of XAI on clinicians' trust in AI-driven clinical decision-making. METHODS: A systematic review was conducted in accordance with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, searching PubMed and Web of Science databases. Studies were included if they empirically measured the impact of XAI on clinicians' trust using cognition- or affect-based measures. Out of 778 articles screened, 10 met the inclusion criteria. We assessed the risk of bias using standard tools appropriate to the methodology of each paper. RESULTS: The risk of bias in all papers was moderate or moderate to high. All included studies operationalized trust primarily through cognitive-based definitions, with 2 also incorporating affect-based measures. Out of these, 5 studies reported that XAI increased clinicians' trust compared with standard AI, particularly when the explanations were clear, concise, and relevant to clinical practice. In addition, 3 studies found no significant effect of XAI on trust, and the presence of explanations does not automatically improve trust. Notably, 2 studies highlighted that XAI could either enhance or diminish trust, depending on the complexity and coherence of the provided explanations. The majority of studies suggest that XAI has the potential to enhance clinicians' trust in recommendations generated by AI. However, complex or contradictory explanations can undermine this trust. More critically, trust in AI is not inherently beneficial, as AI recommendations are not infallible. These findings underscore the nuanced role of explanation quality and suggest that trust can be modulated through the careful design of XAI systems. CONCLUSIONS: Excessive trust in incorrect advice generated by AI can adversely impact clinical accuracy, just as can happen when correct advice is distrusted. Future research should focus on refining both cognitive and affect-based measures of trust and on developing strategies to achieve an appropriate balance in terms of trust, preventing both blind trust and undue skepticism. Optimizing trust in AI systems is essential for their effective integration into clinical practice.
540 _aCreative Commons Attribution. See the linked licence for the applicable terms.
_uhttps://creativecommons.org/licenses/by/4.0/
546 _aIn English.
588 0 _aDescription generated from OpenAlex bibliographic metadata retrieved on 5 October 2026; full text linked from the source.
590 _aCourse allocation: B. Sc. Artificial Intelligence.
650 4 _aexplainable AI
650 4 _aclinician trust in AI
650 4 _aclinical decision support
650 4 _aAI explanations
650 4 _aexplanation quality
650 4 _atrust in AI recommendations
653 _aB. Sc. Artificial Intelligence
653 _aUMUN open access collection
653 _aexplainable artificial intelligence
655 4 _aReview articles.
700 0 _aÅsa Melhus
_eauthor.
700 0 _aMartin McKee
_eauthor.
700 0 _aDavid Stuckler
_eauthor.
773 0 _tJMIR AI
_gVol. 3, (2024), pages/article e53207
_x2817-1705
856 4 0 _uhttps://europepmc.org/articles/PMC11561425
_yRead open-access publication
_zOpen access.
_70
884 _aCourse selection and automated MARC21 enrichment from OpenAlex metadata.
_g20261005
_khttps://openalex.org/W4403914562
_qlocal
942 _n0
999 _c588
_d588