TY - JOUR
T1 - A systematic review on the use of explainability in deep learning systems for computer aided diagnosis in radiology
T2 - Limited use of explainable AI?
AU - Groen, Arjan M.
AU - Kraan, Rik
AU - Amirkhan, Shahira F.
AU - Daams, Joost G.
AU - Maas, Mario
N1 - Publisher Copyright: © 2022 The Author(s)
PY - 2022/12/1
Y1 - 2022/12/1
N2 - Objectives: This study aims to contribute to an understanding of the explainability of computer aided diagnosis studies in radiology that use end-to-end deep learning by providing a quantitative overview of methodological choices and by discussing the implications of these choices for their explainability. Methods: A systematic review was executed using the preferred reporting items for systemic reviews and meta-analysis guidelines. Primary diagnostic test accuracy studies using end-to-end deep learning for radiology were identified from the period January 1st, 2016, to January 20th, 2021. Results were synthesized by identifying the explanation goals, measures, and explainable AI techniques. Results: This study identified 490 primary diagnostic test accuracy studies using end-to-end deep learning for radiology, of which 179 (37%) used explainable AI. In 147 out of 179 (82%) of studies, explainable AI was used for the goal of model visualization and inspection. Class activation mapping is the most common technique, being used in 117 out of 179 studies (65%). Only 1 study used measures to evaluate the outcome of their explainable AI. Conclusions: A considerable portion of computer aided diagnosis studies provide a form of explainability of their deep learning models for the purpose of model visualization and inspection. The techniques commonly chosen by these studies (class activation mapping, feature activation mapping and t-distributed stochastic neighbor embedding) have potential limitations. Because researchers generally do not measure the quality of their explanations, we are agnostic about how effective these explanations are at addressing the black box issues of deep learning in radiology.
AB - Objectives: This study aims to contribute to an understanding of the explainability of computer aided diagnosis studies in radiology that use end-to-end deep learning by providing a quantitative overview of methodological choices and by discussing the implications of these choices for their explainability. Methods: A systematic review was executed using the preferred reporting items for systemic reviews and meta-analysis guidelines. Primary diagnostic test accuracy studies using end-to-end deep learning for radiology were identified from the period January 1st, 2016, to January 20th, 2021. Results were synthesized by identifying the explanation goals, measures, and explainable AI techniques. Results: This study identified 490 primary diagnostic test accuracy studies using end-to-end deep learning for radiology, of which 179 (37%) used explainable AI. In 147 out of 179 (82%) of studies, explainable AI was used for the goal of model visualization and inspection. Class activation mapping is the most common technique, being used in 117 out of 179 studies (65%). Only 1 study used measures to evaluate the outcome of their explainable AI. Conclusions: A considerable portion of computer aided diagnosis studies provide a form of explainability of their deep learning models for the purpose of model visualization and inspection. The techniques commonly chosen by these studies (class activation mapping, feature activation mapping and t-distributed stochastic neighbor embedding) have potential limitations. Because researchers generally do not measure the quality of their explanations, we are agnostic about how effective these explanations are at addressing the black box issues of deep learning in radiology.
KW - Computer aided diagnosis
KW - Deep learning
KW - Explainable artificial intelligence
KW - Radiology
UR - http://www.scopus.com/inward/record.url?scp=85141471077&partnerID=8YFLogxK
U2 - https://doi.org/10.1016/j.ejrad.2022.110592
DO - https://doi.org/10.1016/j.ejrad.2022.110592
M3 - Article
C2 - 36371947
SN - 0720-048X
VL - 157
JO - European Journal of Radiology
JF - European Journal of Radiology
M1 - 110592
ER -