TY - JOUR
T1 - Clinical evaluation of automated quantitative MRI reports for assessment of hippocampal sclerosis
AU - Goodkin, Olivia
AU - Pemberton, Hugh G.
AU - Vos, Sjoerd B.
AU - Prados, Ferran
AU - Das, Ravi K.
AU - Moggridge, James
AU - De Blasi, Bianca
AU - Bartlett, Philippa
AU - Williams, Elaine
AU - Campion, Thomas
AU - Haider, Lukas
AU - Pearce, Kirsten
AU - Bargallό, Nuria
AU - Sanchez, Esther
AU - Bisdas, Sotirios
AU - White, Mark
AU - Ourselin, Sebastien
AU - Winston, Gavin P.
AU - Duncan, John S.
AU - Cardoso, Jorge
AU - Thornton, John S.
AU - Yousry, Tarek A.
AU - Barkhof, Frederik
N1 - Funding Information: We would like to thank our radiographers for acquiring high-quality clinical data. We are grateful to the Epilepsy Society for supporting the Epilepsy Society MRI scanner. Funding Information: This work is supported by the National Institute for Health Research (NIHR) University College London Hospitals Biomedical Research Centre and the Engineering and Physical Sciences Research Council (EPSRC). GPW was supported by the MRC (G0802012, MR/M00841X/1). BDB was supported by the EPSRC-funded UCL CDT in Medical Imaging (EP/L016478/1). Acknowledgments Publisher Copyright: © 2020, The Author(s). Copyright: Copyright 2020 Elsevier B.V., All rights reserved.
PY - 2021/1
Y1 - 2021/1
N2 - Objectives: Hippocampal sclerosis (HS) is a common cause of temporal lobe epilepsy. Neuroradiological practice relies on visual assessment, but quantification of HS imaging biomarkers—hippocampal volume loss and T2 elevation—could improve detection. We tested whether quantitative measures, contextualised with normative data, improve rater accuracy and confidence. Methods: Quantitative reports (QReports) were generated for 43 individuals with epilepsy (mean age ± SD 40.0 ± 14.8 years, 22 men; 15 histologically unilateral HS; 5 bilateral; 23 MR-negative). Normative data was generated from 111 healthy individuals (age 40.0 ± 12.8 years, 52 men). Nine raters with different experience (neuroradiologists, trainees, and image analysts) assessed subjects’ imaging with and without QReports. Raters assigned imaging normal, right, left, or bilateral HS. Confidence was rated on a 5-point scale. Results: Correct designation (normal/abnormal) was high and showed further trend-level improvement with QReports, from 87.5 to 92.5% (p = 0.07, effect size d = 0.69). Largest magnitude improvement (84.5 to 93.8%) was for image analysts (d = 0.87). For bilateral HS, QReports significantly improved overall accuracy, from 74.4 to 91.1% (p = 0.042, d = 0.7). Agreement with the correct diagnosis (kappa) tended to increase from 0.74 (‘fair’) to 0.86 (‘excellent’) with the report (p = 0.06, d = 0.81). Confidence increased when correctly assessing scans with the QReport (p < 0.001, η2p = 0.945). Conclusions: QReports of HS imaging biomarkers can improve rater accuracy and confidence, particularly in challenging bilateral cases. Improvements were seen across all raters, with large effect sizes, greatest for image analysts. These findings may have positive implications for clinical radiology services and justify further validation in larger groups. Key Points: • Quantification of imaging biomarkers for hippocampal sclerosis—volume loss and raised T2 signal—could improve clinical radiological detection in challenging cases. • Quantitative reports for individual patients, contextualised with normative reference data, improved diagnostic accuracy and confidence in a group of nine raters, in particular for bilateral HS cases. • We present a pre-use clinical validation of an automated imaging assessment tool to assist clinical radiology reporting of hippocampal sclerosis, which improves detection accuracy.
AB - Objectives: Hippocampal sclerosis (HS) is a common cause of temporal lobe epilepsy. Neuroradiological practice relies on visual assessment, but quantification of HS imaging biomarkers—hippocampal volume loss and T2 elevation—could improve detection. We tested whether quantitative measures, contextualised with normative data, improve rater accuracy and confidence. Methods: Quantitative reports (QReports) were generated for 43 individuals with epilepsy (mean age ± SD 40.0 ± 14.8 years, 22 men; 15 histologically unilateral HS; 5 bilateral; 23 MR-negative). Normative data was generated from 111 healthy individuals (age 40.0 ± 12.8 years, 52 men). Nine raters with different experience (neuroradiologists, trainees, and image analysts) assessed subjects’ imaging with and without QReports. Raters assigned imaging normal, right, left, or bilateral HS. Confidence was rated on a 5-point scale. Results: Correct designation (normal/abnormal) was high and showed further trend-level improvement with QReports, from 87.5 to 92.5% (p = 0.07, effect size d = 0.69). Largest magnitude improvement (84.5 to 93.8%) was for image analysts (d = 0.87). For bilateral HS, QReports significantly improved overall accuracy, from 74.4 to 91.1% (p = 0.042, d = 0.7). Agreement with the correct diagnosis (kappa) tended to increase from 0.74 (‘fair’) to 0.86 (‘excellent’) with the report (p = 0.06, d = 0.81). Confidence increased when correctly assessing scans with the QReport (p < 0.001, η2p = 0.945). Conclusions: QReports of HS imaging biomarkers can improve rater accuracy and confidence, particularly in challenging bilateral cases. Improvements were seen across all raters, with large effect sizes, greatest for image analysts. These findings may have positive implications for clinical radiology services and justify further validation in larger groups. Key Points: • Quantification of imaging biomarkers for hippocampal sclerosis—volume loss and raised T2 signal—could improve clinical radiological detection in challenging cases. • Quantitative reports for individual patients, contextualised with normative reference data, improved diagnostic accuracy and confidence in a group of nine raters, in particular for bilateral HS cases. • We present a pre-use clinical validation of an automated imaging assessment tool to assist clinical radiology reporting of hippocampal sclerosis, which improves detection accuracy.
KW - Biomarkers
KW - Epilepsy
KW - Hippocampus
KW - Magnetic resonance imaging
KW - Temporal lobe
UR - http://www.scopus.com/inward/record.url?scp=85088997160&partnerID=8YFLogxK
U2 - https://doi.org/10.1007/s00330-020-07075-2
DO - https://doi.org/10.1007/s00330-020-07075-2
M3 - Article
C2 - 32749588
SN - 0938-7994
VL - 31
SP - 34
EP - 44
JO - European radiology
JF - European radiology
IS - 1
ER -