TY - JOUR
T1 - Real-time imputation of missing predictor values improved the application of prediction models in daily practice
AU - Nijman, Steven Willem Joost
AU - Groenhof, T. Katrien J.
AU - Hoogland, Jeroen
AU - Bots, Michiel L.
AU - Brandjes, Menno
AU - Jacobs, John J. L.
AU - Asselbergs, Folkert W.
AU - Moons, Karel G. M.
AU - Debray, Thomas P. A.
N1 - Funding Information: Funding sources: This work was supported by the Netherlands Heart Foundation (public-private study grant, number: #2018B006); and the Top Sector Life Sciences and health (PPP allowance made available to Netherlands Heart Foundation to stimulate public-private partnerships). TD and JH acknowledge financial support from the Netherlands Organization for Health Research and Development (VENI grant 91617050, and TOP grant 91215058, respectively). Publisher Copyright: © 2021 The Authors
PY - 2021/6/1
Y1 - 2021/6/1
N2 - Objectives: In clinical practice, many prediction models cannot be used when predictor values are missing. We, therefore, propose and evaluate methods for real-time imputation. Study Design and Setting: We describe (i) mean imputation (where missing values are replaced by the sample mean), (ii) joint modeling imputation (JMI, where we use a multivariate normal approximation to generate patient-specific imputations), and (iii) conditional modeling imputation (CMI, where a multivariable imputation model is derived for each predictor from a population). We compared these methods in a case study evaluating the root mean squared error (RMSE) and coverage of the 95% confidence intervals (i.e., the proportion of confidence intervals that contain the true predictor value) of imputed predictor values. Results: –RMSE was lowest when adopting JMI or CMI, although imputation of individual predictors did not always lead to substantial improvements as compared to mean imputation. JMI and CMI appeared particularly useful when the values of multiple predictors of the model were missing. Coverage reached the nominal level (i.e., 95%) for both CMI and JMI. Conclusion: Multiple imputations using either CMI or JMI is recommended when dealing with missing predictor values in real-time settings.
AB - Objectives: In clinical practice, many prediction models cannot be used when predictor values are missing. We, therefore, propose and evaluate methods for real-time imputation. Study Design and Setting: We describe (i) mean imputation (where missing values are replaced by the sample mean), (ii) joint modeling imputation (JMI, where we use a multivariate normal approximation to generate patient-specific imputations), and (iii) conditional modeling imputation (CMI, where a multivariable imputation model is derived for each predictor from a population). We compared these methods in a case study evaluating the root mean squared error (RMSE) and coverage of the 95% confidence intervals (i.e., the proportion of confidence intervals that contain the true predictor value) of imputed predictor values. Results: –RMSE was lowest when adopting JMI or CMI, although imputation of individual predictors did not always lead to substantial improvements as compared to mean imputation. JMI and CMI appeared particularly useful when the values of multiple predictors of the model were missing. Coverage reached the nominal level (i.e., 95%) for both CMI and JMI. Conclusion: Multiple imputations using either CMI or JMI is recommended when dealing with missing predictor values in real-time settings.
KW - Computerized decision support system
KW - Electronic health records
KW - Missing data
KW - Multiple imputations
KW - Prediction
KW - Real-time imputation
UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85100883308&origin=inward
UR - https://www.ncbi.nlm.nih.gov/pubmed/33482294
UR - http://www.scopus.com/inward/record.url?scp=85100883308&partnerID=8YFLogxK
U2 - https://doi.org/10.1016/j.jclinepi.2021.01.003
DO - https://doi.org/10.1016/j.jclinepi.2021.01.003
M3 - Article
C2 - 33482294
SN - 0895-4356
VL - 134
SP - 22
EP - 34
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
ER -