TY - JOUR
T1 - Individualized prediction of three- and six-year outcomes of psychosis in a longitudinal multicenter study
T2 - a machine learning approach
AU - GROUP investigators
AU - de Nijs, Jessica
AU - Burger, Thijs J.
AU - Janssen, Ronald J.
AU - Kia, Seyed Mostafa
AU - van Opstal, Daniël P.J.
AU - de Koning, Mariken B.
AU - de Haan, Lieuwe
AU - Alizadeh, Behrooz Z.
AU - Bartels-Velthuis, Agna A.
AU - van Beveren, Nico J.
AU - Bruggeman, Richard
AU - de Haan, Lieuwe
AU - Delespaul, Philippe
AU - Luykx, Jurjen J.
AU - Myin-Germeys, Inez
AU - Kahn, Rene S.
AU - Schirmbeck, Frederike
AU - Simons, Claudia J.P.
AU - van Amelsvoort, Therese
AU - van Os, Jim
AU - van Winkel, Ruud
AU - Cahn, Wiepke
AU - Schnack, Hugo G.
N1 - Publisher Copyright: © 2021, The Author(s).
PY - 2021/12
Y1 - 2021/12
N2 - Schizophrenia and related disorders have heterogeneous outcomes. Individualized prediction of long-term outcomes may be helpful in improving treatment decisions. Utilizing extensive baseline data of 523 patients with a psychotic disorder and variable illness duration, we predicted symptomatic and global outcomes at 3-year and 6-year follow-ups. We classified outcomes as (1) symptomatic: in remission or not in remission, and (2) global outcome, using the Global Assessment of Functioning (GAF) scale, divided into good (GAF ≥ 65) and poor (GAF < 65). Aiming for a robust and interpretable prediction model, we employed a linear support vector machine and recursive feature elimination within a nested cross-validation design to obtain a lean set of predictors. Generalization to out-of-study samples was estimated using leave-one-site-out cross-validation. Prediction accuracies were above chance and ranged from 62.2% to 64.7% (symptomatic outcome), and 63.5–67.6% (global outcome). Leave-one-site-out cross-validation demonstrated the robustness of our models, with a minor drop in predictive accuracies of 2.3% on average. Important predictors included GAF scores, psychotic symptoms, quality of life, antipsychotics use, psychosocial needs, and depressive symptoms. These robust, albeit modestly accurate, long-term prognostic predictions based on lean predictor sets indicate the potential of machine learning models complementing clinical judgment and decision-making. Future model development may benefit from studies scoping patient’s and clinicians' needs in prognostication.
AB - Schizophrenia and related disorders have heterogeneous outcomes. Individualized prediction of long-term outcomes may be helpful in improving treatment decisions. Utilizing extensive baseline data of 523 patients with a psychotic disorder and variable illness duration, we predicted symptomatic and global outcomes at 3-year and 6-year follow-ups. We classified outcomes as (1) symptomatic: in remission or not in remission, and (2) global outcome, using the Global Assessment of Functioning (GAF) scale, divided into good (GAF ≥ 65) and poor (GAF < 65). Aiming for a robust and interpretable prediction model, we employed a linear support vector machine and recursive feature elimination within a nested cross-validation design to obtain a lean set of predictors. Generalization to out-of-study samples was estimated using leave-one-site-out cross-validation. Prediction accuracies were above chance and ranged from 62.2% to 64.7% (symptomatic outcome), and 63.5–67.6% (global outcome). Leave-one-site-out cross-validation demonstrated the robustness of our models, with a minor drop in predictive accuracies of 2.3% on average. Important predictors included GAF scores, psychotic symptoms, quality of life, antipsychotics use, psychosocial needs, and depressive symptoms. These robust, albeit modestly accurate, long-term prognostic predictions based on lean predictor sets indicate the potential of machine learning models complementing clinical judgment and decision-making. Future model development may benefit from studies scoping patient’s and clinicians' needs in prognostication.
UR - http://www.scopus.com/inward/record.url?scp=85117043447&partnerID=8YFLogxK
U2 - 10.1038/s41537-021-00162-3
DO - 10.1038/s41537-021-00162-3
M3 - Article
SN - 0920-9964
VL - 7
JO - npj Schizophrenia
JF - npj Schizophrenia
IS - 1
M1 - 34
ER -