Establishing thresholds for meaningful within-individual change using longitudinal item response theory

Jakob Bue Bjorner, Berend Terluin, Andrew Trigg, Jinxiang Hu, Keri J. S. Brady, Pip Griffiths

Research output: Contribution to journalArticleAcademicpeer-review

6 Citations (Scopus)

Abstract

Purpose: Thresholds for meaningful within-individual change (MWIC) are useful for interpreting patient-reported outcome measures (PROM). Transition ratings (TR) have been recommended as anchors to establish MWIC. Traditional statistical methods for analyzing MWIC such as mean change analysis, receiver operating characteristic (ROC) analysis, and predictive modeling ignore problems of floor/ceiling effects and measurement error in the PROM scores and the TR item. We present a novel approach to MWIC estimation for multi-item scales using longitudinal item response theory (LIRT). Methods: A Graded Response LIRT model for baseline and follow-up PROM data was expanded to include a TR item measuring latent change. The LIRT threshold parameter for the TR established the MWIC threshold on the latent metric, from which the observed PROM score MWIC threshold was estimated. We compared the LIRT approach and traditional methods using an example data set with baseline and three follow-up assessments differing by magnitude of score improvement, variance of score improvement, and baseline-follow-up score correlation. Results: The LIRT model provided good fit to the data. LIRT estimates of observed PROM MWIC varied between 3 and 4 points score improvement. In contrast, results from traditional methods varied from 2 to 10 points—strongly associated with proportion of self-rated improvement. Best agreement between methods was seen when approximately 50% rated their health as improved. Conclusion: Results from traditional analyses of anchor-based MWIC are impacted by study conditions. LIRT constitutes a promising and more robust analytic approach to identifying thresholds for MWIC.
Original languageEnglish
JournalQuality of life research
Early online date2022
DOIs
Publication statusE-pub ahead of print - 2022

Keywords

  • Interpretation of Patient-Reported Outcomes
  • Item response theory
  • Longitudinal studies
  • Meaningful within-individual change
  • Minimal important change
  • Minimal important difference

Cite this