TY - JOUR
T1 - An extension minimal important difference credibility item addressing construct proximity is a reliable alternative to the correlation item
AU - Wang, Yuting
AU - Devji, Tahira
AU - Carrasco-Labra, Alonso
AU - Qasim, Anila
AU - Hao, Qiukui
AU - Kum, Elena
AU - Devasenapathy, Niveditha
AU - King, Madeleine T.
AU - Terluin, Berend
AU - Terwee, Caroline B.
AU - Walsh, Michael
AU - Furukawa, Toshi A.
AU - Tsujimoto, Yasushi
AU - Guyatt, Gordon H.
N1 - Funding Information: The authors thank Mark Phillips, Bradley C Johnston, Dena Zeraatkar, Meha Bhatt, Xuejing Jin, Romina Brignardello-Petersen, Olivia Urquhart, Farid Foroutan, Stefan Schandelmaier, Hector Pardo-Hernandez, Robin WM Vernooij, Hsiaomin Huang, Linan Zeng, Yamna Rizwan, Reed Siemieniuk, Lyubov Lytvyn, Zhikang Ye, Liam Yao, Vanessa Wong, Donald L Patrick, Shanil Ebrahim, Gihad Nesrallah, Holger J Schunemann, Mohit Bhandari, and Lehana Thabane for their contributions on the MID inventory and credibility instrument projects. The authors also thank Ying Wang, Maryam Ghadimi, Yaping Chang, Layla Bakaa, Sam Al-Rammahy, and Mike Ge for their contributions to the abstraction of anchor questions. Publisher Copyright: © 2023 Elsevier Inc.
PY - 2023/5/1
Y1 - 2023/5/1
N2 - Objectives: Minimal important difference (MID), the smallest change or difference that patients perceive as important, aids interpretation of change in patient-reported outcome measure (PROM) scores. A credibility instrument that assesses the methodological rigor of an anchor-based MID includes one core item addressing the correlation between the PROM and the anchor. However, the majority of MID studies in the literature fail to report the correlation. To address this issue, we extended the anchor-based MID credibility instrument by adding an item addressing construct proximity as an alternative to the correlation item. Study Design and Setting: Informed by an MID methodological survey, we added an alternative item—a subjective assessment of similarity of the constructs (i.e., construct proximity) between PROM and anchor—to the correlation item and generated principles for the assessment. We sampled 101 MIDs and analyzed the assessments performed by each pair of raters. By calculating weighted Cohen's kappa, we assessed the reliability of the assessments. Results: Construct proximity assessment is based on the anticipated association between the anchor and PROM constructs: the closer the anticipated association, the higher the rating. Our detailed principles address the most frequently used anchors: transition ratings, measures of satisfaction, other PROMs, and clinical measures. The assessments showed acceptable agreement (weighted kappa 0.74, 95% CI 0.55–0.94) between raters. Conclusion: In the absence of a reported correlation coefficient, construct proximity assessment provides a useful alternative in the credibility assessment of anchor-based MID estimates.
AB - Objectives: Minimal important difference (MID), the smallest change or difference that patients perceive as important, aids interpretation of change in patient-reported outcome measure (PROM) scores. A credibility instrument that assesses the methodological rigor of an anchor-based MID includes one core item addressing the correlation between the PROM and the anchor. However, the majority of MID studies in the literature fail to report the correlation. To address this issue, we extended the anchor-based MID credibility instrument by adding an item addressing construct proximity as an alternative to the correlation item. Study Design and Setting: Informed by an MID methodological survey, we added an alternative item—a subjective assessment of similarity of the constructs (i.e., construct proximity) between PROM and anchor—to the correlation item and generated principles for the assessment. We sampled 101 MIDs and analyzed the assessments performed by each pair of raters. By calculating weighted Cohen's kappa, we assessed the reliability of the assessments. Results: Construct proximity assessment is based on the anticipated association between the anchor and PROM constructs: the closer the anticipated association, the higher the rating. Our detailed principles address the most frequently used anchors: transition ratings, measures of satisfaction, other PROMs, and clinical measures. The assessments showed acceptable agreement (weighted kappa 0.74, 95% CI 0.55–0.94) between raters. Conclusion: In the absence of a reported correlation coefficient, construct proximity assessment provides a useful alternative in the credibility assessment of anchor-based MID estimates.
KW - Anchor-based minimal important difference
KW - Construct proximity
KW - Correlation
KW - Credibility assessment
KW - Patient-reported outcome measure
KW - Reliability
UR - https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85151413396&origin=inward
UR - https://www.ncbi.nlm.nih.gov/pubmed/36878330
U2 - https://doi.org/10.1016/j.jclinepi.2023.03.001
DO - https://doi.org/10.1016/j.jclinepi.2023.03.001
M3 - Article
C2 - 36878330
SN - 0895-4356
VL - 157
SP - 46
EP - 52
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
ER -