TY - JOUR
T1 - Psychometrics of the observational scales of the Utrecht Scale for Evaluation of Rehabilitation (USER)
T2 - Content and structural validity, internal consistency and reliability
AU - Jansen, Michael
AU - Doornebosch, Arno J.
AU - de Waal, Margot WM
AU - Wattel, Elizabeth M.
AU - Visser, Dennis
AU - Spek, Bea
AU - Smit, Ewout B.
N1 - Funding Information: This study was supported by Verenso, the Dutch Association of Elderly Care Physicians (Verenso Grant 2017). Verenso had no active role in collection, analysis and interpretation of the data and in the writing of the manuscript. Publisher Copyright: © 2021 The Authors
PY - 2021/11/1
Y1 - 2021/11/1
N2 - Introduction: : Establish content and structural validity, internal consistency, inter-rater reliability, and measurement error of the physical and cognitive scales of the Utrecht Scale for Evaluation clinical Rehabilitation (USER) in geriatric rehabilitation. Material and methods: : First, an expert consensus-meeting (N=7) was organised for content validity wherein scale content validity index (CVI) was measured. Second, in a sample of geriatric rehabilitation patient structural validity (N=616) was assessed by confirmatory factor analyses for exploring unidimensionality. Cut-off criteria were: Root Mean Square Error of Approximation (RMSEA) ≤0.08; Comparative Fit Index (CFI) and Tucker Lewis Index (TLI) ≥0.95. Local independence (residual correlation<0.20) and monotonicity (Hi-coefficient ≥0.30 and Hs-coefficient ≥0.50) were also calculated. Cronbach alphas were calculated for internal consistency. Alpha's > 0.7 was considered adequate. Third, two nurses independently administered the USER to 37 patients. Intraclass-correlation coefficients (ICC) were calculated for inter-rater reliability (IRR), standard error of measurement (SEM) and Smallest Detectable Change (SDC). Results: : The CVI for physical functioning was moderate (0.73) and excellent for cognitive functioning (0.97). Structural validity physical scale was acceptable (CFI;0.95, TLI;0.93, RMSEA;0.07, ECV;0.78, OmegaH;0.87; Monotonicity;(Hi;0.52-0.75 and Hs;0.63)). Cognitive scale was good (CFI;0.98, TLI;0.96, RMSEA;0.05, ECV;0.66 and OmegaH;0.90. Monotonicity;(Hi;0.30 –0.70 and Hs;0.61)). Cronbach's alpha were high: physical scale;0.92 and cognitive scale;0.94. Reliability physical scale ICC;0.94, SEM;5 and SDC;14 and cognitive scale ICC;0.88, SEM;5 and SDC;13. Conclusion: : The observational scales of the USER have shown sufficient content and structural validity, internal consistency, and interrater reliability for measuring physical and cognitive function in geriatric rehabilitation. Trial registration: : N/A
AB - Introduction: : Establish content and structural validity, internal consistency, inter-rater reliability, and measurement error of the physical and cognitive scales of the Utrecht Scale for Evaluation clinical Rehabilitation (USER) in geriatric rehabilitation. Material and methods: : First, an expert consensus-meeting (N=7) was organised for content validity wherein scale content validity index (CVI) was measured. Second, in a sample of geriatric rehabilitation patient structural validity (N=616) was assessed by confirmatory factor analyses for exploring unidimensionality. Cut-off criteria were: Root Mean Square Error of Approximation (RMSEA) ≤0.08; Comparative Fit Index (CFI) and Tucker Lewis Index (TLI) ≥0.95. Local independence (residual correlation<0.20) and monotonicity (Hi-coefficient ≥0.30 and Hs-coefficient ≥0.50) were also calculated. Cronbach alphas were calculated for internal consistency. Alpha's > 0.7 was considered adequate. Third, two nurses independently administered the USER to 37 patients. Intraclass-correlation coefficients (ICC) were calculated for inter-rater reliability (IRR), standard error of measurement (SEM) and Smallest Detectable Change (SDC). Results: : The CVI for physical functioning was moderate (0.73) and excellent for cognitive functioning (0.97). Structural validity physical scale was acceptable (CFI;0.95, TLI;0.93, RMSEA;0.07, ECV;0.78, OmegaH;0.87; Monotonicity;(Hi;0.52-0.75 and Hs;0.63)). Cognitive scale was good (CFI;0.98, TLI;0.96, RMSEA;0.05, ECV;0.66 and OmegaH;0.90. Monotonicity;(Hi;0.30 –0.70 and Hs;0.61)). Cronbach's alpha were high: physical scale;0.92 and cognitive scale;0.94. Reliability physical scale ICC;0.94, SEM;5 and SDC;14 and cognitive scale ICC;0.88, SEM;5 and SDC;13. Conclusion: : The observational scales of the USER have shown sufficient content and structural validity, internal consistency, and interrater reliability for measuring physical and cognitive function in geriatric rehabilitation. Trial registration: : N/A
KW - Clinimetrics
KW - Cognitive functioning
KW - Geriatric rehabilitation
KW - Physical functioning
KW - Post-acute care
UR - http://www.scopus.com/inward/record.url?scp=85118285738&partnerID=8YFLogxK
U2 - https://doi.org/10.1016/j.archger.2021.104509
DO - https://doi.org/10.1016/j.archger.2021.104509
M3 - Article
C2 - 34509903
SN - 0167-4943
VL - 97
SP - 104509
JO - Archives of Gerontology and Geriatrics
JF - Archives of Gerontology and Geriatrics
M1 - 104509
ER -