TY - JOUR
T1 - Assessing the reliability of the OMERACT juvenile idiopathic arthritis magnetic resonance scoring system for temporomandibular joints (JAMRIS-TMJ)
AU - Tolend, Mirkamal
AU - Doria, Andrea S.
AU - Meyers, Arthur B.
AU - Larheim, Tore A.
AU - Abramowicz, Shelly
AU - Aguet, Julien
AU - Appenzeller, Simone
AU - Arvidsson, Linda Z.
AU - Averill, Lauren W.
AU - Feldman, Brian M.
AU - Guleria, Saurabh
AU - Clemente, Emilio J. Inarejos
AU - Jaremko, Jacob L.
AU - Junhasavasdikul, Thitiporn
AU - von Kalle, Thekla
AU - Kirkhus, Eva
AU - Koos, Bernd
AU - Miller, Elka
AU - Moineddin, Rahim
AU - Panwar, Jyoti
AU - Peacock, Zachary S.
AU - Resnick, Cory M.
AU - van Rossum, Marion A.
AU - Stimec, Jennifer
AU - Tomlinson, George
AU - Tzaribachev, Nikolay
AU - Kellenberger, Christian J.
N1 - Funding Information: Funding: Mirkamal Tolend was supported by research scholarship awards from Queen Elizabeth II/Edward Dunlop foundation, Peterborough K. M. Hunter Charitable Foundation, The Hospital for Sick Children ResTraComp, Ontario Graduate Scholarship and Mergelas Family foundation for this study. Publisher Copyright: © 2021 by the authors. Licensee MDPI, Basel, Switzerland.
PY - 2021/9/1
Y1 - 2021/9/1
N2 - Contrast-enhanced magnetic resonance imaging (MRI) remains the most comprehensive modality to assess juvenile idiopathic arthritis (JIA)-related inflammation and osteochondral damage in the temporomandibular joints (TMJ). This study tested the reliability of a new JIA MRI scoring system for TMJ (JAMRIS-TMJ) and the impact of variations in calibration and reader specialty. Thirty-one MRI exams of bilateral TMJs were scored independently using the JAMRIS-TMJ by 20 readers consisting of radiologists and non-radiologist clinicians in three reading groups, with or without a calibrating atlas and/or tutorial. The inter-reader reliability in the multidisciplinary cohort assessed by the generalizability coefficient was 0.61–0.67 for the inflammatory and 0.66–0.74 for the damage domain. The atlas and tutorial did not improve agreement within radiologists, but improved the agreement between radiologist and non-radiologist groups. Agreements between different calibration levels were 0.02 to 0.08 lower by the generalizability coefficient compared to agreement within calibration levels; agreement between specialty groups was 0.04 to 0.10 lower than within specialty groups. Averaging two radiologists raised the reliability above 0.8 for both domains. Therefore, the reliability of JAMRIS-TMJ was moderate-to-good depending on the presence of specialty and calibration differences. The atlas and tutorial are necessary to improve reliability when the reader cohort consists of multiple specialties.
AB - Contrast-enhanced magnetic resonance imaging (MRI) remains the most comprehensive modality to assess juvenile idiopathic arthritis (JIA)-related inflammation and osteochondral damage in the temporomandibular joints (TMJ). This study tested the reliability of a new JIA MRI scoring system for TMJ (JAMRIS-TMJ) and the impact of variations in calibration and reader specialty. Thirty-one MRI exams of bilateral TMJs were scored independently using the JAMRIS-TMJ by 20 readers consisting of radiologists and non-radiologist clinicians in three reading groups, with or without a calibrating atlas and/or tutorial. The inter-reader reliability in the multidisciplinary cohort assessed by the generalizability coefficient was 0.61–0.67 for the inflammatory and 0.66–0.74 for the damage domain. The atlas and tutorial did not improve agreement within radiologists, but improved the agreement between radiologist and non-radiologist groups. Agreements between different calibration levels were 0.02 to 0.08 lower by the generalizability coefficient compared to agreement within calibration levels; agreement between specialty groups was 0.04 to 0.10 lower than within specialty groups. Averaging two radiologists raised the reliability above 0.8 for both domains. Therefore, the reliability of JAMRIS-TMJ was moderate-to-good depending on the presence of specialty and calibration differences. The atlas and tutorial are necessary to improve reliability when the reader cohort consists of multiple specialties.
KW - Generalizability theory
KW - Juvenile idiopathic arthritis
KW - Magnetic resonance imaging
KW - Outcome measure
KW - Reliability
KW - Temporomandibular joints
UR - http://www.scopus.com/inward/record.url?scp=85114309155&partnerID=8YFLogxK
U2 - https://doi.org/10.3390/jcm10184047
DO - https://doi.org/10.3390/jcm10184047
M3 - Article
C2 - 34575158
SN - 2077-0383
VL - 10
JO - Journal of clinical medicine
JF - Journal of clinical medicine
IS - 18
M1 - 4047
ER -