TY - JOUR
T1 - Methodological quality of systematic reviews of intraoperative neuromonitoring in thyroidectomy
T2 - A systematic review
AU - Sanabria, Alvaro
AU - Kowalski, Luiz P.
AU - Nixon, Iain
AU - Angelos, Peter
AU - Shaha, Ashok
AU - Owen, Randall P.
AU - Suarez, Carlos
AU - Rinaldo, Alessandra
AU - Ferlito, Alfio
AU - International Head and Neck Scientific Group
AU - Brakenhoff, RH
PY - 2019/6/1
Y1 - 2019/6/1
N2 - Importance: Systematic reviews and meta-Analyses are considered the best evidence for clinical decision making. Many reviews of intraoperative neuromonitoring (IONM) in thyroidectomy have conflicting results, owing in large part to methodological quality. Objective: To assess the methodological quality and the causes of heterogeneous results of systematic reviews that compare routine IONM vs visual identification of the recurrent laryngeal nerve (RLN) in patients undergoing thyroidectomy. Data Sources: A systematic search was performed of MEDLINE (PubMed), Embase, the Cochrane Library, LILACS (Literatura Latino Americana e do Caribe em Ciências da Saúde), Web of Science, and Google from January 1, 1968, through June 30, 2018. Data were analyzed from July 17 to November 30, 2018. Study Selection: Studies that mentioned performance of a systematic review/meta-Analysis during the search period. Data Extraction and Synthesis: Data including study characteristics, type of patients, numbers of nerves at risk, and temporary and definitive RLN paralysis by group were extracted. Data about methodological characteristics, type of statistical analysis and summary estimator, endorsement of systematic review/meta-Analysis guidelines, heterogeneity, publication bias, funding, conflict of interest, and statistical analysis were also recorded. The methodological quality was measured with the AMSTAR2 (A Measurement Tool to Assess Systematic Reviews) tool by 2 independent evaluators. Main Outcomes and Measures: Methodological quality. Results: The search identified 13 systematic reviews that included patients who underwent open or minimally invasive thyroidectomy, second operations, and a mixture of low-and high-risk procedures. The mean compliance with the AMSTAR2 overall criteria was 53% (range, 11%-83%); with critical criteria, 71% (range, 50%-94%). The percentage of nerves at risk from RCTs was 4.8%. The mean (SD) crude rate of definitive RLN paralysis was 0.81% (0.22%; median, 0.75% [range, 0.53%-1.30%]) in the monitoring group and 1.14% (0.56%; median, 0.96% [range, 0.57%-2.56%]) in the control group. Conclusions and Relevance: A substantial number of systematic reviews of IONM in thyroidectomy have conflicting results, but their mean methodological quality is critically low. Design of a systematic review should comply with methodological standards and recommendations to offer relevant and practical information for decision making.
AB - Importance: Systematic reviews and meta-Analyses are considered the best evidence for clinical decision making. Many reviews of intraoperative neuromonitoring (IONM) in thyroidectomy have conflicting results, owing in large part to methodological quality. Objective: To assess the methodological quality and the causes of heterogeneous results of systematic reviews that compare routine IONM vs visual identification of the recurrent laryngeal nerve (RLN) in patients undergoing thyroidectomy. Data Sources: A systematic search was performed of MEDLINE (PubMed), Embase, the Cochrane Library, LILACS (Literatura Latino Americana e do Caribe em Ciências da Saúde), Web of Science, and Google from January 1, 1968, through June 30, 2018. Data were analyzed from July 17 to November 30, 2018. Study Selection: Studies that mentioned performance of a systematic review/meta-Analysis during the search period. Data Extraction and Synthesis: Data including study characteristics, type of patients, numbers of nerves at risk, and temporary and definitive RLN paralysis by group were extracted. Data about methodological characteristics, type of statistical analysis and summary estimator, endorsement of systematic review/meta-Analysis guidelines, heterogeneity, publication bias, funding, conflict of interest, and statistical analysis were also recorded. The methodological quality was measured with the AMSTAR2 (A Measurement Tool to Assess Systematic Reviews) tool by 2 independent evaluators. Main Outcomes and Measures: Methodological quality. Results: The search identified 13 systematic reviews that included patients who underwent open or minimally invasive thyroidectomy, second operations, and a mixture of low-and high-risk procedures. The mean compliance with the AMSTAR2 overall criteria was 53% (range, 11%-83%); with critical criteria, 71% (range, 50%-94%). The percentage of nerves at risk from RCTs was 4.8%. The mean (SD) crude rate of definitive RLN paralysis was 0.81% (0.22%; median, 0.75% [range, 0.53%-1.30%]) in the monitoring group and 1.14% (0.56%; median, 0.96% [range, 0.57%-2.56%]) in the control group. Conclusions and Relevance: A substantial number of systematic reviews of IONM in thyroidectomy have conflicting results, but their mean methodological quality is critically low. Design of a systematic review should comply with methodological standards and recommendations to offer relevant and practical information for decision making.
UR - http://www.scopus.com/inward/record.url?scp=85064243194&partnerID=8YFLogxK
U2 - https://doi.org/10.1001/jamaoto.2019.0092
DO - https://doi.org/10.1001/jamaoto.2019.0092
M3 - Article
C2 - 30973598
SN - 2168-6181
VL - 145
SP - 563
EP - 573
JO - JAMA Otolaryngology - Head and Neck Surgery
JF - JAMA Otolaryngology - Head and Neck Surgery
IS - 6
ER -