TY - JOUR
T1 - Analysis of Online Reviews of Orthopaedic Surgeons and Orthopaedic Practices Using Natural Language Processing
AU - Langerhuizen, David W. G.
AU - Brown, Laura E.
AU - Doornberg, Job N.
AU - Ring, David
AU - Kerkhoffs, Gino M. M. J.
AU - Janssen, Stein J.
N1 - Publisher Copyright: Copyright © 2021 by the American Academy of Orthopaedic Surgeons.
PY - 2021/4/15
Y1 - 2021/4/15
N2 - BACKGROUND: There is growing interest in measuring and improving patient experience. Machine learning-based natural language processing techniques may help identify instructive themes in online comments written by patients about their healthcare provider. Separating individual surgeon and orthopaedic office reviews, we analyzed themes that are discussed based on the rating category, the association with review length, the number of people posting more than one review for a surgeon or office, the mean number of reviews per rating category, and the difference in review tones. METHODS: On Yelp.com, we collected 11,614 free-text reviews-together with a one- to five-star rating-of orthopaedic surgeons. Using natural language processing, we identified the most frequently occurring word combinations among rating categories. Themes were derived by categorizing word combinations. Dominant tones (emotional and language styles) were assessed by the IBM Watson Tone Analyzer. We calculated chi-square tests for linear trend and Spearman's rank correlation coefficients to assess differences among rating category. RESULTS: For individual surgeons and orthopaedic offices, themes such as logistics, care and compassion, trust, recommendation, and customer service varied among rating categories. More positive reviews are shorter for individual surgeons and orthopaedic offices, while rating category was comparable among people posting more than one review for both groups. Tones of joy and confidence were associated with higher ratings. Sadness and tentative tones were associated with lower ratings. DISCUSSION: For individual orthopaedic surgeons and orthopaedic offices, patient experience may be influenced mostly by the patient-clinician relationship. Training in more effective communication strategies may help improve self-reported patient experience.
AB - BACKGROUND: There is growing interest in measuring and improving patient experience. Machine learning-based natural language processing techniques may help identify instructive themes in online comments written by patients about their healthcare provider. Separating individual surgeon and orthopaedic office reviews, we analyzed themes that are discussed based on the rating category, the association with review length, the number of people posting more than one review for a surgeon or office, the mean number of reviews per rating category, and the difference in review tones. METHODS: On Yelp.com, we collected 11,614 free-text reviews-together with a one- to five-star rating-of orthopaedic surgeons. Using natural language processing, we identified the most frequently occurring word combinations among rating categories. Themes were derived by categorizing word combinations. Dominant tones (emotional and language styles) were assessed by the IBM Watson Tone Analyzer. We calculated chi-square tests for linear trend and Spearman's rank correlation coefficients to assess differences among rating category. RESULTS: For individual surgeons and orthopaedic offices, themes such as logistics, care and compassion, trust, recommendation, and customer service varied among rating categories. More positive reviews are shorter for individual surgeons and orthopaedic offices, while rating category was comparable among people posting more than one review for both groups. Tones of joy and confidence were associated with higher ratings. Sadness and tentative tones were associated with lower ratings. DISCUSSION: For individual orthopaedic surgeons and orthopaedic offices, patient experience may be influenced mostly by the patient-clinician relationship. Training in more effective communication strategies may help improve self-reported patient experience.
UR - http://www.scopus.com/inward/record.url?scp=85104047005&partnerID=8YFLogxK
U2 - https://doi.org/10.5435/JAAOS-D-20-00288
DO - https://doi.org/10.5435/JAAOS-D-20-00288
M3 - Article
C2 - 32796371
SN - 1067-151X
VL - 29
SP - 337
EP - 344
JO - Journal of the American Academy of Orthopaedic Surgeons
JF - Journal of the American Academy of Orthopaedic Surgeons
IS - 8
ER -