Construct validity of six sentiment analysis methods in the text of encounter notes of patients with critical illness release_rmp4ov67fbfczezch2sbtrojdy

by Gary Weissman, Lyle H. Ungar, Michael O. Harhay, Katherine R. Courtright, Scott D. Halpern

Published in Journal of Biomedical Informatics by Elsevier BV.

2019   Volume 89, p114-121

Abstract

Sentiment analysis may offer insights into patient outcomes through the subjective expressions made by clinicians in the text of encounter notes. We analyzed the predictive, concurrent, convergent, and content validity of six sentiment methods in a sample of 793,725 multidisciplinary clinical notes among 41,283 hospitalizations associated with an intensive care unit stay. None of these approaches improved early prediction of in-hospital mortality using logistic regression models, but did improve both discrimination and calibration when using random forests. Additionally, positive sentiment measured by the CoreNLP (OR 0.04, 95% CI 0.002-0.55), Pattern (OR 0.09, 95% CI 0.04-0.17), sentimentr (OR 0.37, 95% CI 0.25-0.63), and Opinion (OR 0.25, 95% CI 0.07-0.89) methods were inversely associated with death on the concurrent day after adjustment for demographic characteristics and illness severity. Median daily lexical coverage ranged from 5.4% to 20.1%. While sentiment between all methods was positively correlated, their agreement was weak. Sentiment analysis holds promise for clinical applications but will require a novel domain-specific method applicable to clinical text.
In text/plain format

Archived Files and Locations

application/pdf  1.0 MB
file_geq3o24dnnan7ltwiea6tqqkg4
europepmc.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2018-12-14
Language   en ?
Journal Metadata
Not in DOAJ
In Keepers Registry
ISSN-L:  1532-0464
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 1f650c4b-ddae-479d-8a4a-1f63394f4d92
API URL: JSON