AI Can Improve Identification of Social Determinants of Health in EHRs
By Elana Gotkine HealthDay Reporter
FRIDAY, Jan. 12, 2024 -- Large language models (LLMs) can potentially improve the identification of social determinants of health (SDoH) in electronic health records (EHRs), according to a study published online Jan. 11 in npj Digital Medicine.
Noting that SDoH play an important role in patient outcomes but their documentation is often missing or incomplete in EHRs, Marco Guevara, from Mass General Brigham and Harvard Medical School in Boston, and colleagues examined the optimal methods for using LLMs to extract six SDoH categories from narrative text in the EHR: employment, housing, transportation, parental status, relationship, and social support.
The researchers found that the best-performing models were fine-tuned Flan-T5 XL and Flan-T5 XXL for any SDoH mentions and adverse SDoH mentions, respectively. Across models and architecture, there was variation in the addition of LLM-generated synthetic data to training, but this improved the performance of small Flan-T5 models. In the zero- and few-shot setting, the best finetuned models outperformed zero- and few-shot performance of ChatGPT models, except GPT4 with 10-shot prompting for adverse SDoH. When race/ethnicity and gender descriptors were added to the text, finetuned models were less likely than ChatGPT to change their prediction, suggesting less algorithmic bias. Overall, 93.8 percent of patients with adverse SDoH were identified with the models, while International Classification of Diseases-Version 10 codes captured 2.0 percent.
"In the future, these models could improve our understanding of drivers of health disparities by improving real-world evidence and could directly support patient care by flagging patients who may benefit most from proactive resource and social work referral," the authors write.
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted January 2024
Read this next
AI-Assisted Contours Superior to Cognitively Defined Prostate Cancer Contours
WEDNESDAY, July 3, 2024 -- Artificial intelligence (AI)-assisted definition of prostate cancer contours reduces underestimation of the extent of prostate cancer, according to a...
Mean Cost of Bringing New Drug to U.S. Market Is $879.3 Million
TUESDAY, July 2, 2024 -- The mean cost of developing a new drug for the U.S. market is estimated to be $879.3 million when both drug development failure and capital costs are...
Patient–Primary Care Provider Language Concordance Tied to Better Outcomes
TUESDAY, July 2, 2024 -- Patient-family physician language concordance is associated with a lower risk for adverse outcomes, according to a study published online June 3...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.