AI Shows Good Clinical Knowledge, Reasoning for Eye Issues
By Lori Solomon HealthDay Reporter
FRIDAY, April 26, 2024 -- Large language models (LLMs) are approaching expert-level knowledge and reasoning skills in ophthalmology, according to a study published online April 17 in PLOS Digital Health.
Arun James Thirunavukarasu, M.B., B.Chir., from University of Oxford in the United Kingdom, and colleagues evaluated the clinical potential of state-of-the-art LLMs in ophthalmology. Responses to 87 questions were compared for GPT-3.5, GPT-4, PaLM 2, LLaMA, expert ophthalmologists, and doctors in training.
The researchers found that the performance of GPT-4 (69 percent) was superior to performance of GPT-3.5 (48 percent), LLaMA (32 percent), and PaLM 2 (56 percent) and compared favorably with expert ophthalmologists (median, 76 percent), ophthalmology trainees (median, 59 percent), and unspecialized junior doctors (median, 43 percent). Low agreement between LLMs and doctors was due to idiosyncratic differences in knowledge and reasoning, with overall consistency across individuals and type. Grading ophthalmologists preferred GPT-4 responses over GPT-3.5 due to higher accuracy and relevance.
"LLMs are approaching expert-level ophthalmological knowledge and reasoning, and may be useful for providing eye-related advice where access to health care professionals is limited," the authors write. "Further research is required to explore potential avenues of clinical deployment."
One author disclosed a patent on a deep learning system to detect retinal disease.
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted April 2024
Read this next
Prevalence of Skin Cancer Varies for Sexual Minority, Heterosexual Adults
FRIDAY, July 19, 2024 -- With respect to their lifetime prevalence of skin cancer, sexual minority (SM) adults differ across racial and ethnic groups and among males and females...
Concussions in Children Less Likely to Be Related to Sport
FRIDAY, July 19, 2024 -- For children aged 5 through 12 years with concussion, recreation-related concussion (RRC) and non-sport or recreation-related concussion (non-SRRC) occur...
Neighborhood Disadvantage Metrics Tied to Stress Genes in Prostate Cancer
FRIDAY, July 19, 2024 -- Expression of several stress-related genes in prostate tumors is elevated among men residing in disadvantaged neighborhoods, according to a study...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.