AI Model Can Respond Appropriately to Ophthalmology Questions
Medically reviewed by Drugs.com.
By Elana Gotkine HealthDay Reporter
FRIDAY, Aug. 25, 2023 -- Large language models (LLMs) like ChatGPT can respond to patient-written ophthalmology questions and usually generate appropriate responses, according to a study published online Aug. 22 in JAMA Network Open.
Isaac A. Bernstein, from Stanford University in California, and colleagues examined the quality of ophthalmology advice generated by an LLM chatbot compared with ophthalmologist-written advice. The study used deidentified data from an online medical forum, in which patient questions received responses written by ophthalmologists. A masked panel of eight board-certified ophthalmologists were asked to differentiate between answers generated by the ChatGPT chatbot and answers from ophthalmologists.
Two hundred pairs of user questions and answers were assessed. The researchers found that the mean accuracy was 61.3 percent for differentiating artificial intelligence (AI) and human responses. Of 800 assessments of chatbot-written answers, 21.0 and 64.6 percent were marked as human-written and AI-written, respectively. Chatbot answers were more often rated as probably or definitely written by AI compared with human answers. The likelihood of chatbot answers containing incorrect or inappropriate material and likelihood of harm was comparable with human answers.
"We intend for this study to catalyze more extensive and nuanced dialogue and joint efforts surrounding the use of LLMs in ophthalmology among various health care stakeholders, including patients, clinicians, researchers, and policy makers," the authors write. "The primary goal is to prudently leverage these early research findings to shape the responsible implementation of LLMs in the field of ophthalmology."
Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.
© 2024 HealthDay. All rights reserved.
Posted August 2023
Read this next
Micronutrient Supplementation Slows Geographic Atrophy Progression
FRIDAY, July 19, 2024 -- Oral micronutrient supplementation slows geographic atrophy (GA) progression in age-related macular degeneration (AMD), according to a study published...
Ophthalmologic Manifestations of Acute Leukemia Are Heterogeneous
WEDNESDAY, July 17, 2024 -- Ophthalmologic manifestations of acute leukemia are heterogeneous and detectable at initial presentation or relapse, according to a study published...
Self-Imposed Use Cessation Dates Tied to Ophthalmic Drop Waste
TUESDAY, July 16, 2024 -- Self-imposed use cessation dates (SUCD) for multiuse eye drop bottles leads to significant drug waste and associated costs, according to a report...
More news resources
- FDA Medwatch Drug Alerts
- Daily MedNews
- News for Health Professionals
- New Drug Approvals
- New Drug Applications
- Drug Shortages
- Clinical Trial Results
- Generic Drug Approvals
Subscribe to our newsletter
Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.