NCT07183891

Performance of Large Language Models for Structured Recognition and Refractive Prediction

Head-to-Head Evaluation of ChatGPT 4o, GPT-5, and DeepSeek for Structured Extraction, Toric IOL Recommendation, and Refractive Prediction

• Status: Recruiting
• Phase: —
• Study type: Observational
• Enrollment: 100 (estimated)
• Sponsor: Jin Yang · Academic / Other
• Sex: All
• Age: 18 Years
• Healthy volunteers: Not accepted

Summary

We conducted a single-center, retrospective observational study to evaluate large language models (ChatGPT 4o, GPT-5, DeepSeek) for automated interpretation of de-identified IOLMaster 700 reports provided as raster images. Models produced structured biometric extraction, toric IOL recommendation, and refractive predictions (sphere, cylinder, axis). Primary outcomes included parameter-level agreement and refractive error metrics; secondary outcomes included decision-support performance for toric IOL selection and agreement on ordered T-codes. No clinical intervention was performed.

Detailed description

This study compares three large language models accessed in their native configurations, without fine-tuning or external tools. For each examination, the original IOLMaster 700 report image was supplied without manual annotation or pre-processing. A standardized instruction required: (i) structured extraction of AL, ACD, LT, WTW, K1/K2 and axes, ΔK, TK1/TK2 and axes, and ΔTK; (ii) binary toric candidacy and T-code according to institutional ALCON mapping; and (iii) refractive recommendations (sphere, cylinder, implantation axis). Each model generated three independent outputs per case. De-identification and IRB oversight (waiver of consent) were implemented according to institutional policy. The unit of enrollment is participants (n=54), with outcomes analyzed per eye (162 eyes) and per model generation where applicable.

Conditions

• Cataract

Timeline

• Start date: 2025-08-01
• Primary completion: 2030-12-31
• Completion: 2035-12-31
• First posted: 2025-09-19
• Last updated: 2025-09-19

Locations

1 site across 1 country: China