NCT07166692

Evaluation of a Retrieval Augmented Large Language Model as a Diagnostic Copilot in Rheumatology

• Status: Completed
• Phase: N/A
• Study type: Interventional
• Enrollment: 82 (actual)
• Sponsor: Philipps University Marburg · Academic / Other
• Sex: All
• Age: —
• Healthy volunteers: Accepted

Summary

This trial evaluates whether providing physicians with access to Prof. Valmed, a clinical decision support medical product, improves identification of rheumatic diseases and formulation of differential diagnoses compared with conventional decision support.

Detailed description

Advanced AI, particularly large language models, shows promise for enhancing clinical reasoning, yet most systems such as ChatGPT are not certified as medical products. Prof. Valmed is a clinical decision support medical product designed to assist physicians in diagnostic decision making. Given frequent referral problems and diagnostic delays in rheumatology, evaluating such support is highly relevant for clinical workflows. This randomized controlled trial will test whether access to Prof. Valmed improves physicians' diagnostic performance in cases of suspected rheumatic disease compared with conventional decision support. Participants will be randomized to either use Prof. Valmed or rely on conventional tools while working through standardized clinical cases. For each case, participants will submit up to three differential diagnoses and a confidence rating. Independent reviewers, blinded to group allocation, will adjudicate accuracy. Findings will clarify the benefits and limitations of integrating Prof. Valmed into routine practice.

Conditions

• Diagnosis

Interventions

Type	Name	Description
OTHER	Prof. Valmed	Prof Valmed. decision support system.

Timeline

• Start date: 2025-10-12
• Primary completion: 2026-02-01
• Completion: 2026-02-01
• First posted: 2025-09-10
• Last updated: 2026-04-08

Locations

1 site across 1 country: Germany