NCT07505862

Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination

Scientific Validity Assessment and Optimization of AI-Generated A3/A4 Type Questions for the Chinese Medical Licensing Examination: An Empirical Analysis Based on the "Answering-Generating" Closed Loop and Transformation of Competency Assessment

• Status: Recruiting
• Phase: —
• Study type: Observational
• Enrollment: 20 (estimated)
• Sponsor: Guangdong Provincial People's Hospital · Academic / Other
• Sex: All
• Age: 18 Years – 60 Years
• Healthy volunteers: Accepted

Summary

This is a cross-sectional study that primarily employs quantitative analysis, supplemented by qualitative assessment. The research is conducted in two stages: Phase I consists of a model performance comparison experiment, and Phase II involves an item quality evaluation experiment. The entire study adheres to the principles of single-blinding, randomization, and standardization to ensure scientific rigor and reproducibility. The single-blind design is implemented during the "standardized testing" phase, where the system intersperses AI-generated items with those authored by human experts. Participants remain blinded to the source of each item (AI-generated vs. human-authored) throughout the testing and scoring processes, thereby ensuring the objectivity of the evaluation results.

Conditions

• AI (Artificial Intelligence)

Timeline

• Start date: 2025-10-01
• Primary completion: 2026-03-30
• Completion: 2026-03-30
• First posted: 2026-04-01
• Last updated: 2026-04-01

Locations

1 site across 1 country: China