This study is a randomized controlled trial based on simulated clinical cases, aiming to establish a standardized evaluation system for PD physicians, to assess the differences in PD management quality between a workflow assisted by a PD-specialized large language model and physician-only decision-making, and to identify potential risks (such as generating obviously erroneous or even harmful recommendations). This simulated clinical case framework not only supports standardized and blinded evaluation, but also provides preliminary evidence for the model's effectiveness and safety before its deployment in real clinical settings, while avoiding direct impact on real patients.
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
TREATMENT
Masking
SINGLE
Enrollment
100
The peritoneal dialysis-specialized large language model (PD-LLM) used in this study was jointly developed by the Department of Nephrology at the First Affiliated Hospital of Sun Yat-sen University and Digital Health China (DHC).
The First Affiliated Hospital of Sun Yat-sen University
Guangzhou, Guangdong, China
Management Reasoning
Percent correct (range: 0 to 100) for each case.
Time frame: Within the 120-minute test period of the first test.
Domain-Specific Scores
Percent correct (range: 0 to 100) for each case in each domain.
Time frame: Within the 120-minute test period of the first test.
Severity of Potential Harm
The severity of potential harm will be classified as none, mild-to-moderate, or severe.
Time frame: Within the 120-minute test period of the first test.
Time per Scenario Case
The time (in seconds) participants spend per case.
Time frame: Within the 120-minute test period of the first test.
Self-Reported Confidence per Case
Scale 1-10. 10 represents being very confident.
Time frame: Within the 120-minute test period of the first test.
Difference between the Phys group's scores when tested with PD-LLM assistance and when assisted only by traditional search methods
range from -100 to 100
Time frame: After 1-2 months of washout of first test
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.