This study conducted a randomized controlled trial using clinical vignettes to evaluate differences in the quality of PD management among two large language model-assisted workflows and a physician-only decision-making process, and to identify potential risks (e.g., generating clearly erroneous or even harmful suggestions).
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
TREATMENT
Masking
SINGLE
Enrollment
150
The peritoneal dialysis-specialized large language model (PD-LLM) used in this study was jointly developed by the Department of Nephrology at the First Affiliated Hospital of Sun Yat-sen University and Digital Health China (DHC).
Participants were permitted to ask the LLM any questions related to the clinical scenarios. However, they were explicitly instructed to critically evaluate the model's suggestions and to take full responsibility for the final clinical plans.
Sixiu Chen
Guangzhou, Guangdong, China
Management Reasoning
Percent correct (range: 0 to 100) for each case.
Time frame: Within 90-min study
Domain-Specific Scores
Percent correct (range: 0 to 100) for each case.
Time frame: within 90-min study.
Severity of Potential Harm
The severity of potential harm will be classified as none, mild-to-moderate, or severe.
Time frame: Within 90-min study.
Time Spent on Management
The time participants spend per case.
Time frame: Within 90-min study.
Self-Reported Confidence per Case
Scale 1-10. 10 represents being very confident.
Time frame: Within 90-min study.
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.