This study is a multicenter randomized controlled trial evaluating the effectiveness and safety of EyeAgent, a multimodal artificial intelligence (AI) agent designed to assist ophthalmologists in clinical decision-making. Participants will be recruited from ophthalmology clinics and hospitals in Hong Kong and mainland China. The AI agent acts as a digital co-pilot, analyzing patient images and clinical history to provide diagnostic and management recommendations. The trial aims to determine whether the use of the AI agent improves diagnostic accuracy, treatment decision-making performance, report generation, workflow efficiency, and user satisfaction compared to standard clinical practice.
This multicenter, randomized controlled trial aims to evaluate the integration of EyeAgent, a multimodal artificial intelligence (AI) agent, in real-world clinical settings. The AI system is designed to support clinicians by analyzing patient data, including ocular images and electronic health records, to aid in image interpretation, diagnosis, and treatment planning. A total of 300 participants will be randomly assigned to either an AI-assisted care arm or a standard care arm. In the AI-assisted arm, clinicians review the comprehensive report generated by AI agent as a supportive tool before finalizing their independent decisions. The study comprehensively measures diagnostic accuracy, the rate of inappropriate treatment decisions, report generation, workflow efficiency, and user questionnaire. By comparing these two groups, the trial aims to provide robust evidence on the effectiveness and practical utility of AI-driven clinical decision support in ophthalmology, with the goal of enhancing both the quality and efficiency of patient care.
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
OTHER
Masking
DOUBLE
Enrollment
300
EyeAgent is a multimodal AI agent assistant for ophthalmology that integrates imaging, electronic health records, and curated clinical knowledge. In this arm, EyeAgent supports clinicians in clinical consultation, including report generation, diagnostic interpretation, and treatment planning.
The Hong Kong Polytechnic University
Hong Kong, China
Diagnostic accuracy rate
Proportion of diagnoses consistent with a reference expert panel.
Time frame: Immediately after the intervention.
Rate of inappropriate treatment decisions
The frequency of treatment recommendations (e.g., injection, laser therapy, or observation) that deviate from clinical guidelines as determined by the senior expert panel gold standard. Expert adjudication is conducted post-hoc after the enrollment phase concludes.
Time frame: Immediately after the intervention.
Report quality
Completeness and clarity of clinical reports, assessed via a standardized scoring rubric.
Time frame: Within 1 month after enrollment.
Clinician confidence
Clinician's self-rated confidence in diagnosis and treatment plans post-consultation.
Time frame: Immediately after the intervention.
Workflow efficiency
Time elapsed from image acquisition to final diagnosis and report completion.
Time frame: During the index diagnostic session.
Satisfaction and usability score
Evaluation of the AI agent's user-friendliness, helpfulness, and logical transparency, measured via a structured 5-point Likert scale questionnaire.
Time frame: At the end of each clinician's participation period, approximately 2 months.
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.