Generative AI (GenAI) based on large language models (LLMs) is expected to improve the diagnosis and treatment of autoimmune diseases. We are studying how GenAI may affect the diagnosis of various complications of rheumatoid arthritis (RA). In a retrospective study using RA patients' EHR records, we will quantify physician adoption of GenAI predictions for RA complications and co-existing diseases. In a prospective observational study, we will assess the feasibility of using GenAI predictions as additional clinical information to help physicians make more complete diagnoses of RA complications and co-existing diseases, including complex, uncommon, or rare conditions.
Study Type
OBSERVATIONAL
Enrollment
100
Generative AI based on multiple large language models (LLMs) is used to predict potential complications and co-existing diseases in patients with rheumatoid arthritis using EHR data available at admission. Physicians use these AI predictions as additional information to adjust their diagnostic plans during differential diagnosis. The impact of this intervention on the final diagnoses at discharge will be measured. Before the prospective study, the adoptability of the generative AI prediction reports will be validated using EHR records from retrospective RA patients.
Guang'anmen Hospital of China Academy of Chinese Medical Sciences
Beijing, Beijing Municipality, China
RECRUITINGWill physicians adopt GenAI predictions in diagnosing RA complications?
In the routine care workflow, large language models (LLMs) are used to predict potential RA complications for each de-identified patient case and generate an AI report listing possible complications and co-existing diseases. Additional diagnostic tests are suggested to verify the predicted conditions. After reviewing the AI report, physicians immediately evaluate each disease prediction using a 5-point Likert scale (1 = complete disagreement; 2 = disagreement; 3 = neutral; 4 = agreement; 5 = complete agreement). The mean score is calculated as a measure of perceived prediction accuracy. Physicians also indicate whether each specific disease prediction could potentially be adopted or used to assist differential diagnosis (binary: 0 or 1). The percentage of positive adoption responses is calculated as a measure of potential adoption rate, or adoptability.
Time frame: Immediately after reviewing patient AI report on the day of admission.
To what extent are RA complication diagnoses actually affected by GenAI predictions?
Before patient discharge, physicians make final diagnoses and record which diagnosed complications or co-existing diseases were influenced by GenAI prediction information for each patient. The percentage of cases in which GenAI predictions affected the final diagnosis is calculated as a measure of AI's actual impact on routine diagnostic practice.
Time frame: Immediately after making the final diagnosis at discharge.
Quan Jiang Guang'anmen Hospital, China Academy of Chinese Medical Science
CONTACT
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.