The goal of this clinical trial is to learn about how Urogynecology patients use Artificial Intelligence (AI) Chatbots like ChatGPT, and how it affects healthcare decision making. The main question\[s\] it aims to answer are: * How does the AI Chatbot affect participants' understanding of diagnoses and participant satisfaction with a urogynecology consultation? * How accurate is the chatbot-provided diagnosis and counseling information? Participants will be asked to use the ChatGPT chatbot and ask it questions about the main problem the participant is seeing the doctor for, and will also be asked to fill out some questionnaires. Researchers will compare using the Chatbot before the visit, after the visit, or not at all to see if the way participants understand the information changes based on timing of use.
Artificial Intelligence (AI) in medicine and the use of machine learning to improve patient care and outcomes is a quickly developing field. Interest is building in the use and accuracy of AI chatbot programs such as ChatGPT for patient diagnosis and counseling. A recent study of Chat GPT accuracy compared with patient pamphlets about pelvic organ prolapse found comparable accuracy and completeness.Given the novelty of this field, no current literature exists regarding the use of AI chatbot technology for patient care and patient counseling in Urogynecology. This will be a single-center, prospective, randomized, non-blinded study examining patient use of AI Chatbot technology (Chat GPT4) at initial visits to supplement understanding of urogynecologic problems. The primary aim of this study is to investigate the effect of use of an AI Chatbot platform on patient understanding of disease processes and treatment options prior to or following a consult with a urogynecologist at the initial visit. The secondary aims are to evaluate the accuracy of the chatbot-provided diagnosis (for participants applicable through randomization) and counseling information, and to evaluate patient satisfaction with the visit. This study will recruit patients with presenting problems of prolapse, lower urinary tract symptoms, or incontinence into one of three arms: use of an AI chatbot prior to seeing the urogynecologist, use of an AI chatbot following a consult with the urogynecologist, no use of an AI chatbot at the time of the visit. During time of their initial urogynecology visit, data will be collected including demographics, Pelvic Floor Disorders Inventory (PFDI) intake questionnaire data, health literacy, Chat GPT conversation, office consultation diagnoses/treatment, physician questionnaire, and post-consultation questionnaire (Diagnosis and Treatment, Decisional Conflict Scale, Patient Satisfaction, Chatbot Satisfaction). Patients will be asked three months after their visit to complete the post-consultation questionnaire again.
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
OTHER
Masking
NONE
Enrollment
125
Patients will be provided with the opportunity to ask ChatGPT questions about their primary presenting problem at a time point during their initial Urogynecology consultation visit.
Hartford Hospital
Hartford, Connecticut, United States
Patient understanding of diagnosis and treatment - physician understanding of diagnosis
The effect of use of an AI Chatbot platform on participant understanding of diagnosis at the initial urogynecology visit. This will be measured by the incidence of agreement of participant-reported diagnosis with their physician-reported diagnosis. The physician will be asked the patient's primary diagnosis in one multiple choice question (part of Physician Questionnaire). There are no minimum or maximum values to this questionnaire, and there are no answers that would mean a better or worse outcome.
Time frame: Baseline
Patient understanding of diagnosis and treatment - physician perception of participant understanding
The effect of use of an AI Chatbot platform on participant understanding of diagnosis at the initial urogynecology visit. This will be measured by the incidence of agreement of participant-reported diagnosis with their physician-reported diagnosis. The physician will be asked about the participants' understanding of their diagnosis and treatment plans in three multiple choice questions (part of Physician Questionnaire). The questionnaire will ask for responses on a Likert Scale 1 - 5, with the minimum value of 1 being "Strongly Disagree" and 5the maximum value of 5 being "Strongly Agree." Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 15.
Time frame: Baseline
Patient understanding of diagnosis and treatment - participant understanding of diagnosis and treatment plan
The effect of use of an AI Chatbot platform on participant understanding of diagnosis at the initial urogynecology visit. This will be measured by the incidence of agreement of participant-reported diagnosis with their physician-reported diagnosis. The participant will be provided with a three-item questionnaire (Post Consultation Participant Questionnaire). Each item will have multiple choice options. The participant will be asked asked to select the participant's primary diagnosis, treatment options, and selected management plan. There are no minimum or maximum values to this questionnaire, and there are no answers that would mean a better or worse outcome.
Time frame: Baseline and three month follow-up
Patient understanding of diagnosis and treatment - understanding of diagnosis
The effect of use of an AI Chatbot platform on participant understanding of diagnosis at the urogynecology initial visit. This will be measured by rate of participant agreement to a medical decision making questionnaire (Understanding of Diagnosis Questionnaire). The questionnaire has three items, and will ask for responses on a Likert Scale 1 - 5, with the minimum value of 1 being "Strongly Disagree" and the maximum value of 5 being "Strongly Agree." Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 15.
Time frame: Baseline and three month follow-up
Patient understanding of diagnosis and treatment - decision making
The effect of use of an AI Chatbot platform on participant decision making at the urogynecology initial visit. This will be measured by rate of participant agreement to a validated medical decision making questionnaire (Decisional Conflict Scale). The questionnaire has sixteen items, and will ask for responses on a Likert Scale 1 - 5, with the minimum value of 1 being "Strongly Disagree" and the maximum value of 5 being "Strongly Agree." Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 80.
Time frame: Baseline and three month follow-up
Patient satisfaction - medical visit
The effect of use of an AI Chatbot platform on participant satisfaction with the urogynecology visit. This will be measured by rate of participant agreement to a satisfaction questionnaire (Patient Satisfaction Questionnaire). The questionnaire has four items, and will ask for responses on a Likert Scale 1 - 5, with the minimum value of 1 being "Very Unsatisfied" and the maximum value of 5 being "Very Satisfied." Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 20.
Time frame: Baseline and three month follow-up
Patient satisfaction - Chatbot
The effect of use of an AI Chatbot platform on participant satisfaction with the urogynecology visit. This will be measured by rate of participant agreement to a satisfaction questionnaire (Chatbot Satisfaction Questionnaire). The questionnaire has six items, and will ask for responses on a Likert Scale 1 - 5, with the minimum value of 1 being "Strongly Disagree" and the maximum value of 5 being "Strongly Agree." Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 30.
Time frame: Baseline and three month follow-up
Patient Chatbot use after urogynecology visit
The participant use of the Chatbot platform at home after the urogynecology visit. This will be measured by one yes or no question asking if the participant used the Chatbot after the Urogynecology visit (Three Month Questionnaire). The questionnaire has one yes/no item. There are no minimum or maximum values to this questionnaire, and there are no answers that would mean a better or worse outcome.
Time frame: Three month follow-up
Chatbot information accuracy
The accuracy of chatbot-provided diagnosis and counseling information via expert clinician review. This will be measured by expert review of all chatbot transcripts by two independent clinicians with a third for adjudication with assessment using the Patient Education Materials Assessment Tool (PEMAT). The questionnaire has twenty-six items, and will ask for responses on a two point scale of "Disagree" meaning 0 points, and "Agree" meaning 1 point. Higher scores mean a better outcome. Score will be assessed in aggregate with a total possible score of 26.
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.
Time frame: Baseline