Human Doctors or AI: Evaluating Patient Satisfaction in Urinary Stone Disease Consultations

Abant Izzet Baysal University100 enrolled

Overview

The goal of this observational study is to understand how satisfied patients are after getting medical advice about urinary stone disease from either a real doctor or an artificial intelligence (AI) chatbot. We want to learn whether people feel more satisfied with the information and support they get from human doctors or from AI tools like ChatGPT, Gemini, Perplexity, or Copilot. The main questions it aims to answer are: * Are patients more satisfied after consulting a real doctor or an AI chatbot? * Does the time spent in the consultation affect satisfaction? Researchers will compare doctor consultations with consultations from different AI chatbots to see if there are differences in patient satisfaction. Participants will: * Ask all their medical questions about urinary stones to one of the sources (a doctor or a specific AI chatbot) * Fill out a short questionnaire (CSQ-8) to rate how satisfied they felt with the answers they received

Study Type

INTERVENTIONAL

Allocation

RANDOMIZED

Purpose

HEALTH_SERVICES_RESEARCH

Masking

NONE

Enrollment

100

Conditions

Patient Satisfaction

Interventions

Participants will be randomly assigned to receive medical consultation about urinary stone disease from one of five sources: a real urologist (in-person) or one of four AI chatbots (ChatGPT, Gemini, Perplexity, or Microsoft Copilot). Each participant will be instructed to ask all their questions related to urinary stone disease and continue the consultation until they feel adequately informed. The consultation format (human vs. AI) will depend on group assignment. After the session, participants will complete a validated satisfaction questionnaire (CSQ-8) to assess their experience.

Eligibility

Sex: ALLMin age: 18 Years

Medical Language ↔ Plain English

Inclusion Criteria: * Newly diagnosed with urinary stone disease, * Aged 18 years or older, * Provided written informed consent to participate in the study. Exclusion Criteria: * History of previous urinary stone disease, stone-related procedures, * Presence of other acute medical conditions unrelated to urinary stone disease, * Cognitive or communication impairments, * Pregnancy.

Outcomes

Primary Outcomes

Patient Satisfaction Score

Patient satisfaction will be measured using the validated Client Satisfaction Questionnaire (CSQ-8), which consists of 8 items scored on a 4-point Likert scale. The total score ranges from 8 to 32, with higher scores indicating greater satisfaction.

Time frame: Within 1 hour after the consultation

Secondary Outcomes

Consultation Duration

Total duration (in minutes) of the consultation session (doctor or chatbot) will be recorded and compared across all groups.

Time frame: During consultation