This study is designed to test the impact of a new curriculum, called Provider Awareness Cultural Dexterity Toolkit for Surgeons (PACTS), on surgical residents' cross-cultural knowledge, attitudes, and skills surrounding the care of patients from diverse cultural backgrounds, as well as clinical and patient-reported health outcomes for patients treated by surgical residents undergoing this training.
In order to improve overall health outcomes of minority patients undergoing surgical care, the National Institute on Minority Health and Health Disparities (NIMHD) collaborated with the American College of Surgeons (ACS) and prioritized the evaluation and the the effect of improvement in culturally dexterous care on surgical outcomes for patients from disparity populations. Poor outcomes in patients are attributed to poor patient-provider communication which may lead to treatment errors, inadequate pain management, less patient-centered care, decreased adherence to treatment plans, and worse overall clinical outcomes. Additionally, studies have shown that some surgeons have pro-White implicit biases, which are unconscious, automated preferences that individuals may not even be aware of. Historically, formal training in cultural competency is generally integrated into medical education at the undergraduate level but it rarely continues up to the post-graduate level. Few surgical programs have attempted to incorporate cross-cultural communication skills into their educational paradigms, and the approaches to doing so have been inconsistent. In order to add the surgical context in post-graduate level medical education, the investigators adopted a novel approach to cross-cultural communication for surgical trainees, known as cultural dexterity. Cultural dexterity refers to a set of skills and cognitive practices used to maximize communication across multiple dimensions of cultural diversity and deviates from the concept of cultural competency in that it does not demand that learners associate certain practices and behaviors with individuals based on generalizations. Study design: Cross-over, cluster-randomized trial Study Procedures: Curriculum Administration The PACTS curriculum incorporates contemporary learning practices such as the "flipped classroom" model and team-based learning. It consists of e-learning modules and interactive sessions in which residents will apply concepts from the e-learning modules to role-play scenarios constructed in a team-based learning format. Residents will be given detailed, scripted prompts for the role-play sessions followed by structured feedback from peers and facilitators. Outcome Measurement: Residents To evaluate the impact of PACTS on surgical residents' knowledge and attitudes about caring for diverse patients, the investigators will use a pre- and post-test in the form of validated instruments that assess knowledge, attitudes, and self-reported skills on a Likert-type scale. Resident skills will also be objectively assessed through an Objective Structured Clinical Examination (OSCE) that will be created by the study staff and administered immediately before the intervention and 3 months after the intervention has been completed. The OSCE uses 5-point Likert scale questions to evaluate resident performance across multiple domains. These may be administered virtually or in-person. A Standardized Patient evaluator and a third-party trained impartial observer will evaluate the residents on these domains, and the resulting numerical scores will be averaged. It will serve both a summative and educational purpose in this context. Residents will be required to take a knowledge survey before and after receiving the PACTS curriculum or standard training. Attitudes regarding the importance of facing cross-cultural health care situations will be assessed across multiple domains using a novel survey instrument that is based on a survey that was used in a similar curriculum aimed at medical students, as well as the Values and Belief Systems domain. Patients To evaluate patients' satisfaction and clinical quality related to PACTS training, the investigators will administer surveys to patients treated by residents to determine satisfaction with pain management, communication, trust-building, and comprehension of the informed consent discussion two months before and after the intervention is implemented. Patient satisfaction will be assessed using elements of the validated Patient Satisfactions Survey. We plan to collect clinical surgical outcomes obtained from the National Surgical Quality Improvement Program (NSQIP) database for each patient participant before and after the PACTS curriculum is implemented to measure individual outcomes such as length of stay, postoperative complications, unplanned reoperations, and 30-day morbidity/mortality. A post hoc analysis of clinical outcomes will be performed.
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
HEALTH_SERVICES_RESEARCH
Masking
NONE
Enrollment
2,901
The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
The standard residency curriculum consists of previously scheduled resident didactic sessions at all academic medical centers that may or may not include topics on cultural competency or cross-cultural care.
Howard University Hospital
Washington D.C., District of Columbia, United States
Johns Hopkins Hospital
Baltimore, Maryland, United States
Massachusetts General Hospital
Boston, Massachusetts, United States
Brigham and Women's Hospital
Boston, Massachusetts, United States
Beth Israel Deaconess Medical Center
Boston, Massachusetts, United States
Washington University in St. Louis
St Louis, Missouri, United States
Rhode Island Hospital
Providence, Rhode Island, United States
Eastern Virginia Medical School
Norfolk, Virginia, United States
Change in Residents' Questionnaire Scores Measuring Knowledge From Pre- to Post-PACTS Curriculum
The effect of PACTS curriculum on surgical residents' questionnaire scores measuring knowledge about caring for culturally diverse patients at time Period 2 (18 months). At this time, the Early Intervention Group had already received the PACTS curriculum. The Delayed Intervention Group had not received the PACTS curriculum, serving as the control group at this time period. Resident knowledge: Percent score out of 100, with range 0-100%. Higher values represent a better outcome, with 100% as the highest score possible. This is the average score for the Early Intervention and Delayed Intervention groups at Period 2.
Time frame: Period 2 (18 months)
Change in Residents' Cross Cultural Care Survey Scores From Pre- to Post-PACTS Curriculum
The effect of PACTS curriculum on surgical residents' cross cultural care survey about caring for culturally diverse patients at time Period 2 (18 months). At this time period, the Early Intervention group received the PACTS curriculum, while the Delayed Intervention Group had not received the PACTS curriculum, serving as the control group. The cross cultural care survey was evaluated using a modified Likert type scale (with scale ranging from lowest to highest: very unprepared, somewhat unprepared, somewhat prepared, very well prepared). Resident scores were dichotomized into two groups, those reporting "very unprepared" and "somewhat unprepared", and those reporting "somewhat prepared" and "very well prepared." Here reported values are representative of the percentage of participants who reported "somewhat prepared" and "very well prepared" at time Period 2.
Time frame: Period 2 (18 months)
Change in Residents' Questionnaire Scores Regarding Self-Assessed Skills From Pre- to Post-PACTS Curriculum
The effect of PACTS curriculum on surgical residents' self-assessed skills for caring for culturally diverse patients at time Period 2 (18 months). Self-assessed skills ranged from levels 1 to levels 4, with level 1 indicated less skilled, and level 4 indicating skillful. For purposes of comparison, resident scores were dichotomized into two groups: less skilled (referring to skill levels 1 and 2), and skillful (levels 3 and 4). Here reported values are representative of the percentage of participants who reported skill levels 3 or 4, indicating skillful. Results here demonstrate the proportion of residents in the Early Intervention (Intervention) group and Delayed Intervention (control group) who self-evaluated their skills as skillful at Period 2.
Time frame: Period 2 (18 months)
Change in Residents' Questionnaire Scores Regarding Their Beliefs From Pre- to Post-PACTS Curriculum
The effect of PACTS curriculum on surgical residents' beliefs regarding caring for culturally diverse patients at time Period 2 (18 months). At this time, the Early Intervention Group had already received the PACTS curriculum. The Delayed Intervention Group had not received the PACTS curriculum, serving as the control group at this time period. The questionnaire was scored using a modified Likert type scale with a range from lowest to highest: strongly disagree, moderately disagree, mildly disagree, strongly agree, moderately agree, mildly agree. Answers were dichotomized into two groups: strongly disagree, moderately disagree, and mildly disagree; and strongly agree, moderately agree, and mildly agree. Here reported values are representative of the proportion of participants who answered "strongly agree, moderately agree, and mildly agree."
Time frame: Period 2 (18 months)
Objective Structured Clinical Examination Scores
Standardized Patient observers evaluated surgical residents on multiple dimensions of cultural dexterity and communication skills using Likert-type scales. The scale range, from lowest to highest was: "Not at all; a little bit; somewhat; mostly; a great deal." Scores were put into two groups: 1) not at all, a little bit, and somewhat; 2) mostly and a great deal. The percentage of residents who received scores of "mostly" and "a great deal" in categories of trust, limited english proficiency, consent, and pain were reported.
Time frame: Period 2 (18 months)
Patients' Self-reported Satisfaction Scores
We used an adapted version of the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) to assess patients' (1) satisfaction with pain management, (2) satisfaction with communication including specific measures for limited English proficiency (LEP), (3) trust, and (4) comprehension of informed consent. Patient satisfaction was captured using a modified Likert scale from lowest to highest: strongly disagree, disagree, neither agree nor disagree, agree, and strongly agree. The values reported below are the percentage of participants who reported "agree" or "strongly agree."
Time frame: Period 2 (18 months)
Median Hospital Length of Stay for Patient Participants
National Surgical Quality Improvement Program (NSQIP) metrics for each patient participant capturing hospital length of stay in days. Patients designated to Early Intervention Group were cared for by a resident enrolled in the Early Intervention group, where the PACTS curriculum was administered between period 1 (0 months) and period 2 (18 months). Patients designated to the Delayed Intervention group were cared for by a resident enrolled in the Delayed Intervention group, where the standard curriculum was administered between period 1 (0 months) and period 2 (18 months). We are comparing median length of stay at period 2.
Time frame: Period 2 (18 months)
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.