This study will test feature enhancements to a behavioral therapy data collection software (Motivity) that will add a new clinical decision support module, called Acuity. Acuity is a Quality Improvement (QI) intervention targeted at Behavior Analysts (BAs) and Behavior Technicians (BTs) that aims to improve the delivery of autism behavioral therapy. Subjects will be staff recruited from existing Motivity customers.
Acuity is intended to provide significant improvements in treatment planning, progress tracking, trend monitoring, and dosage management. If successful, Acuity will provide Applied Behavior Analysis (ABA) practitioners with a higher level of real-time insight into their clinical data, enabling more efficient and productive treatment. Research has shown that first-generation systems fall short in supporting overworked BAs who are overwhelmed with data. Acuity will address critical shortfalls by enabling more agile corrective actions and data-driven planning across multiple aspects of treatment, providing practitioners with new levels of rigorous, real-time insight into their clinical data. Acuity will help BAs establish and adhere to realistic treatment timelines, and will proactively alert the BA to noteworthy trends in the data as they occur, such as learner performance issues, missed dosages, and significant changes in tracked behaviors. In doing so, Acuity will support more responsive and effective treatment.
Study Type
INTERVENTIONAL
Allocation
RANDOMIZED
Purpose
OTHER
Masking
NONE
Enrollment
102
Enhancement to Motivity product for clinical decision support
Experiad LLC
Honolulu, Hawaii, United States
Number of participants with improved estimation of Trials to Criterion and Time (days) to Criterion
Does Acuity make initial timeline estimates for sets of targets more accurate?
Time frame: through study completion, expected to be 18 months from the start of retroactive observation period
Increased frequency of changes to programs and prescribed dosages, resulting in reduced Trials to Criterion and Time to Criterion.
Does Acuity result in corrective action being taken more quickly for programs that are off schedule or targets that are exhibiting performance issues?
Time frame: through study completion, expected to be 18 months from the start of retroactive observation period
Increased adherence to prescribed dosage
Does Acuity result in increased adherence to prescribed dosage, as measured by system
Time frame: through study completion, expected to be 18 months from the start of retroactive observation period
Number of participants who find Acuity and its components practical and possible to use, assessed by qualitative measures and system usage tracking
Feasibility - To what extent are Acuity and its components practical or possible to use?
Time frame: at the end of the study, expected to be 18 months from the start of retroactive observation period
Proportion of clinics and providers that actively use Acuity, assessed by system usage tracking.
Adoption - What proportion of clinics and providers are willing to use Acuity and how well do they represent the population of clinics and providers?
Time frame: at the end of the study, expected to be 18 months from the start of retroactive observation period
Number of BAs & BTs who utilize Acuity as intended to provide learners with accurate treatment plans, and achieve expected results, as measured by system usage and qualitative assessment.
This platform is for informational purposes only and does not constitute medical advice. Always consult a qualified healthcare professional.
Fidelity - the degree to which BAs and BTs use the system as expected, including dosage adherence, treatment planning accuracy, and timely protocol modification.
Time frame: at the end of the study, expected to be 18 months from the start of retroactive observation period
Majority of BAs and BTs rate Acuity and its components as attractive, agreeable, or palatable.
Acceptability, as measured by SUS score and SUS Items 1, 5, 6 \& 8 collected via online survey at the end of O0 \& O1 from both arms.
Time frame: at the end of the study, expected to be 18 months from the start of retroactive observation period
Frequency at which Acuity and its components are rated as suitable, fitting, or proper for achieving the goals set forth in treatment plans, as measured by surveys.
Appropriateness - Same measures captured for all primary \& secondary research questions in the Functional Impact Evaluation. Brief online survey with Likert scaled items focused on the providers' assessment of how well Acuity and its components are matched to the challenges of planning and executing Treatment Plans.
Time frame: at the end of the study, expected to be 18 months from the start of retroactive observation period