RE-AIM Archives - Page 2 of 5 - Implementation Science at UW

✪ Evaluating spoke facilitation costs of implementing TelePain in the Veterans Health Administration

Abstract:

Background

The high prevalence and significant morbidity and mortality associated with chronic pain among veterans has made expansion of pain services within the Veterans Health Administration (VHA) a key priority. TelePain, in which services are provided via telehealth from central “hub” sites to patients at decentralized “spoke” sites, is one such model with positive implementation findings to date. However, the staff effort and cost of implementation have yet to be examined when considering TelePain or similar virtual hub-and spoke models of specialty pain care, information that is critical for expansion of services.

Methods

Using an established time-based activity tracker designed for implementation facilitation, study staff tracked minutes spent on implementation activities at 11 spoke sites. Annual salaries were extracted to calculate an average cost per minute for each personnel type. Costs per personnel minute were combined with activity data to calculate costs of implementation activities at spoke sites. Implementation reach outcomes for the first 36 months of implementation were extracted from the electronic health record. Service utilization data was combined with cost data to calculate cost per patient reached and per clinical encounter achieved at each site.

Results

Total facilitation costs (range: $1,746-$7,978) and unique patients reached (range: 2–46) varied considerably across spoke sites and greater staff implementation efforts (measured in time or cost) were not associated with greater numbers of patients reached. Therefore, costs per patient reached also varied widely (range: $120–2,569) across spoke sites. Key challenges included high rurality and small clinic size; insufficient engagement of frontline providers; lack of referral options for high acuity patients; and lack of existing programming within which to situate pain services.

Conclusions

At spoke sites where patients were consistently referred and reached, costs were relatively modest, particularly compared to the high cost of untreated chronic pain, suggesting the potential impact of this model at scale. However, in spoke sites where referrals and encounters were low during initial implementation, cost per patient was high. Findings highlight the need for better methods for tailoring of facilitation interventions to spoke site’s individual needs to maximize impact.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Integrating Implementation Outcomes into Effectiveness Studies: A Practical Guide for Clinical Interventionists

Treating seizures faster: The quality improvement in time to treat status epilepticus (QuITT-SE) multicenter randomized stepped wedge clinical trial protocol

Design of a pragmatic trial integrating human papillomavirus (HPV) self-sampling into primary care to reduce cervical cancer screening disparities in Somali American individuals: The Isbaar project

✪ WhatsApp Versus SMS for 2-Way, Text-Based Follow-Up After Voluntary Medical Male Circumcision in South Africa: Exploration of Messaging Platform Choice

Abstract:

Background

Telehealth is growing, especially in areas where access to health facilities is difficult. We previously used 2-way texting (2wT) via SMS to improve the quality of postoperative care after voluntary medical male circumcision in South Africa. In this study, we offered males aged 15 years and older WhatsApp or SMS as their message delivery and interaction platform to explore user preferences and behaviors.

Objective

The objectives of this process evaluation embedded within a larger 2wT expansion trial were to (1) explore 2wT client preferences, including client satisfaction, with WhatsApp or SMS; (2) examine response rates (participation) by SMS and WhatsApp; and (3) gather feedback from the 2wT implementation team on the WhatsApp approach.

Methods

Males aged 15 years and older undergoing voluntary medical male circumcision in program sites could choose their follow-up approach, selecting 2wT via SMS or WhatsApp or routine care (in-person postoperative visits). The 2wT system provided 1-way educational messages and an open 2-way communication channel between providers and clients. We analyzed quantitative data from the 2wT database on message delivery platforms (WhatsApp vs SMS), response rates, and user behaviors using chi-square tests, z tests, and t tests. The team conducted short phone calls with WhatsApp and SMS clients about their perceptions of this 2wT platform using a short, structured interview guide. We consider informal reflections from the technical team members on the use of WhatsApp. We applied an implementation science lens using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to focus results on practice and policy improvement.

Results

Over a 2-month period—from August to October, 2023—337 males enrolled in 2wT and were offered WhatsApp or SMS and were included in the analysis. For 2wT reach, 177 (53%) participants chose WhatsApp as their platform (P=.38). Mean client age was 30 years, and 253 (75%) participants chose English for automated messages. From quality assurance calls, almost all respondents (87/89, 98%) were happy with the way they were followed up. For effectiveness, on average for the days on which responses were requested, 58 (33%) WhatsApp clients and 44 (28%) SMS clients responded (P=.50). All 2wT team members believed WhatsApp limited the automated message content, language choices, and inclusivity as compared with the SMS-based 2wT approach.

Conclusions

When presented with a choice of 2wT communication platform, clients appear evenly split between SMS and WhatsApp. However, WhatsApp requires a smartphone and data plan, potentially reducing reach at scale. Clients using both platforms responded to 2wT interactive prompts, demonstrating similar effectiveness in engaging clients in follow-up. For telehealth interventions, digital health designers should maintain an SMS-based platform and carefully consider adding WhatsApp as an option for clients, using an implementation science approach to present evidence that guides the best implementation approach for their setting.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation of collaborative care for depression in VA HIV clinics: Translating Initiatives for Depression into Effective Solutions (HITIDES): protocol for a cluster-randomized type 3 hybrid effectiveness-implementation trial

Abstract:

Background

Depression is the most diagnosed mental health condition among people living with HIV. Collaborative care is an effective intervention for depression, typically delivered in primary care settings. The HIV Translating Initiatives for Depression into Effective Solutions (HITIDES) clinical intervention involves a depression care team housed off-site that supports depression care delivery by HIV care providers. In a randomized controlled trial, HITIDES significantly improved depression symptoms for veterans living with HIV and delivered cost savings. However, no HIV clinics in the Veterans Health Administration (VHA) have implemented HITIDES; as such, it is unclear what implementation strategies are necessary to launch and sustain this intervention.

Methods

This hybrid type-3 effectiveness-implementation trial examines the implementation and effectiveness of HITIDES in 8 VHA HIV clinics randomly assigned to one of two implementation arms. Each arm uses a different implementation strategy package. Arm 1 includes an intervention operations guide; an on-site clinical champion who, with the help of a peer community of practice, will work with local clinicians and leadership to implement HITIDES at their site; and patient engagement in implementation tools. Arm 2 includes all strategies from Arm 1 with assistance from an external facilitator. The primary implementation outcomes is reach; secondary outcomes include adoption, implementation dose, depressive symptoms, and suicidal ideation. We will conduct a budget impact analysis of the implementation strategy packages. We hypothesize that Arm 2 will be associated with greater reach and adoption and that Arm 1 will be less costly.

Discussion

Preliminary work identified implementation strategies acceptable to veterans living with HIV and HIV care providers; however, the effectiveness and cost of these strategies are unknown. While the depression care team can deliver services consistently with high quality, the ability of the depression care team to engage with HIV care providers at sites is unknown. Findings from this study will be used to inform selection of implementation strategies for a broad rollout to enhance depression and suicide care for people living with HIV.

Trial registration

ClinicalTrials.gov ID: NCT05901272, Registered 10 May 2023, https://clinicaltrials.gov/study/NCT05901272

Contributions to the literature

It is well-recognized that those with HIV infections need greater access to mental healthcare for depression. But it is not known how best to support deployment of evidence-based mental healthcare to them.
This paper describes an implementation trial to roll out depression care in HIV clinics.
With the fragmentation of care among so many subspecialties, understanding how to roll out mental health support across specialty medical settings is crucial.
Results will be relevant to mental health and suicide support not only for those with HIV but across many sectors of care for adults receiving care in specialty medical settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: Findings from a quasi-experimental study in Lilongwe, Malawi

Abstract:

Background

Retaining clients on antiretroviral therapy (ART) is challenging, especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi.

Methods

Between August 2021—June 2023, in a quasi-experimental study, outcomes were compared between two cohorts of new ART clients: 1) those opting into 2wT who received automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as “the proportion clients ≤6 months of ART initiation eligible for 2wT”. 2wT effectiveness was assessed in time-to-event analysis. Retention was presented in a Kaplan-Meier plot and compared between 2wT and SoC using a log-rank test. The effect of 2wT on ART dropout (lost to follow-up or stopped ART) was estimated using Fine-Gray competing risk regression models, adjusting for sex, age and WHO HIV stage at ART initiation.

Results

Of 1,146 clients screened, 501 were eligible for 2wT, a reach of 44%. Lack of phone (393/645; 61%) and illiteracy (149/645; 23%) were the most common ineligibility reasons. Among 468 participants exposed to 2wT, 12-month probability of ART retention was 91% (95% CI: 88% - 94%) compared to 76% (95% CI: 72% - 80%) among 468 SoC participants (p<0.001). Compared to SoC, 2wT participants had a 65% lower hazard of ART dropout at any timepoint (sub-distribution hazard ratio 0.35, 95% CI: 0.24–0.51; p<0.001).

Conclusions

2wT did not reach all clients. For those who opted-in, 2wT significantly increased 12-month ART retention. Expansion of 2wT as a complement to other retention interventions should be considered in other low-resource, routine ART settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A formative mixed methods evaluation of a new Ross program: Why context matters

Abstract:

Background

The Ross procedure is a technically complex operation to address the pathology of the aortic valve. Prior attempts at widespread implementation have been plagued with variations in effectiveness. We report our initial programmatic outcomes using dissemination and implementation (D&I) science frameworks, with an aim to define both programmatic efficacy and effectiveness. The study design was a single center, explanatory sequential mixed methods evaluation of a Ross surgery program from June 2020 to April 2023. Quantitative measures for baseline patient characteristics and postoperative outcomes were summarized. Qualitative measures were obtained using semi-structured interviews and characterized using implementation science frameworks.

Results

A total of 71 patients underwent the Ross procedure at a single academic center. Mean age was 40 years (± 13). There were no perioperative deaths or valve-related reinterventions (0%). During the follow-up period, 2 (2.8%) patients required re-operation and 2 (2.8%) required balloon dilation of the pulmonary homograft. Qualitative measures noted communication and prospective self-audit facilitated measures of effectiveness, as dichotomy within expected vs. observed outcomes led to program modifications. Collaboration across hospital systems promoted adoption and implementation, which led to the incorporation of the Ross procedure into accepted organizational practice.

Conclusions

In this formative evaluation, limited-efficacy outcomes demonstrated similar programmatic success to data from other established centers. With the prerequisite center volume and case selection, the Ross procedure is a safe and efficacious treatment for aortic valvular disease. Implementation science can be used both in real-time and retrospectively to guide organizational efforts to improve outcomes and to improve the translation of results across centers.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

Authors:

Carmen E. Hazim , Igor Dobe, Stephen Pope, Kristjana H. Ásbjörnsdóttir, Orvalho Augusto, Fernando Pereira Bruno, Sergio Chicumbe, Norberto Lumbandali, Inocêncio Mate, Elso Ofumhan, Sam Patel, Riaze Rafik, Kenneth Sherr, Veronica Tonwe, Onei Uetela, David Watkins, Sarah Gimbel, & Ana O. Mocumbi

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: March 2024

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services.
Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

Methods

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be “scaled up” with delivery by district health supervisors (rather than research staff) and will be “scaled out” via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer’s perspective.

Discussion

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes, Katherine Ritchey

Abstract:

Introduction

Falls in nursing homes are a major cause for decreases in residents’ quality of life and overall health. This study aims to reduce resident falls by implementing the LOCK Falls Programme, an evidence-based quality improvement intervention. The LOCK Falls Programme involves the entire front-line care team in (1) focusing on evidence of positive change, (2) collecting data through systematic observation and (3) facilitating communication and coordination of care through the practice of front-line staff huddles.

Methods and analysis

The study protocol describes a mixed-methods, 4-year hybrid (type 2) effectiveness-implementation study in State Veterans Homes in the USA. The study uses a pragmatic stepped-wedge randomised trial design and employs relational coordination theory and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to guide implementation and evaluation. A total of eight State Veterans Homes will participate and data will be collected over an 18-month period. Administrative data inclusive of all clinical assessments and Minimum Data Set assessments for Veterans with a State Veterans Home admission or stay during the study period will be collected (8480 residents total). The primary outcome is a resident having any fall. The primary analysis will be a partial intention-to-treat analysis using the rate of participants experiencing any fall. A staff survey (n=1200) and qualitative interviews with residents (n=80) and staff (n=400) will also be conducted. This research seeks to systematically address known barriers to nursing home quality improvement efforts associated with reducing falls.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Journal of General Internal Medicine

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Contemporary Clinical Trials

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Contemporary Clinical Trials

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Discussion

Trial registration

Contributions to the literature

Authors:

✪ Open Access

Read the full text in the open access journal PLOS One

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal The Cardiothoracic Surgeon

Abstract:

Background

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Methods

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Methods and analysis