RE-AIM Archives - Implementation Science at UW

✪ Getting to Implementation: applying data-driven implementation strategies to improve guideline concordant surveillance for hepatocellular carcinoma

Authors:

Vera Yakovchenko, Chaeryon Kang, Brittney Neely, Carolyn Lamorte, Heather McCurdy, Dawn Scott, Anna Nobbe, Gwen Robins, Nsikak R. Ekanem, Monica Merante, Sandra Gibson, Patrick Spoutz, Linda Chia, Rachel I. Gonzalez, Matthew J. Chinman, David Ross, Maggie Chartier, Lauren A. Beste, Jasmohan S. Bajaj, Tamar Taddei, Timothy R. Morgan & Shari S. Rogal

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: December 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

While guidelines recommend twice-yearly liver cancer (hepatocellular carcinoma, HCC) surveillance for people with cirrhosis, adherence to these guidelines remains variable. We aimed to empirically identify and apply successful implementation strategies through Getting to Implementation (GTI), a manualized facilitation approach.

Method

A hybrid type III, stepped-wedge, cluster-randomized trial was conducted at 12 underperforming Veterans Health Administration (VA) sites between October 2020 and October 2022. GTI included a stepwise approach to guide sites to detail their current state, set implementation goals, identify implementation barriers, select implementation strategies, make a work plan, conduct an evaluation, and sustain their work. Outcomes were defined using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework.

Results

Facilitators supported site teams with an average of 20±6 facilitation hours over a 12-month period. Ten of 12 sites (83%) adopted GTI and applied a median of five strategies (e.g., dashboard use, small tests of change, direct patient outreach). Reach, the primary outcome, increased from mean 29.1% to mean 38.8% at-risk Veterans receiving HCC surveillance from pre- to post-intervention, and further increasing to 41.3% in the sustainment period. In both unadjusted and adjusted models, the odds of HCC surveillance were significantly higher during intervention (adjusted odds ratio, aOR=1.67, 95% CI:1.59, 1.75) and during sustainment (aOR=1.69, 95% CI:1.60, 1.78) compared with baseline, and with difference between active and sustainment periods, indicating sustained improvement after active facilitation ended.

Conclusions

GTI sustainably improved HCC surveillance, suggesting that applying data-driven implementation strategies within a manualized facilitation approach can improve care.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Exploring fidelity and its influence on effectiveness in an audit and feedback strategy implemented in a low-resource setting: an application of regression modeling

Abstract:

Background

Assessing implementation fidelity—the degree to which a program is implemented as intended—is essential to understand whether poor outcomes are due to implementation problems or the design of an intervention. Few studies in health research have documented the association between implementation fidelity and effectiveness. The Integrated District Evidence-to-Action (IDEAs) is a multicomponent audit and feedback strategy designed to improve the implementation of maternal and child clinical guidelines in Mozambique. In a previous study, we found mixed results of IDEAs effectiveness. The objective of the present study is to understand how implementation fidelity may have influenced the effectiveness of the strategy.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces in Mozambique between 2016 and 2020. We used the conceptual framework for implementation fidelity to guide descriptive analysis of IDEAs adherence. Regression modeling was used to study patterns of the direction of association between measures of fidelity and effectiveness for ten service delivery outcomes and five service readiness outcomes.

Results

We describe adherence on 15 measures of fidelity, of which 12 had high fidelity. Poor fidelity was found in conducting facility service readiness assessments and completing micro-interventions from action plans. Service delivery measures tended to be positively associated with participation and degree of micro-intervention completion and negatively associated with a higher number of action plans elaborated by participating teams. For the service readiness outcomes, delivery of essential care was positively associated with participation and micro-intervention completion, and staff availability was negatively associated with supervision.

Conclusion

Participation in audit and feedback meetings, the number of action plans elaborated, and the degree of completion of micro-interventions seem to be related to the effectiveness results. IDEAs should be adapted to reduce the number of action plans elaborated and promote better micro-intervention completion. Additionally, combining audit and feedback strategies with other strategies might enhance effectiveness in service outcomes. This study examines how to analyze the link between fidelity and effectiveness of a strategy to inform better design and recommend context-specific improvements.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Protocol for the process evaluation of a randomised clinical trial of incremental-start versus conventional haemodialysis: the TwoPlus study

Authors:

Mariana Murea, Kristie L Foley, Samir C Gautam, Jennifer E Flythe , Jochen G Raimann, Emaad Abdel-Rahman, Alaa S Awad, Vandana Dua Niyyar, Cassandra Kovach, Glenda V Roberts, Nicole M Jefferson, Paul T Conway, Laura M Rosales, Jobira Woldemichael, Hiba I Sheikh, Gaurav Raman, Anne M Huml, Daphne H Knicely, Irtiza Hasan, Bhaktidevi Makadia , Janice Lea, John T Daugirdas, Nihan Gencerliler, Jasmin Divers, Peter Kotanko, TwoPlus Research Consortium & Ucheoma C Nwaozuru

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: November 2025

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Process evaluation provides insight into how interventions are delivered across varying contexts and why interventions work in some contexts and not in others. This manuscript outlines the protocol for a process evaluation embedded in a hybrid type 1 effectiveness-implementation randomised clinical trial of incremental-start haemodialysis (HD) versus conventional HD delivered to patients starting chronic dialysis (the TwoPlus Study). The trial will simultaneously assess the effectiveness of incremental-start HD in real-world settings and the implementation strategies needed to successfully integrate this intervention into routine practice. This manuscript describes the rationale and methods used to capture how incremental-start HD is implemented across settings and the factors influencing its implementation success or failure within this trial.

Methods and analysis

We will use the Consolidated Framework for Implementation Research (CFIR) and the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) frameworks to inform process evaluation. Mixed methods include surveys conducted with treating providers (physicians) and dialysis personnel (nurses and dialysis administrators); semi-structured interviews with patient participants, caregivers of patient participants, treating providers (physicians and advanced practice practitioners), dialysis personnel (nurses, dieticians and social workers); and focus group meetings with study investigators and stakeholder partners. Data will be collected on the following implementation determinants: (a) organisational readiness to change, intervention acceptability and appropriateness; (b) inner setting characteristics underlying barriers and facilitators to the adoption of HD intervention at the enrollment centres; (c) external factors that mediate implementation; (d) adoption; (e) reach; (f) fidelity, to assess adherence to serial timed urine collection and HD treatment schedule; and (g) sustainability, to assess barriers and facilitators to maintaining intervention. Qualitative and quantitative data will be analysed iteratively and triangulated following a convergent parallel and pragmatic approach. Mixed methods analysis will use qualitative data to lend insight to quantitative findings. Process evaluation is important to understand factors influencing trial outcomes and identify potential contextual barriers and facilitators for the potential implementation of incremental-start HD into usual workflows in varied outpatient dialysis clinics and clinical practices. The process evaluation will help interpret and contextualise the trial clinical outcomes’ findings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A pragmatic approach to estimating the cost to deliver and participate in implementation strategies

Abstract:

The Healing Experiences of Adversity Among Latinos (HEALthy4You; H4Y) study was a multi-sector partnership between an academic research institution, a Federally Qualified Health Center (FQHC), and a multi-sector collective impact coalition focused on childhood obesity prevention. The goal of HEALthy4You was to develop community-centered and culturally appropriate precision interventions within FQHCs for Latino families to address predictors of adverse child experiences and treat childhood obesity. A multidisciplinary and multi-sector research, clinical, and community team (N = 29) was formed in September 2020 to co-design the study, which launched in June 2022. The team utilized a co-creation approach combined with the Exploration, Preparation, Implementation, and Sustainment framework to facilitate a collaborative design process. We conducted an internal and retrospective process evaluation in March 2023 to identify antecedents and situational factors associated with project formation, with a focus on understanding tensions and challenges with a broad partnership structure. We outline the team's co-creation process and describe internal challenges and pitfalls that emerged when developing the project. We sought to better understand the impact of differing perspectives, priorities, and goals between disciplines, sectors, and roles; differing approaches to evidence and evidence production; and team strategies to mitigate and manage competing pressures and priorities. This case report describes lessons learned, intending to share insights to support future development of best practices in project, partner, and team formation between researchers, clinicians, and community members. More specifically, these lessons could help inform community-led research endeavors between academic institutions, FQHCs, and community-based organizations (CBOs).

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Editorial: Using the RE-AIM framework and other implementation theories, models, and frameworks to guide the implementation and evaluation of rural health innovations

Conducting an implementation intervention study with American Indian and Alaska Native communities: Methodological considerations

“It makes all the sense in the world”: A qualitative evaluation of patient perspectives on implementation outcomes of a peer-facilitated integrated infectious disease and substance use care model

✪ When evidence is not enough: A qualitative exploration of healthcare workers’ perspectives on expansion of two-way texting (2wT) for post- circumcision follow-up in South Africa

Abstract:

As per South African national guidelines, in-person follow-up visits after voluntary medical male circumcision (VMMC) are required but may be unnecessary. Two-way texting (2wT), an mHealth platform, engages clients in post-operative care and triages those with complications to in-person review. 2wT was found to be safe, effective, and efficient. In South Africa, to understand provider perspectives on 2wT and potential for expansion, 20 key informant interviews were conducted with management, clinicians, data officials and support staff involved in 2wT scale-up. Interviews were analyzed using rapid qualitative methods and informed by two implementation science frameworks: the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework and the Pragmatic, Robust, Implementation and Sustainability Model (PRISM). Participants shared mixed and multi-faceted feedback, including that 2wT improves monitoring and evaluation of clients and clinical outcomes while also reducing follow-up visits. Challenges included duplicative routine and 2wT reporting systems and perceptions that 2wT increased workload. To improve the likelihood of successful 2wT scale-up in routine VMMC settings, participants suggested: further 2wT sensitization to ensure clinician and support staff buy-in; a dedicated clinician or nurse to manage telehealth clients; improved dashboards to better visualize 2wT client data; mobilizing 2wT champions at facilities to garner support for 2wT as routine care; and updating VMMC guidelines to support VMMC telehealth. As attendance at follow-up visits may not be as high as reported, implementing 2wT may require more effort but also brings added benefits of client verification and documented follow-up. The transition from research to routine practice is challenging, but use of RE-AIM and PRISM indicate that it is not impossible. As VMMC funding is decreasing, more effort to share the evidence base for 2wT as a safe, cost-effective, high-quality approach for VMMC follow-up is needed to encourage widespread uptake and adoption.

Author summary

South Africa has a high prevalence of HIV, and voluntary medical male circumcision is a prevention method recommended by the World Health Organization. Two-way texting (2wT) is a digital health intervention that allows males to receive educational messages after circumcision about healing and send messages directly to a provider via SMS or WhatsApp. This system detects as many complications as routine follow-up care, though is more efficient. As we scale up to new locations in South Africa, we wanted to ensure the approach is well-adapted for health workers. Through 20 interviews with health workers, we found that it saves clients in-person visits and helps with data collection. However, more effort is needed to introduce the intervention to clinicians, including providing better training and appointing champions to help motivate clinicians. Funding for HIV and VMMC programs is decreasing, so it is important to find tools such as digital health to reduce the burden on facilities while maintaining quality client care.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ “If he returns, receive him because he has realized that he needs assistance”: A qualitative study exploring preferences for retention on antiretroviral therapy support in Malawi among Lighthouse Clinic clients

Abstract:

Introduction

Retention of people living with HIV (PLHIV) on antiretroviral therapy (ART) is critical. Retention is not static: clients cycle in and out of care over the course of treatment. Retention support is also evolving, with interventions like mobile health (mHealth) gaining traction. We aimed to explore ART clients’ perspectives and recommend strategies for improved retention support including a two-way-texting (2wT) mHealth intervention in two clinics in Malawi.

Materials and methods

We conducted focus group discussions (FGDs) with PLHIV on ART receiving 2wT or standard of care (SoC) retention support to understand client perspectives. FGDs were audio-recorded in Chichewa, translated and transcribed into English. We used the RE-AIM implementation science framework to report findings on the reach, effectiveness, adoption, implementation, and maintenance potential of retention interventions considering individual, clinic/organization, and community factors. Through rapid qualitative analysis, we identified key themes and subthemes.

Results

Ten FGDs were conducted with 89 ART clients (aged ≥18 years; 55% female): four FGDs among 2wT participants and six among SoC participants. Few differences were observed between 2wT and SoC clients. All clients appreciated accessing at least one form of support and recommended continuous assistance, regardless of age, sex, or duration on ART. Clients wished to be encouraged by other PLHIV to allay common fears. Groups discussed the need for intensified support to retain young clients or those out of care longer. Individual responsibility was identified as necessary, but insufficient, to improve retention: respondents desired a more positive clinic environment to encourage persistence in care. Fear of stigma, unintended status disclosure, and negative interactions with clinic staff prevent some clients from returning to care.

Conclusion

PLHIV want differentiated, continuous retention support from other PLHIV coupled with a positive clinic environment to promote retention and reengagement in care. As differentiated retention support is expensive, consideration of cost, feasibility, and sustainability is needed.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Method

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Methods and analysis

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Contemporary Clinical Trials

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal International Journal of Drug Policy

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Digital Health

Abstract:

Author summary

Authors:

✪ Open Access

Read the full text in the open access journal PLOS One

Abstract:

Introduction

Materials and methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Global Public Health

Abstract: