RE-AIM Archives - Page 3 of 5 - Implementation Science at UW

✪ Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

Authors:

Aneth Dinis, Quinhas Fernandes, Bradley H Wagenaar, Sarah Gimbel, Bryan J Weiner, Grace John-Stewart, Ermyas Birru, Stephen Gloyd, Ruth Etzioni, Dorlim Uetela, Isaías Ramiro, Artur Gremu, Orvalho Augusto, Stélio Tembe, Jaime L Mário, Jalilo E Chinai, Alfredo F Covele, Cassimo M Sáide, Nélia Manaca & Kenneth Sherr

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

Results

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities’ first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. “Weak diagnosis or management of obstetric complications” was identified as the main problem, and “actions to reinforce norms and protocols” was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

Conclusion

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Project UPLIFT: Adoption and implementation experiences of an epilepsy self-management program

✪ Applying implementation science to evaluate participatory ergonomics program for continuous improvement: A case study in the construction industry

✪ Strengthening integrated depression services within routine primary health care using the RE-AIM framework in South Africa

Authors:

Inge Petersen, Christopher G. Kemp, Deepa Rao, Bradley H. Wagenaar, Max Bachmann, Kenneth Sherr, Tasneem Kathree, Zamasomi Luvuno, André Van Rensburg, Sithabisile Gugulethu Gigaba, Londiwe Mthethwa, Merridy Grant, One Selohilwe, Nikiwe Hongo, Gillian Faris, Christy-Joy Ras, Lara Fairall, Sanah Bucibo, & Arvin Bhana

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: November 2023

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Integration of mental health into routine primary health care (PHC) services in low-and middle-income countries is globally accepted to improve health outcomes of other conditions and narrow the mental health treatment gap. Yet implementation remains a challenge. The aim of this study was to identify implementation strategies that improve implementation outcomes of an evidence-based depression care collaborative implementation model integrated with routine PHC clinic services in South Africa. An iterative, quasi-experimental, observational implementation research design, incorporating the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework, was applied to evaluate implementation outcomes of a strengthened package of implementation strategies (stage two) compared with an initial evaluation of the model (stage one). The first stage package was implemented and evaluated in 10 PHC clinics and the second stage strengthened package in 19 PHC clinics (inclusive of the initial 10 clinics) in one resource-scarce district in the province of KwaZulu-Natal, South Africa. Diagnosed service users were more likely to be referred for counselling treatment in the second stage compared with stage one (OR 23.15, SE = 18.03, z = 4.04, 95%CI [5.03–106.49], p < .001). Training in and use of a validated, mandated mental health screening tool, including on-site educational outreach and technical support visits, was an important promoter of nurse-level diagnosis rates (OR 3.75, 95% CI [1.19, 11.80], p = 0.02). Nurses who perceived the integrated care model as acceptable were also more likely to successfully diagnose patients (OR 2.57, 95% CI [1.03–6.40], p = 0.043). Consistent availability of a clinic counsellor was associated with a greater probability of referral (OR 5.9, 95%CI [1.29–27.75], p = 0.022). Treatment uptake among referred service users remained a concern across both stages, with inconsistent co-located counselling services associated with poor uptake. The importance of implementation research for strengthening implementation strategies along the cascade of care for integrating depression care within routine PHC services is highlighted.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation and scale-up of a single-visit, screen-and-treat approach with thermal ablation for sustainable cervical cancer prevention services: a protocol for a stepped-wedge cluster randomized trial in Kenya

Abstract:

Background

An important cervical cancer prevention strategy in low- and middle-income countries (LMICs) has been single-visit screen-and-treat (SV-SAT) approach, using visual inspection with acetic acid (VIA) and ablative treatment with cryotherapy to manage precancerous lesions. While SV-SAT with VIA and cryotherapy have established efficacy, its population level coverage and impact on reducing cervical cancer burden remains low. In Kenya, the estimated cervical cancer screening uptake among women aged 30–49 is 16% and up to 70% of screen-positive women do not receive treatment. Thermal ablation for treatment of precancerous lesions of the cervix is recommended by the World Health Organization and has the potential to overcome logistical challenges associated with cryotherapy and facilitate implementation of SV-SAT approach and increase treatment rates of screen-positive women. In this 5-year prospective, stepped-wedge randomized trial, we plan to implement and evaluate the SV-SAT approach using VIA and thermal ablation in ten reproductive health clinics in central Kenya.

Methods

The study aims to develop and evaluate implementation strategies to inform the national scale-up of SV-SAT approach with VIA and thermal ablation through three aims: (1) develop locally tailored implementation strategies using multi-level participatory method with key stakeholders (patient, provider, system-level), (2) implement SV-SAT approach with VIA and thermal ablation and evaluate clinical and implementation outcomes, and (3) assess the budget impact of SV-SAT approach with VIA and thermal ablation compared to single-visit, screen-and-treat method using cryotherapy.

Discussion

Our findings will inform national scale-up of the SV-SAT approach with VIA and thermal ablation. We anticipate that this intervention, along with tailored implementation strategies will enhance the adoption and sustainability of cervical cancer screening and treatment compared to the standard of care using cryotherapy.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ ADCC’s Improving Goal Concordant Care Initiative: Implementing Primary Palliative Care Principles

Abstract:

Background

High-quality, timely goals of care communication (GOCC) may improve patient and caregiver outcomes and promote care that is consistent with patient preferences.

Problem

Cancer patients, and their loved ones, appreciate GOCC; however, oncologists often lack formal communication training, institutional support and structures necessary to promote the delivery, documentation, and longitudinal follow-up of GOCC.

Proposed solution

The Alliance of Dedicated Cancer Centers (ADCC), representing 10 U.S. academic cancer hospitals, undertook the Improving Goal Concordant Care Initiative (IGCC). This national, 3-year implementation initiative was designed in Fall 2019 by a workgroup of quality, oncology, and palliative care leaders, as well as patient and family advisory committee members (PFAC). IGCC addresses systemic gaps by requiring four core components for participation: 1) Implementation of a formal communication skills training (CST) program, 2) Structured GOCC documentation in the electronic medical record that is visible to all clinicians, 3) Expectations regarding the timing and patient populations for GOCC, and 4) Implementation of a measurement framework.

Method

Dyads of palliative and oncology leaders committed to attend regularly scheduled, ADCC-led, virtual meetings during the design and implementation phase, incorporating PFAC feedback at every stage. Using the RE-AIM framework, we describe process and outcome evaluation measures defined by implementation and measures workgroups and collected routinely, including: CST completion; trainee evaluation response rate, trainee-reported quality of CST, trainee changes in self-efficacy and distress; percent of high-priority patients participating in GOCC, and patient-reported response to the “Heard and Understood” scale (HU). IGCC's impact will be assessed using claims-based utilization metrics near the end of life (EOLM) and followed longitudinally. Qualitative evaluations near the completion of IGCC will provide insight into perceived barriers, enabling factors, and sustainability.

Outcomes

Implementation of all IGCC components has begun at all sites. ADCC-wide, 35% of MD/DOs have completed CST (range by site: 8%–100%). CST is highly rated; in Quarter 3, 2022, 93%–100%, 90%–100% and 87%–100% of respondents reported above average to excellent CST quality, likelihood to use the skills and likelihood to recommend CST to others, respectively. Clinician self-efficacy and distress ratings are expected in late 2023. All sites have identified patient populations and continue to refine automated triggers and timelines; uptake of GOCC documentation has been slow. Eight of 10 sites have submitted patient-reported HU data. EOLM data are expected for all sites in early 2024.

Lesson learned

Flexibility in implementation with shared definitions, measures, and learnings about approaches optimizes the ability of all centers to collaborate and make progress in improving GOCC. Flexibility adds to the complexity of understanding intervention effectiveness, the critical intervention components and the fidelity necessary to achieve specific outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Adapting Evidence-Based Falls Prevention Programs for Remote Delivery — Implementation Insights through the RE-AIM Evaluation Framework to Promote Health Equity

Abstract:

COVID-19 disproportionally impacted the health and well-being of older adults—many of whom live with chronic conditions—due to their higher risk of dying and being hospitalized. It also created several secondary pandemics, including increased falls risk, sedentary behavior, social isolation, and physical inactivity due to limitations in mobility from lock-down policies. With falls as the leading cause of preventable death and hospitalizations, it became vital for in-person evidence-based falls prevention programs (EBFPPs) to pivot to remote delivery. In Spring 2020, many EBFPP administrators began re-designing programs for remote delivery to accommodate physical distancing guidelines necessitated by the pandemic. Transition to remote delivery was essential for older adults and persons with disabilities to access EBFPPs for staying healthy, falls and injury free, out of hospitals, and also keeping them socially engaged. We collaborated with the Administration on Community Living (ACL), the National Council on Aging (NCOA), and the National Falls Prevention Resource Center (NFPRC), for an in-depth implementation evaluation of remotely delivered EBFPPs. We examined the process of adapting and implementing four EBFPPs for remote delivery, best practices for implementing the programs remotely within the RE-AIM evaluation framework. This enhances NFPRC’s ongoing work supporting dissemination, implementation, and sustainability of EBFPPs. We purposively sampled organizations for maximum variation in organization and provider type, geographic location, and reach of underserved older populations (Black, Indigenous, or other People of Color (BIPOC), rural, disabilities).

This qualitative evaluation includes provider-level data from semi-structured interviews (N = 22) with program administrators, staff, and leaders. The interview guide included what, why, and how adaptations were made to EBFPP interventions and implementation strategies using Wiltsey-Stirman (2019) adaptations framework (FRAME), reach, and implementation outcomes (acceptability, feasibility, fidelity, and costs; Proctor et al., 2011), focusing on equity to learn for whom these programs were working and opportunities to address inequities. Findings demonstrate remote EBFPPs made planned and fidelity-consistent adaptations to remote delivery in partnership with researchers and community organizations, focusing on participant safety both in program content and delivery. Supports using and accessing technology were needed for delivery sites and leaders to facilitate engagement, and improved over time. While remote EBFPP delivery has increased access to EBFPPs for some populations from the perspective of program administrator, leaders, and staff (e.g., caregivers, rural-dwellers, persons with physical disabilities), the digital divide remains a barrier in access to and comfort using technology. Remote-delivered EBFPPs were acceptable and feasible to delivery organizations and leaders, were able to be delivered with fidelity using adaptations from program developers, but were more resource intensive and costly to implement compared to in-person. This work has important implications beyond the pandemic. Remote delivery has expanded access to groups traditionally underserved by in-person programming, particularly disability communities. This work will help answer important questions about reach, accessibility, feasibility, and cost of program delivery for older adults and people with disabilities at risk for falls, those living with chronic conditions, and communities most vulnerable to disparities in access to health care, health promotion programming, and health outcomes. It will also provide critical information to funders about elements required to adapt EBFPPs proven effective in in-person settings for remote delivery with fidelity to achieve comparable outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Monitoring and evaluating the implementation of essential packages of health services

Abstract:

Essential packages of health services (EPHS) are a critical tool for achieving universal health coverage, especially in low-income and lower middle-income countries. However, there is a lack of guidance and standards for monitoring and evaluation (M&E) of EPHS implementation. This paper is the final in a series of papers reviewing experiences using evidence from the Disease Control Priorities, third edition publications in EPHS reforms in seven countries. We assess current approaches to EPHS M&E, including case studies of M&E approaches in Ethiopia and Pakistan. We propose a step-by-step process for developing a national EPHS M&E framework. Such a framework would start with a theory of change that links to the specific health system reforms the EPHS is trying to accomplish, including explicit statements about the ‘what’ and ‘for whom’ of M&E efforts. Monitoring frameworks need to consider the additional demands that could be placed on weak and already overstretched data systems, and they must ensure that processes are put in place to act quickly on emergent implementation challenges. Evaluation frameworks could learn from the field of implementation science; for example, by adapting the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to policy implementation. While each country will need to develop its own locally relevant M&E indicators, we encourage all countries to include a set of core indicators that are aligned with the Sustainable Development Goal 3 targets and indicators. Our paper concludes with a call to reprioritise M&E more generally and to use the EPHS process as an opportunity for strengthening national health information systems. We call for an international learning network on EPHS M&E to generate new evidence and exchange best practices.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Addressing the Know-Do Gap in Adolescent HIV: Framing and Measuring Implementation Determinants, Outcomes, and Strategies in the AHISA Network

Abstract:

Implementation science (IS) uses systematic methods to close gaps between research and practice by identifying and addressing barriers to implementation of evidence-based interventions (EBIs). To reach UNAIDS HIV targets, IS can support programs to reach vulnerable populations and achieve sustainability. We studied the application of IS methods in 36 study protocols that were part of the Adolescent HIV Prevention and Treatment Implementation Science Alliance (AHISA). Protocols focused on youth, caregivers, or healthcare workers in high HIV-burden African countries and evaluated medication, clinical and behavioral/social EBIs. All studies measured clinical outcomes and implementation science outcomes; most focused on early implementation outcomes of acceptability (81%), reach (47%), and feasibility (44%). Only 53% used an implementation science framework/theory. Most studies (72%) evaluated implementation strategies. Some developed and tested strategies, while others adapted an EBI/strategy. Harmonizing IS approaches allows cross study learning and optimization of delivery of EBIs and could support attainment of HIV goals.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Population-based implementation of behavioral health detection and treatment into primary care: early data from New York state

Abstract:

Background

The Collaborative Care Model is a well-established, evidence-based approach to treating depression and other common behavioral health conditions in primary care settings. Despite a robust evidence base, real world implementation of Collaborative Care has been limited and very slow. The goal of this analysis is to better describe and understand the progression of implementation in the largest state-led Collaborative Care program in the nation—the New York State Collaborative Care Medicaid Program.

Data are presented using the RE-AIM model, examining the proportion of clinics in each of the model’s five steps from 2014 to 2019.

Methods

We used the RE-AIM model to shape our data presentation, focusing on the proportion of clinics moving into each of the five steps of this model over the years of implementation. Data sources included: a New York State Office of Mental Health clinic tracking database, billing applications, quarterly reports, and Medicaid claims.

Results

A total of 84% of clinics with which OMH had an initial contact [n = 611clinics (377 FQHCs and 234 non-FQHCs)] received some form of training and technical assistance. Of those, 51% went on to complete a billing application, 41% reported quarterly data at least once, and 20% were able to successfully bill Medicaid. Of clinics that reported data prior to the first quarter of 2019, 79% (n = 130) maintained Collaborative Care for 1 year or more. The receipt of any training and technical assistance was significantly associated with our implementation indices: (completed billing application, data reporting, billing Medicaid, and maintaining Collaborative Care). The average percent of patient improvement for depression and anxiety across 155 clinics that had at least one quarter of data was 44.81%. Training and technical assistance source (Office of Mental Health, another source, or both) and intensity (high/low) were significantly related to implementation indices and were observed in FQHC versus non-FQHC samples.

Conclusions

Offering Collaborative Care training and technical assistance, particularly high intensity training and technical assistance, increases the likelihood of implementation. Other state-wide organizations might consider the provision of training and technical assistance when assisting clinics to implement Collaborative Care.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text open access in the journal Epilepsy & Behavior

Authors:

✪ Open Access

Read the full text open access in the journal Applied Ergonomics

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Journal of Pain and Symptom Management

Abstract:

Background

Problem

Proposed solution

Method

Outcomes

Lesson learned

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Global Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusions