Sarah Gimbel Archives - Implementation Science at UW

✪ Cost of an Audit and Feedback intervention to increase uptake of maternal and child health services in Mozambique’s Primary health care

Abstract:

Introduction

Despite high coverage of facility-based maternal and child health (MCH) services in Mozambique, preventable maternal and neonatal deaths remain among the highest globally. To address this, the Integrated District Evidence-to-Action (IDEAs) program was implemented from 2016 to 2020 in central Mozambique as a facility-level Audit and Feedback (A&F) strategy. IDEAs adapted traditional A&F into three components: 1) biannual facility readiness assessments, 2) A&F meetings to develop action plans, and 3) supportive supervision with funding for implementation. This study estimates total and component-specific implementation costs of IDEAs and compares them to average district health budgets.

Methods

Costs were estimated from a payer perspective following CHEERS guidelines, using both Gross and Microcosting methods. Costs were annualized over five years (2016–2020) with a 3% discount rate and are reported in 2020 USD. Staff time estimates were based on program staff consultations and national salary data. Outcomes include average cost per district and total annual cost by intervention component. We conducted a deterministic sensitivity analysis to identify cost drivers with the most significant impact on the overall cost.

Results

The IDEAs programs total (2016–2020) incurred total costs were $2,224,341 (2020 USD), with $1,702,648 (76.5%) for recurrent expenses and $495,323 (22.3%) for Capital expenses. Average annual district-level costs were $41,967, including A&F meetings ($10,893; 26.0%), Capital expenditures ($8255; 19.7%), targeted support ($9323; 22.2%) which includes $5700 (13.6%) for district-level cash transfers and $3623 (8.6%) for facility supervision, and readiness assessments ($6351; 15.1%).Per diems accounted for 52.0% of A&F meeting costs. IDEAs represented approximately 6.6% of the average district health budget. Implementation involved 33 participants with 2560 h yearly per district. Capital expenses were highly sensitive to when applying a standard 25% increase or decrease compared to other cost categories.

Conclusion

Our findings offer practical guidance for district-level planners to adapt and scale IDEAs. Policymakers and donors should integrate recurring costs into budgets and explore cost-saving strategies like virtual tools or streamlined meetings to improve sustainability. Future research must assess long-term integration into government programs and test alternative approaches across diverse low-resource settings to guide scaling.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Exploring fidelity and its influence on effectiveness in an audit and feedback strategy implemented in a low-resource setting: an application of regression modeling

Abstract:

Background

Assessing implementation fidelity—the degree to which a program is implemented as intended—is essential to understand whether poor outcomes are due to implementation problems or the design of an intervention. Few studies in health research have documented the association between implementation fidelity and effectiveness. The Integrated District Evidence-to-Action (IDEAs) is a multicomponent audit and feedback strategy designed to improve the implementation of maternal and child clinical guidelines in Mozambique. In a previous study, we found mixed results of IDEAs effectiveness. The objective of the present study is to understand how implementation fidelity may have influenced the effectiveness of the strategy.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces in Mozambique between 2016 and 2020. We used the conceptual framework for implementation fidelity to guide descriptive analysis of IDEAs adherence. Regression modeling was used to study patterns of the direction of association between measures of fidelity and effectiveness for ten service delivery outcomes and five service readiness outcomes.

Results

We describe adherence on 15 measures of fidelity, of which 12 had high fidelity. Poor fidelity was found in conducting facility service readiness assessments and completing micro-interventions from action plans. Service delivery measures tended to be positively associated with participation and degree of micro-intervention completion and negatively associated with a higher number of action plans elaborated by participating teams. For the service readiness outcomes, delivery of essential care was positively associated with participation and micro-intervention completion, and staff availability was negatively associated with supervision.

Conclusion

Participation in audit and feedback meetings, the number of action plans elaborated, and the degree of completion of micro-interventions seem to be related to the effectiveness results. IDEAs should be adapted to reduce the number of action plans elaborated and promote better micro-intervention completion. Additionally, combining audit and feedback strategies with other strategies might enhance effectiveness in service outcomes. This study examines how to analyze the link between fidelity and effectiveness of a strategy to inform better design and recommend context-specific improvements.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ “Though there are some challenges, we try our best to follow the guidelines”: a qualitative study exploring determinants of providing guideline-adherent care to hospitalized children in Kenya

Abstract:

Background

Clinical treatment guidelines are designed to improve quality of care by offering clear recommendations for health workers; however, across many settings, implementing guidelines is a challenge. For over 20 years, comprehensive World Health Organization guidelines for care of hospitalized children have provided guidance for treating the primary causes of childhood death. These recommendations were adapted in Kenya and codified in the Basic Paediatric Protocol; however, adherence to these evidence-based interventions remains suboptimal.

Methods

This qualitative study identified the barriers and facilitators of providing guideline-adherent care to children admitted to two hospitals in Kenya. The semi-structured question guide was informed by the Theoretical Domains Framework (TDF). Three focus group discussions and 16 in-depth interviews were conducted with 35 health workers. Participants were nurses, doctors, clinical officers, or nutritionists (including in-charges and clinical supervisors). Interviews were audio recorded and transcribed. Transcripts were coded using a TDF-based codebook, validated, and analyzed for themes.

Results

TDF domains with the greatest influence on the thematic findings were environmental context and resources, social influences, beliefs about consequences, and beliefs about capabilities. Health workers were knowledgeable about guidelines and felt strongly that adherence to them was beneficial; however, they also faced barriers implementing them. Challenges related to the environmental context were pervasive, including shortages of staff and supplies. Participants praised the simplicity of guidelines but also noted that simplified diagnostic criteria don’t align with complex patient presentations. While guidelines empowered some nurses to make clinical decisions, respondents reported that strict professional roles sometimes delayed diagnosis and treatment. Further, health workers reported some deviations were intentional (ex. when guidelines were not aligned to their beliefs) and other times they were unintentional (ex. when complex patient presentations make guideline adherence difficult).

Conclusions

Knowledge of guidelines and motivation to use them were not major determinants in this analysis. Rather, human and material resource shortages presented the greatest barrier to guideline adherence in this setting. Improving guidelines by involving health workers in participatory development of guidelines would improve both clarity and feasibility. Health workers are well-versed in guideline recommendations, so educational strategies should focus on knowledge gaps or changes in the latest version of guidelines.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Optimizing healthcare for blood donors at risk of transfusion-transmissible infections: pre-implementation mixed methods protocol

Abstract:

In the Peruvian Amazon, a significant proportion of replacement blood donors test reactive for HIV, HTLV-1/2, and other transfusion-transmissible infections but often receive no subsequent care. Optimizing healthcare for these individuals can mitigate adverse outcomes by enabling early diagnosis and management. Effective coordination between Blood Bank and Infectious Diseases services is essential to provide comprehensive care. To address this challenge, this study applies an Implementation Science approach to design and assess an innovation that enhances healthcare for blood donors affected by transfusion-transmissible infections. A pre-implementation mixed methods study will be conducted at two hospitals in the Peruvian Amazon, employing the Consolidated Framework for Implementation Research (CFIR) and a systems engineering tool (mapping). The study will focus on the inner setting domain of CFIR and map the care continuum to identify contextual determinants that may influence implementation. It has three specific aims planned for the future: first, to use a convergent mixed methods approach to examine the care continuum of blood donors and the inner settings; second, to co-design an innovation through qualitative and participatory methods, integrating Blood Bank and Infectious Diseases services via the hospital information management system; and third, to evaluate the feasibility, appropriateness, and acceptability of the co-designed innovation through a pilot. Replacement blood donation and fragmented healthcare systems are common challenges in other low- and middle-income countries. The findings of this study can inform future implementation research and policy in similar settings.

Paper context

Main findings: This study will co-design and pilot an innovation to improve how blood donors at risk of transfusion-transmissible infections receive screening results, confirmatory testing, and care, by integrating Blood Bank and Infectious Diseases services through digital tools.

Added knowledge: This study employs a participatory, mixed-methods implementation science approach to systematically assess and address gaps in blood donor healthcare, providing a scalable methodology while ensuring context-specific, actionable interventions for resource-limited settings.

Global health impact for policy and action: This study will drive digital innovations in blood donor healthcare to strengthen blood safety and infectious disease control, while framing a pragmatic, adaptable approach for integrating fragmented healthcare systems in resource-limited settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Systems analysis and improvement to optimize opioid use disorder care quality and continuity for patients exiting jail (SAIA-MOUD)

Abstract:

Background

Between 2012–2022 opioid-related overdose deaths in the United States, including Washington State, have risen dramatically. Opioid use disorder (OUD) is a complex, chronic, and criminalized illness with biological, environmental, and social causes. One-fifth of people with OUD have recent criminal-legal system involvement; > 50% pass through WA jails annually.

Medications for Opioid Use Disorder (MOUD) can effectively treat OUD. WA has prioritized improving access to MOUD, including for those in jails. As patients in jail settings are systematically marginalized due to incarceration, it is critical to foster connections to MOUD services upon release, an acknowledged period of high overdose risk. Currently, there is insufficient focus on developing strategies to foster linkages between jail-based MOUD and referral services.

The Systems Analysis and Improvement Approach (SAIA), an evidence-based implementation strategy, may optimize complex care cascades like MOUD provision and improve linkages between jail- and community-based providers. SAIA bundles systems engineering tools into an iterative process to guide care teams to visualize cascade drop-offs and prioritize steps for improvement; identify modifiable organization-level bottlenecks; and propose, implement, and evaluate modifications to overall cascade performance. The SAIA-MOUD study aims to strengthen the quality and continuity of MOUD care across jail and referral clinics in King County, WA, and ultimately reduce recidivism and mortality.

Methods

We will conduct a quasi-experimental evaluation of SAIA effectiveness on improving MOUD care cascade quality and continuity for patients receiving care in jail and exiting to referral clinics; examine determinants of SAIA-MOUD adoption, implementation, and sustainment; and determine SAIA-MOUD’s cost and cost-effectiveness. Clinic teams with study team support will deliver the SAIA-MOUD intervention at the jail-based MOUD program and three referral clinics over a two-year intensive phase, followed by a one-year sustainment phase where SAIA implementation will be led by King County Jail MOUD staff without study support to enable pragmatic evaluation of sustained implementation.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line care providers to identify low-cost, contextually appropriate health care improvement strategies. By integrating SAIA into MOUD care provision in jail and linked services, this pragmatic trial is designed to test a model for national scale-up.

Trial registration

ClinicalTrials.gov NCT06593353 (registered 09/06/2024).

Contributions to the literature

Our study examines whether the introduction of an evidence-based, user-friendly, low-cost package of systems engineering tools can optimize investments in providing medications for opioid use disorder for individuals during the high-risk period immediately after exiting jail.
This is the first application of the Systems Analysis and Improvement Approach (SAIA) across health system levels to optimize both care delivery and continuity of care.
Our study is designed to provide decision-makers with evidence they need to decide whether to invest in systems engineering approaches during the expansion of MOUD in jail settings, including information on acceptability, feasibility, effectiveness and cost.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Peer Review reports

✪ Systems analysis and improvement approach to optimize tuberculosis (SAIA-TB) screening, treatment, and prevention in South Africa: a stepped-wedge cluster randomized trial

Abstract:

Background

The use of systems engineering tools, including the development and use of care cascades using routinely collected data, process mapping, and continuous quality improvement, is used for frontline healthcare workers to devise systems level change. South Africa experiences high rates of tuberculosis (TB) infection and disease as well as HIV co-infection. The Department of Health has made significant gains in HIV services over the last two decades, reaching their set “90–90-90” targets for HIV. However, TB services, although robust, have lagged in comparison for both disease and infection. The Systems Analysis and Improvement Approach (SAIA) is a five-step implementation science method, drawn from systems engineering, to identify, define, and implement workflow modifications using cascade analysis, process mapping, and repeated quality improvement cycles within healthcare facilities.

Methods

This stepped-wedge cluster randomized trial will evaluate the effectiveness of SAIA on TB (SAIA-TB) cascade optimization for patients with TB and high-risk contacts across 16 clinics in four local municipalities in the Sarah Baartman district, Eastern Cape, South Africa. We hypothesize that SAIA-TB implementation will lead to a 20% increase in each of: TB screening, TB preventive treatment initiation, and TB disease treatment initiation during the 18-month intervention period. Focus group discussions and key informant interviews with clinic staff will also be conducted to determine drivers of implementation variability across clinics.

Discussion

This study has the potential to improve TB screening, treatment initiation, and completion for both active disease and preventive measures among individuals with and without HIV in a high burden setting. SAIA-TB provides frontline health care workers with a systems-level view of their care delivery system with the aim of sustainable systems-level improvements.

Trial registration

Clinicaltrials.gov, NCT06314386. Registered 18 March 2024, https://clinicaltrials.gov/study/NCT06314386. NCT06314386.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

Authors:

Carmen E. Hazim , Igor Dobe, Stephen Pope, Kristjana H. Ásbjörnsdóttir, Orvalho Augusto, Fernando Pereira Bruno, Sergio Chicumbe, Norberto Lumbandali, Inocêncio Mate, Elso Ofumhan, Sam Patel, Riaze Rafik, Kenneth Sherr, Veronica Tonwe, Onei Uetela, David Watkins, Sarah Gimbel, & Ana O. Mocumbi

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: March 2024

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services.
Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

Methods

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be “scaled up” with delivery by district health supervisors (rather than research staff) and will be “scaled out” via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer’s perspective.

Discussion

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

Authors:

Aneth Dinis, Quinhas Fernandes, Bradley H Wagenaar, Sarah Gimbel, Bryan J Weiner, Grace John-Stewart, Ermyas Birru, Stephen Gloyd, Ruth Etzioni, Dorlim Uetela, Isaías Ramiro, Artur Gremu, Orvalho Augusto, Stélio Tembe, Jaime L Mário, Jalilo E Chinai, Alfredo F Covele, Cassimo M Sáide, Nélia Manaca & Kenneth Sherr

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

Results

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities’ first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. “Weak diagnosis or management of obstetric complications” was identified as the main problem, and “actions to reinforce norms and protocols” was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

Conclusion

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Introduction

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Global Health Action

Abstract:

Paper context

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration

Contributions to the literature

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Methods

Discussion

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Methods

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal The Lancet HIV