Kenneth Sherr Archives - Implementation Science at UW

✪ Strengthening primary care facility management: a systematic review of management interventions, implementation strategies, and outcomes in six sub-Saharan African countries

Abstract:

Background

Although primary health care (PHC) is central to health system performance, effective facility-level management is a critical determinant of service quality, resource use, and improved health outcomes. We conducted a systematic review to synthesize evidence on interventions, implementation strategies, and outcomes aimed at strengthening PHC facility management in Sub-Saharan Africa (SSA).

Methods

We conducted a systematic review using thematic synthesis. Eight electronic databases were searched for peer-reviewed studies and grey literature published between 2012 and 2022, focusing on interventions targeting PHC facility management in SSA. Implementation strategies were mapped to the thematic cluster areas of the Expert Recommendations for Implementing Change (ERIC) framework. Implementation outcomes were classified using Proctor’s Implementation Outcome Framework, and management effectiveness domains were identified through thematic analysis.

Results

Of 3,752 studies screened, nine met the inclusion criteria. These studies represented six SSA countries: Botswana, Ethiopia, Kenya, South Africa, Tanzania, and Zambia. Four categories of intervention were identified: (1) training and capacity building programs, (2) peer-to-peer learning, (3) audit and feedback-based quality management systems, and (4) supportive supervision. These interventions were delivered through multiple implementation strategies, including training and education, coaching and mentoring, learning collaboratives, interactive continuous learning, and routine data monitoring. Acceptability was the most consistently reported implementation outcome. Improvements in management effectiveness were identified across four domains: financial management, organizational climate and culture, resource management and utilization, and human resource management. Five studies also reported intermediate service-level outcomes including improvements in maternal and child health indicators.

Conclusion

Interventions aimed at strengthening PHC facility management in SSA primarily emphasize skill development, collaboration, and ongoing managerial support, typically delivered through multiple strategies. However, few studies have evaluated these interventions using rigorous experimental or pragmatic study designs. More robust implementation research is needed to identify effective strategies for strengthening PHC facility management and supporting the consistent implementation of national PHC guidelines.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ An integrative review of implementation science in climate change and health adaptation research

Abstract:

Introduction

As climate change accelerates, reducing associated health risks requires uptake of effective approaches to adaptation at scale. However, translating climate change and health adaptation (CCHA) interventions into practice remains a persistent challenge for both researchers and practitioners. Implementation science provides tools to study methods and strategies that facilitate the adoption and sustainability of interventions into practice, but its application in the CCHA domain has not yet been examined.

Methods

In response, this integrative literature review identifies how implementation science has been applied to assess determinants, strategies, and outcomes of CCHA interventions, and to evaluate gaps, strengths, and limitations in the existing literature. Nineteen articles were identified through systematic searches of four databases and expert recommendations. Discrete data domains, defined a priori, were extracted and synthesized across articles.

Results

Findings demonstrated wide variability in the use of implementation frameworks, the identification and assessment of implementation strategies and outcomes, and the overall conceptualization of CCHA interventions. Findings highlight a critical opportunity to leverage implementation science as a tool to strengthen the assessment and uptake of CCHA efforts in public health practice.

Conclusion

In the face of the accelerating climate crisis, there is an urgent need for implementation science and climate change and health experts to work together to overcome conceptual and operational challenges to the use of implementation science frameworks and methods to advance the field.

Highlights

The formal use of implementation science in published CCHA research is limited.
Opportunities exist to adapt implementation science frameworks to CCHA research.
Investing in these opportunities can improve uptake of CCHA interventions.

View graphical abstract

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Effectiveness of the Systems Analysis and Improvement Approach to optimise outpatient mental, neurological, and substance-use disorder treatment cascades in Mozambique: a cluster-randomised trial

✪ Cost of an Audit and Feedback intervention to increase uptake of maternal and child health services in Mozambique’s Primary health care

Abstract:

Introduction

Despite high coverage of facility-based maternal and child health (MCH) services in Mozambique, preventable maternal and neonatal deaths remain among the highest globally. To address this, the Integrated District Evidence-to-Action (IDEAs) program was implemented from 2016 to 2020 in central Mozambique as a facility-level Audit and Feedback (A&F) strategy. IDEAs adapted traditional A&F into three components: 1) biannual facility readiness assessments, 2) A&F meetings to develop action plans, and 3) supportive supervision with funding for implementation. This study estimates total and component-specific implementation costs of IDEAs and compares them to average district health budgets.

Methods

Costs were estimated from a payer perspective following CHEERS guidelines, using both Gross and Microcosting methods. Costs were annualized over five years (2016–2020) with a 3% discount rate and are reported in 2020 USD. Staff time estimates were based on program staff consultations and national salary data. Outcomes include average cost per district and total annual cost by intervention component. We conducted a deterministic sensitivity analysis to identify cost drivers with the most significant impact on the overall cost.

Results

The IDEAs programs total (2016–2020) incurred total costs were $2,224,341 (2020 USD), with $1,702,648 (76.5%) for recurrent expenses and $495,323 (22.3%) for Capital expenses. Average annual district-level costs were $41,967, including A&F meetings ($10,893; 26.0%), Capital expenditures ($8255; 19.7%), targeted support ($9323; 22.2%) which includes $5700 (13.6%) for district-level cash transfers and $3623 (8.6%) for facility supervision, and readiness assessments ($6351; 15.1%).Per diems accounted for 52.0% of A&F meeting costs. IDEAs represented approximately 6.6% of the average district health budget. Implementation involved 33 participants with 2560 h yearly per district. Capital expenses were highly sensitive to when applying a standard 25% increase or decrease compared to other cost categories.

Conclusion

Our findings offer practical guidance for district-level planners to adapt and scale IDEAs. Policymakers and donors should integrate recurring costs into budgets and explore cost-saving strategies like virtual tools or streamlined meetings to improve sustainability. Future research must assess long-term integration into government programs and test alternative approaches across diverse low-resource settings to guide scaling.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Exploring fidelity and its influence on effectiveness in an audit and feedback strategy implemented in a low-resource setting: an application of regression modeling

Abstract:

Background

Assessing implementation fidelity—the degree to which a program is implemented as intended—is essential to understand whether poor outcomes are due to implementation problems or the design of an intervention. Few studies in health research have documented the association between implementation fidelity and effectiveness. The Integrated District Evidence-to-Action (IDEAs) is a multicomponent audit and feedback strategy designed to improve the implementation of maternal and child clinical guidelines in Mozambique. In a previous study, we found mixed results of IDEAs effectiveness. The objective of the present study is to understand how implementation fidelity may have influenced the effectiveness of the strategy.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces in Mozambique between 2016 and 2020. We used the conceptual framework for implementation fidelity to guide descriptive analysis of IDEAs adherence. Regression modeling was used to study patterns of the direction of association between measures of fidelity and effectiveness for ten service delivery outcomes and five service readiness outcomes.

Results

We describe adherence on 15 measures of fidelity, of which 12 had high fidelity. Poor fidelity was found in conducting facility service readiness assessments and completing micro-interventions from action plans. Service delivery measures tended to be positively associated with participation and degree of micro-intervention completion and negatively associated with a higher number of action plans elaborated by participating teams. For the service readiness outcomes, delivery of essential care was positively associated with participation and micro-intervention completion, and staff availability was negatively associated with supervision.

Conclusion

Participation in audit and feedback meetings, the number of action plans elaborated, and the degree of completion of micro-interventions seem to be related to the effectiveness results. IDEAs should be adapted to reduce the number of action plans elaborated and promote better micro-intervention completion. Additionally, combining audit and feedback strategies with other strategies might enhance effectiveness in service outcomes. This study examines how to analyze the link between fidelity and effectiveness of a strategy to inform better design and recommend context-specific improvements.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Pilot randomized controlled trial to assess the effectiveness of a heat risk reduction decision support platform and barriers and facilitators of its implementation

Abstract:

Background

Climate-sensitive hazards such as extreme heat are increasing in frequency and severity. Protecting population health requires hazard-specific risk assessment, selection of potential interventions, and support for intervention implementation. This process typically takes several years, constraining health adaptation to climate-sensitive hazards. The investigators have developed an online decision support platform, CHaRT, that links evidence-based, location-specific heat-health risk assessment with transparent analyses of risk drivers and evidence-based risk reduction guidance for use in local health departments (LHDs). CHaRT’s effectiveness in supporting delivery of effective health interventions has not been evaluated.

Methods

LHDs are the organizational unit being studied. In this pilot randomized controlled trial, LHDs from the conterminous US will be recruited in coordination with the National Association of City and County Health Officials (NACCHO). Thirty LHDs will be selected at random from interested participants. Fifteen will be randomized to receive the intervention, a facilitated engagement with CHaRT, and 15 will receive the control, a package with information on heat vulnerability assessment and potential interventions. Intervention and control packages will be delivered simultaneously. Facilitated engagement will include an introduction to the tool, user exploration of the tool, elective inclusion of site-specific data into the tool, follow-up sessions to address additional questions, and discussion with investigators regarding planning and implementation needs. Pre- and post-study surveys will be used to assess CHaRT’s effectiveness using the RE-AIM (Reach, Effectiveness, Acceptability, Implementation, Maintenance) framework and by comparing each site’s intentions to implement specific interventions. After the trial, barriers and facilitators of the CHaRT platform’s implementation will be assessed through key informant interviews with the intervention group and analyzed using the Consolidated Framework for Implementation Research (CFIR).

Discussion

This study will allow investigators to evaluate the public health impact of a decision support platform and to identify barriers and facilitators of its implementation. The results will guide future research into strategies for increasing public health adaptation to climate change at the speed and breadth required.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Integrating behavioral health care into a low-barrier HIV clinic using the Collaborative Care Model: a mixed methods evaluation of patient care cascade outcomes and determinants

Abstract:

Background

Low-barrier HIV care is an evidence-based intervention to improve HIV outcomes among those who have complex barriers to care, but the walk-in model poses challenges to integrating behavioral health services. We evaluated the acceptability and feasibility of a Collaborative Care Model (CoCM) for treatment of depression and opioid use disorder in a low-barrier clinic.

Methods

In a sequential explanatory mixed methods pilot study, we accessed data from patient records to generate a care cascade for the number of patients enrolled in the first six months of the program and conducted individual interviews with patients and staff to interpret the care cascade findings.

Results

Among 175 patients who visited the clinic, 36% were screened for, 24% were referred to, 15% completed an intake for, and 9% engaged in CoCM. The interviews revealed that screening was limited by a lack of clarity among staff about services offered in CoCM, staff forgetting the screening process, and limited time during patent visits. Referrals were limited by low buy-in among staff and patient complexity. Intakes were limited by time and space constraints in the care setting and competing acute patient needs. The care manager’s ability to embody the clinic’s culture facilitated engagement among patients who completed intakes.

Conclusions

Staff perceived CoCM to be acceptable and feasible to implement, but only in the context of multiple barriers to implementation and challenges to systematic screening and measurement-based care.

Trial registration

Not applicable.

Contributions to the literature

We evaluated implementation of the Collaborative Care Model, an evidence-based model for integrating behavioral healthcare into primary care settings, for treating depression and opioid-use disorder in a low-barrier HIV clinic. To our knowledge, this is the first implementation of the Collaborative Care Model in a low-barrier HIV clinic.
By specifying a multi-component implementation strategy, our evaluation provides a foundation for selecting and tailoring implementation strategies for use with integrated behavioral healthcare interventions.
Through use of a joint visual display showing a care cascade with illustrative quotes, our evaluation demonstrates a novel approach to using explanatory mixed methods in implementation science.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Building the Road to End the HIV Epidemic Through Coordinating and Capacity-Building Hubs to Enhance the Science of HIV Implementation REsearch (CHESHIRE): Reflections and Directions

Authors:

Debbie L Humphries, Carolyn M Audet, Bijal A Balasubramanian, Nanette Benbow, Christopher G Kemp, Robin Gaines Lanzi, Sung-Jae Lee, Hannah Mestel, Alexandra B Morshed, Brian Mustanski, April Pettit, Borsika A Rabin, Olivia Sadler, Alison B Hamilton, Mary-Louise E Millett, Sheree Schwartz, Kenneth Sherr, Nicole A Stadnick, & Dennis H Li

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: April 2025

Authors:

✪ Open Access

Read the full text in the open access journal BMC Primary Care

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access Journal of Climate Change and Health

Abstract:

Introduction

Methods

Results

Conclusion

Highlights

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal The Lancet: Psychiatry

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Introduction

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Trial registration

Contributions to the literature

Authors:

✪ Open Access

Read the full text open access in the journal JAIDS: Journal of Acquired Immune Deficiency Syndrome

Authors:

✪ Open Access

Read the full text open access in the journal JAIDS: Journal of Acquired Immune Deficiency Syndrome