Skip to content

Effectiveness of the Systems Analysis and Improvement Approach to optimise outpatient mental, neurological, and substance-use disorder treatment cascades in Mozambique: a cluster-randomised trial

Authors:

Vasco F J Cumbe, Alberto Muanido, Morgan Turner, João Nhalimue Jala Jr, Ernesto Eusébio Armando, Flávia Faduque, Ernesto Rodrigo Xerinda, Kenneth Sherr, Brian P Flaherty, Monisha Sharma & Bradley H Wagenaar

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2026

Read the full text in the subscription access journal The Lancet: Psychiatry

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Authors:

Aneth Dinis, Orvalho Augusto, Quinhas Fernandes, Ermyas Birru, Ruth Etzioni, Sarah Gimbel, Stephen Gloyd, Isaías Ramiro, Artur Gremu, Grace John-Stewart, Bradley H. Wagenaar, Bryan J. Weiner, Sérgio Chicumbe, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Integrating behavioral health care into a low-barrier HIV clinic using the Collaborative Care Model: a mixed methods evaluation of patient care cascade outcomes and determinants

Authors:

Scott Halliday, Lydia A. Chwastiak, Kaitlin Zinsli, Ramona Emerson, Teagan Wood, Meena S. Ramchandani, Kenneth Sherr, Judith I. Tsui, Bradley H. Wagenaar, Deepa Rao, & Julia C. Dombrowski

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Low-barrier HIV care is an evidence-based intervention to improve HIV outcomes among those who have complex barriers to care, but the walk-in model poses challenges to integrating behavioral health services. We evaluated the acceptability and feasibility of a Collaborative Care Model (CoCM) for treatment of depression and opioid use disorder in a low-barrier clinic.

Methods

In a sequential explanatory mixed methods pilot study, we accessed data from patient records to generate a care cascade for the number of patients enrolled in the first six months of the program and conducted individual interviews with patients and staff to interpret the care cascade findings.

Results

Among 175 patients who visited the clinic, 36% were screened for, 24% were referred to, 15% completed an intake for, and 9% engaged in CoCM. The interviews revealed that screening was limited by a lack of clarity among staff about services offered in CoCM, staff forgetting the screening process, and limited time during patent visits. Referrals were limited by low buy-in among staff and patient complexity. Intakes were limited by time and space constraints in the care setting and competing acute patient needs. The care manager’s ability to embody the clinic’s culture facilitated engagement among patients who completed intakes.

Conclusions

Staff perceived CoCM to be acceptable and feasible to implement, but only in the context of multiple barriers to implementation and challenges to systematic screening and measurement-based care.

Trial registration

Not applicable.

Contributions to the literature

  • We evaluated implementation of the Collaborative Care Model, an evidence-based model for integrating behavioral healthcare into primary care settings, for treating depression and opioid-use disorder in a low-barrier HIV clinic. To our knowledge, this is the first implementation of the Collaborative Care Model in a low-barrier HIV clinic.
  • By specifying a multi-component implementation strategy, our evaluation provides a foundation for selecting and tailoring implementation strategies for use with integrated behavioral healthcare interventions.
  • Through use of a joint visual display showing a care cascade with illustrative quotes, our evaluation demonstrates a novel approach to using explanatory mixed methods in implementation science.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Methodology for adapting a co-created early childhood development intervention and implementation strategies for use by frontline workers in India and Guatemala: a systematic application of the FRAME-IS framework

Authors:

Amruta Bandal, Sara Hernández, Revan Mustafa, Karyn Choy, Namrata Edwards, Magdalena Guarchaj, Marinés Mejía Alvarez, Anushree Sane, Scott Tschida , Chetna Maliye, Ann Miller, Abhishek Raut, Roopa Srinivasan, Morgan Turner, Bradley H. Wagenaar , Ilgi Ertem, Maria del Pilar Grazioso, Subodh S. Gupta, Vibha Krishnamurthy, and Peter Rohloff.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2026

Read the full text in the open access journal Global Health Action

Abstract:

There is little evidence on optimizing the effectiveness and implementation of evidence-based early childhood development (ECD) interventions when task-shifted to frontline workers. In this Methods Forum paper, we describe our adaptation of the International Guide for Monitoring Child Development (GMCD) for task-shifting to frontline workers in Guatemala and India. In 2021–2022, implementers, trainers, frontline workers, caregivers, and international GMCD experts collaborated to adapt the GMCD for a task shifted implementation by frontline workers. We used an eight-step co-creating process: assembling a multidisciplinary team, training on the existing package, working groups to begin modifications, revision of draft modifications, tailoring of visual materials and language, train-the-trainers activities, pilot frontline worker trainings, final review and feedback. Preliminary effectiveness of adaptations was evaluated through narrative notes and group-based qualitative feedback following pilot trainings with 16 frontline workers in India and 6 in Guatemala. Final adaptations included: refining training techniques to match skill levels and learning styles of frontline workers; tailoring all visual materials to local languages and contexts; design of job aids for providing developmental support messages; modification of referral and triage processes for children in need of enhanced support and specialty referral; and creation of post-training support procedures. Feedback from pilot trainings included: (1) group consensus that training improved ECD skills and knowledge across multiple domains; and (2) feedback on ongoing needed adjustments to pacing, use of video-based vs. role-playing materials, and time allocated to small group work. We use the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) framework to document our adaptations. The co-creating approach we use, as well as systematic documentation of adaptation decisions will be of use to other community-based early childhood interventions and implementation strategies.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

Authors:

Aneth Dinis, Quinhas Fernandes, Bradley H Wagenaar, Sarah Gimbel, Bryan J Weiner, Grace John-Stewart, Ermyas Birru, Stephen Gloyd, Ruth Etzioni, Dorlim Uetela, Isaías Ramiro, Artur Gremu, Orvalho Augusto, Stélio Tembe, Jaime L Mário, Jalilo E Chinai, Alfredo F Covele, Cassimo M Sáide, Nélia Manaca & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

Results

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities’ first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. “Weak diagnosis or management of obstetric complications” was identified as the main problem, and “actions to reinforce norms and protocols” was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

Conclusion

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Strengthening integrated depression services within routine primary health care using the RE-AIM framework in South Africa

Authors:

Inge Petersen, Christopher G. Kemp, Deepa Rao, Bradley H. Wagenaar, Max Bachmann, Kenneth Sherr, Tasneem Kathree, Zamasomi Luvuno, André Van Rensburg, Sithabisile Gugulethu Gigaba, Londiwe Mthethwa, Merridy Grant, One Selohilwe, Nikiwe Hongo, Gillian Faris, Christy-Joy Ras, Lara Fairall, Sanah Bucibo, & Arvin Bhana

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2023

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Integration of mental health into routine primary health care (PHC) services in low-and middle-income countries is globally accepted to improve health outcomes of other conditions and narrow the mental health treatment gap. Yet implementation remains a challenge. The aim of this study was to identify implementation strategies that improve implementation outcomes of an evidence-based depression care collaborative implementation model integrated with routine PHC clinic services in South Africa. An iterative, quasi-experimental, observational implementation research design, incorporating the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework, was applied to evaluate implementation outcomes of a strengthened package of implementation strategies (stage two) compared with an initial evaluation of the model (stage one). The first stage package was implemented and evaluated in 10 PHC clinics and the second stage strengthened package in 19 PHC clinics (inclusive of the initial 10 clinics) in one resource-scarce district in the province of KwaZulu-Natal, South Africa. Diagnosed service users were more likely to be referred for counselling treatment in the second stage compared with stage one (OR 23.15, SE = 18.03, z = 4.04, 95%CI [5.03–106.49], p < .001). Training in and use of a validated, mandated mental health screening tool, including on-site educational outreach and technical support visits, was an important promoter of nurse-level diagnosis rates (OR 3.75, 95% CI [1.19, 11.80], p = 0.02). Nurses who perceived the integrated care model as acceptable were also more likely to successfully diagnose patients (OR 2.57, 95% CI [1.03–6.40], p = 0.043). Consistent availability of a clinic counsellor was associated with a greater probability of referral (OR 5.9, 95%CI [1.29–27.75], p = 0.022). Treatment uptake among referred service users remained a concern across both stages, with inconsistent co-located counselling services associated with poor uptake. The importance of implementation research for strengthening implementation strategies along the cascade of care for integrating depression care within routine PHC services is highlighted.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Application of the Expert Recommendations for Implementing Change (ERIC) compilation of strategies to health intervention implementation in low- and middle-income countries: a systematic review

Authors:

Kathryn L. Lovero, Christopher G. Kemp, Bradley H. Wagenaar, Ali Giusto, M. Claire Greene, Byron J. Powell & Enola K. Proctor

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2023

Read the full text in the open access journal Implementation Science

Abstract:

Background

The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research.

Methods

We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies.

Results

The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1–46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness.

Conclusions

While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Higher rates of mental health screening of adolescents recorded after provider training using simulated patients in a Kenyan HIV clinic: results of a pilot study

Authors:

Tessa Concepcion, Peter Mogere, Kenneth Ngure, Njoroge Mwathi, Roy Njiru, Boaz Kipkorir, Catherine Kiptinness, Gakuo Maina, Emmah Owidi, Tamara Owens, Pamela Kohler, Bradley H. Wagenaar, Shannon Dorsey, Pamela Y. Collins, and Jennifer Velloza

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2023

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Background

Kenyan adolescent girls and young women (AGYW) experience a dual burden of HIV and common mental disorders (CMD). HIV clinics are a key entry point for AGYW in need of integrated CMD and HIV care; however, rates of screening and referral for CMDs are low. Our objective was to test an evidence-based provider training strategy, simulated patient encounters (SPEs), on CMD service delivery for AGYW in a Kenyan HIV clinic.

Methods

This pilot study was conducted in a public HIV clinic in Thika, Kenya from January to November 2021. The simulated patient encounter (SPE) implementation strategy included case script development from prior qualitative work, patient actor training, and a three-day SPE training including four standardized mock clinical encounters followed by quantitative surveys assessing provider competencies for each encounter. We abstracted medical record data related to HIV and CMDs such as HIV status, reason for visit, CMD screening test performed, and counselling or referral information. We conducted an interrupted time series analysis using abstracted HIV and CMD screening rates from AGYW ages 16–25 years visiting the clinic 7 months before and 3 months after SPE training. We used generalized linear models to assess changes in CMD screening rates after training.

Results

A total of 10 providers participated in the training. Competency ratings improved across four mock encounters (mean score from 8.1 to 13.7) between first and fourth encounters. We abstracted all medical records (n = 1,154) including from 888 (76%) AGYW seeking HIV treatment, 243 (21%) seeking prevention services, and 34 (3%) seeking other services. CMD screening rates increased immediately following training from 8 to 21% [relative risk (RR) = 2.57, 95% confidence interval (CI) = 1.34–4.90, p < 0.01]. The 3 months following the SPE training resulted in an 11% relative increase in CMD screening proportion compared to the 7 months pre-SPE (RR: 1.11, 95% CI: 1.04–1.17, p < 0.01). Finally, 1% of all pre-SPE screens resulted in referral versus 5% of post-SPE screens (p = 0.07).

Conclusions

The SPE model is a promising implementation strategy for improving HIV provider competencies and CMD service delivery for adolescents in HIV clinics. Future research is needed to explore effects on adolescent clinical outcomes in larger trials.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**