Skip to content

Effectiveness of the Systems Analysis and Improvement Approach to optimise outpatient mental, neurological, and substance-use disorder treatment cascades in Mozambique: a cluster-randomised trial

Authors:

Vasco F J Cumbe, Alberto Muanido, Morgan Turner, João Nhalimue Jala Jr, Ernesto Eusébio Armando, Flávia Faduque, Ernesto Rodrigo Xerinda, Kenneth Sherr, Brian P Flaherty, Monisha Sharma & Bradley H Wagenaar

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2026

Read the full text in the subscription access journal The Lancet: Psychiatry

✪ Cost of an Audit and Feedback intervention to increase uptake of maternal and child health services in Mozambique’s Primary health care

Authors:

Ermyas Birru, Aneth Dinis, Jonny Crocker, Quinhas Fernandes, Sarah Gimbel, Steve Gloyd, Artur Gremu, Lisa R. Hirschhorn, Isaías Ramiro, Stelio Tembe, Orvalho Augusto & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2026

Read the full text in the open access journal Implementation Science Communications

Abstract:

Introduction

Despite high coverage of facility-based maternal and child health (MCH) services in Mozambique, preventable maternal and neonatal deaths remain among the highest globally. To address this, the Integrated District Evidence-to-Action (IDEAs) program was implemented from 2016 to 2020 in central Mozambique as a facility-level Audit and Feedback (A&F) strategy. IDEAs adapted traditional A&F into three components: 1) biannual facility readiness assessments, 2) A&F meetings to develop action plans, and 3) supportive supervision with funding for implementation. This study estimates total and component-specific implementation costs of IDEAs and compares them to average district health budgets.

Methods

Costs were estimated from a payer perspective following CHEERS guidelines, using both Gross and Microcosting methods. Costs were annualized over five years (2016–2020) with a 3% discount rate and are reported in 2020 USD. Staff time estimates were based on program staff consultations and national salary data. Outcomes include average cost per district and total annual cost by intervention component. We conducted a deterministic sensitivity analysis to identify cost drivers with the most significant impact on the overall cost.

Results

The IDEAs programs total (2016–2020) incurred total costs were $2,224,341 (2020 USD), with $1,702,648 (76.5%) for recurrent expenses and $495,323 (22.3%) for Capital expenses. Average annual district-level costs were $41,967, including A&F meetings ($10,893; 26.0%), Capital expenditures ($8255; 19.7%), targeted support ($9323; 22.2%) which includes $5700 (13.6%) for district-level cash transfers and $3623 (8.6%) for facility supervision, and readiness assessments ($6351; 15.1%).Per diems accounted for 52.0% of A&F meeting costs. IDEAs represented approximately 6.6% of the average district health budget. Implementation involved 33 participants with 2560 h yearly per district. Capital expenses were highly sensitive to when applying a standard 25% increase or decrease compared to other cost categories.

Conclusion

Our findings offer practical guidance for district-level planners to adapt and scale IDEAs. Policymakers and donors should integrate recurring costs into budgets and explore cost-saving strategies like virtual tools or streamlined meetings to improve sustainability. Future research must assess long-term integration into government programs and test alternative approaches across diverse low-resource settings to guide scaling.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Exploring fidelity and its influence on effectiveness in an audit and feedback strategy implemented in a low-resource setting: an application of regression modeling

Authors:

Aneth Dinis, Quinhas Fernandes, Orvalho Augusto, Bryan J. Weiner, Sarah Gimbel, Ermyas Birru, Dorlim Uetela, Grace John-Stewart, Stephen Gloyd, Isaias Ramiro & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2025

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Assessing implementation fidelity—the degree to which a program is implemented as intended—is essential to understand whether poor outcomes are due to implementation problems or the design of an intervention. Few studies in health research have documented the association between implementation fidelity and effectiveness. The Integrated District Evidence-to-Action (IDEAs) is a multicomponent audit and feedback strategy designed to improve the implementation of maternal and child clinical guidelines in Mozambique. In a previous study, we found mixed results of IDEAs effectiveness. The objective of the present study is to understand how implementation fidelity may have influenced the effectiveness of the strategy.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces in Mozambique between 2016 and 2020. We used the conceptual framework for implementation fidelity to guide descriptive analysis of IDEAs adherence. Regression modeling was used to study patterns of the direction of association between measures of fidelity and effectiveness for ten service delivery outcomes and five service readiness outcomes.

Results

We describe adherence on 15 measures of fidelity, of which 12 had high fidelity. Poor fidelity was found in conducting facility service readiness assessments and completing micro-interventions from action plans. Service delivery measures tended to be positively associated with participation and degree of micro-intervention completion and negatively associated with a higher number of action plans elaborated by participating teams. For the service readiness outcomes, delivery of essential care was positively associated with participation and micro-intervention completion, and staff availability was negatively associated with supervision.

Conclusion

Participation in audit and feedback meetings, the number of action plans elaborated, and the degree of completion of micro-interventions seem to be related to the effectiveness results. IDEAs should be adapted to reduce the number of action plans elaborated and promote better micro-intervention completion. Additionally, combining audit and feedback strategies with other strategies might enhance effectiveness in service outcomes. This study examines how to analyze the link between fidelity and effectiveness of a strategy to inform better design and recommend context-specific improvements.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Authors:

Aneth Dinis, Orvalho Augusto, Quinhas Fernandes, Ermyas Birru, Ruth Etzioni, Sarah Gimbel, Stephen Gloyd, Isaías Ramiro, Artur Gremu, Grace John-Stewart, Bradley H. Wagenaar, Bryan J. Weiner, Sérgio Chicumbe, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

Authors:

Carmen E. Hazim , Igor Dobe, Stephen Pope, Kristjana H. Ásbjörnsdóttir, Orvalho Augusto, Fernando Pereira Bruno, Sergio Chicumbe, Norberto Lumbandali, Inocêncio Mate, Elso Ofumhan, Sam Patel, Riaze Rafik, Kenneth Sherr, Veronica Tonwe, Onei Uetela, David Watkins, Sarah Gimbel, & Ana O. Mocumbi

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2024

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services.
Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

Methods

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be “scaled up” with delivery by district health supervisors (rather than research staff) and will be “scaled out” via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer’s perspective.

Discussion

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

Authors:

Aneth Dinis, Quinhas Fernandes, Bradley H Wagenaar, Sarah Gimbel, Bryan J Weiner, Grace John-Stewart, Ermyas Birru, Stephen Gloyd, Ruth Etzioni, Dorlim Uetela, Isaías Ramiro, Artur Gremu, Orvalho Augusto, Stélio Tembe, Jaime L Mário, Jalilo E Chinai, Alfredo F Covele, Cassimo M Sáide, Nélia Manaca & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

Results

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities’ first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. “Weak diagnosis or management of obstetric complications” was identified as the main problem, and “actions to reinforce norms and protocols” was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

Conclusion

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Impact of differentiated service delivery models on 12-month retention in HIV treatment in Mozambique: an interrupted time-series analysis

Authors:

Dorlim A Moiana Uetela, Orvalho Augusto, James P Hughes, Onei A Uetela, Eduardo Samo Gudo, Sérgio A Chicumbe, Aleny M Couto, Irénio A Gaspar, Diogo L Chavana, Sandra E Gaveta, Marita R Zimmermann, Sarah Gimbel & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: October 2023

Read the full text in the subscription access journal The Lancet HIV

✪ Assessing drivers of implementing “Scaling-up the Systems Analysis and Improvement Approach” for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves

Authors:

Celso Inguane, Sarah Gimbel, Caroline Soi, Esperança Tavede, Filipe Murgorgo, Xavier Isidoro, Yaesh Sidat, Regina Nassiaca, Joana Coutinho, Maria Cruz, Mery Agostinho, Fernando Amaral, Aneth Dinis, Kristjana Ásbjörnsdóttir, Jonny Crocker, Nélia Manaca, Isaias Ramiro, James Pfeiffer, Maria de Fátima Cuembelo, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2023

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA’s effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases.

Methods

We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi).

Results

We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA’s compatibility with organizational structures, processes, and priorities of Mozambique’s health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds.

Conclusions

The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities.

Trial registration

ClinicalTrials.gov, NCT03425136. Registered on 02/06/2018.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Managers’ and providers’ perspectives on barriers and facilitators for the implementation of differentiated service delivery models for HIV treatment in Mozambique: a qualitative study

Authors:

Dorlim Moiana Uetela, Sarah Gimbel, Celso Inguane, Onei Uetela, Aneth Dinis, Aleny Couto, Irénio Gaspar, Eduardo S. Gudo, Sérgio Chicumbe, Sandra Gaveta, Orvalho Augusto & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Journal of the International AIDS Society

Abstract:

Introduction

In 2018, Mozambique's Ministry of Health launched a guideline for a nationwide implementation of eight differentiated service delivery models to optimize HIV service delivery and achieve universal coverage of HIV care and treatment. The models were (1) Fast-track, (2) Three-month Antiretrovirals Dispensing, (3) Community Antiretroviral Therapy Groups, (4) Adherence Clubs, (5) Family-approach, and three one-stop shop models for (6) Tuberculosis, (7) Maternal and Child Health, and (8) Adolescent-friendly Health Services. This study identified drivers of implementation success and failure across these differentiated service delivery models.

Methods

Twenty in-depth individual interviews were conducted with managers and providers from the Ministry of Health and implementing partners from all levels of the health system between July and September 2021. National-level participants were based in the capital city of Maputo, and participants at provincial, district and health facility levels were from Sofala province, a purposively selected setting. The Consolidated Framework for Implementation Research (CFIR) guided data collection and thematic analysis. Deductively selected constructs were assessed while allowing for additional themes to emerge inductively.

Results

The CFIR constructs of Relative Advantage, Complexity, Patient Needs and Resources, and Reflecting and Evaluating were identified as drivers of implementation, whereas Available Resources and Access to Knowledge and Information were identified as barriers. Fast-track and Three-month Antiretrovirals Dispensing models were deemed easier to implement and more effective in reducing workload. Adherence Clubs and Community Antiretroviral Therapy Groups were believed to be less preferred by clients in urban settings. COVID-19 (an inductive theme) improved acceptance and uptake of individual differentiated service delivery models that reduced client visits, but it temporarily interrupted the implementation of group models.

Conclusions

This study described important determinants to be addressed or leveraged for the successful implementation of differentiated service delivery models in Mozambique. The models were considered advantageous overall for the health system and clients when compared with the standard of care. However, successful implementation requires resources and ongoing training for frontline providers. COVID-19 expedited individual models by loosening the inclusion criteria; this experience can be leveraged to optimize the design and implementation of differentiated service delivery models in Mozambique and other countries.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying the Consolidated Framework for Implementation Research to Identify Implementation Determinants for the Integrated District Evidence-to-Action Program, Mozambique

Authors:

Celso Inguane, Caroline Soi, Sarah Gimbel, Nélia Manaca, Isaías Ramiro, Florência Floriano, Georgina de Castro, Orvalho Augusto, Stélio Tembe, James Pfeiffer, Quinhas Fernandes, and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2022

Read the full text in the open access journal Global Health: Science and Practice

Abstract

Introduction

The Integrated District Evidence-to-Action program is an audit and feedback intervention introduced in 2017 in Manica and Sofala provinces, Mozambique, to reduce mortality in children younger than 5 years. We describe barriers and facilitators to early-stage effectiveness of that intervention.

Method

We embedded the Consolidated Framework for Implementation Research (CFIR) into an extended case study design to inform sampling, data collection, analysis, and interpretation. We collected data in 4 districts in Manica and Sofala Provinces in November 2018. Data collection included document review, 22 in-depth individual interviews, and 2 focus group discussions (FGDs) with 19 provincial, district, and facility managers and nurses. Most participants (70.2%) were nurses and facility managers and the majority were women (87.8%). We audio-recorded all but 2 interviews and FGDs and conducted a consensus-based iterative analysis.

Results

Facilitators of effective intervention implementation included: implementation of the core intervention components of audit and feedback meetings, supportive supervision and mentorship, and small grants as originally planned; positive pressure from district managers and study nurses on health facility staff to strive for excellence; and easy access to knowledge and information about the intervention. Implementation barriers were the intervention’s lack of compatibility in not addressing the scarcity of human and financial resources and inadequate infrastructures for maternal and child health services at district and facility levels and; the intervention’s lack of adaptability in having little flexibility in the design and decision making about the use of intervention funds and data collection tools.

Discussion

Our comprehensive and systematic use of the CFIR within an extended case study design generated granular evidence on CFIR’s contribution to implementation science efforts to describe determinants of early-stage intervention implementation. It also provided baseline findings to assess subsequent implementation phases, considering similarities and differences in barriers and facilitators across study districts and facilities. Sharing preliminary findings with stakeholders promoted timely decision making about intervention implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**