Skip to content

✪ A structured approach to applying systems analysis methods for examining implementation mechanisms

Authors:

Bo Kim, Gracelyn Cruden, Erika L. Crable, Andrew Quanbeck, Brian S. Mittman, & Anjuli D. Wagner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2023

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

It is challenging to identify and understand the specific mechanisms through which an implementation strategy affects implementation outcomes, as implementation happens in the context of complex, multi-level systems. These systems and the mechanisms within each level have their own dynamic environments that change frequently. For instance, sequencing may matter in that a mechanism may only be activated indirectly by a strategy through another mechanism. The dosage or strength of a mechanism may vary over time or across different health care system levels. To elucidate the mechanisms relevant to successful implementation amidst this complexity, systems analysis methods are needed to model and manage complexity.

Methods

The fields of systems engineering and systems science offer methods—which we refer to as systems analysis methods—to help explain the interdependent relationships between and within systems, as well as dynamic changes to systems over time. When applied to studying implementation mechanisms, systems analysis methods can help (i) better identify and manage unknown conditions that may or may not activate mechanisms (both expected mechanisms targeted by a strategy and unexpected mechanisms that the methods help detect) and (ii) flexibly guide strategy adaptations to address contextual influences that emerge after the strategy is selected and used.

Results

In this paper, we delineate a structured approach to applying systems analysis methods for examining implementation mechanisms. The approach includes explicit steps for selecting, tailoring, and evaluating an implementation strategy regarding the mechanisms that the strategy is initially hypothesized to activate, as well as additional mechanisms that are identified through the steps. We illustrate the approach using a case example. We then discuss the strengths and limitations of this approach, as well as when these steps might be most appropriate, and suggest work to further the contributions of systems analysis methods to implementation mechanisms research.

Conclusions

Our approach to applying systems analysis methods can encourage more mechanisms research efforts to consider these methods and in turn fuel both (i) rigorous comparisons of these methods to alternative mechanisms research approaches and (ii) an active discourse across the field to better delineate when these methods are appropriate for advancing mechanisms-related knowledge.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Systems analysis and improvement approach to optimize the hypertension diagnosis and care cascade for PLHIV individuals (SAIA-HTN): A hybrid type III cluster randomized trial

Authors:

Sarah Gimbel, Ana Olga Mocumbi, Kristjana Ásbjörnsdóttir, Joana Coutinho, Leonel Andela, Bonifacio Cebola, Heidi Craine, Jonny Crocker, Leecreesha Hicks, Sarah Holte, Rodrigues Hossieke, Edgar Itai, Carol Levin, Nelia Manaca, Filipe Murgorgo, Miguel Nhumba, James Pfeiffer, Isaias Ramiro, Keshet Ronen, Nona Sotoodehnia, Onei Uetela, Anjuli Wagner, Bryan J. Weiner, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal Implementation Science

Abstract:

Background

Across sub-Saharan Africa, evidence-based clinical guidelines to screen and manage hypertension exist; however, country level application is low due to lack of service readiness, uneven health worker motivation, weak accountability of health worker performance, and poor integration of hypertension screening and management with chronic care services. The systems analysis and improvement approach (SAIA) is an evidence-based implementation strategy that combines systems engineering tools into a five-step, facility-level package to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). As hypertension screening and management are integrated into chronic care services in sub-Saharan Africa, an opportunity exists to test whether SAIA interventions shown to be effective in improving efficiency and coverage of HIV services can be effective when applied to the non-communicable disease services that leverage the same platform. We hypothesize that SAIA-hypertension (SAIA-HTN) will be effective as an adaptable, scalable model for broad implementation.

Methods

We will deploy a hybrid type III cluster randomized trial to evaluate the impact of SAIA-HTN on hypertension management in eight intervention and eight control facilities in central Mozambique. Effectiveness outcomes include hypertension cascade flow measures (screening, diagnosis, management, control), as well as hypertension and HIV clinical outcomes among people living with HIV. Cost-effectiveness will be estimated as the incremental costs per additional patient passing through the hypertension cascade steps and the cost per additional disability-adjusted life year averted, from the payer perspective (Ministry of Health). SAIA-HTN implementation fidelity will be measured, and the Consolidated Framework for Implementation Research will guide qualitative evaluation of the implementation process in high- and low-performing facilities to identify determinants of intervention success and failure, and define core and adaptable components of the SAIA-HTN intervention. The Organizational Readiness for Implementing Change scale will measure facility-level readiness for adopting SAIA-HTN.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line health workers to identify low-cost, contextually appropriate chronic care improvement strategies. By integrating SAIA into routine hypertension screening and management structures, this pragmatic trial is designed to test a model for national scale-up.

Trial registration

Registered 09/13/2019; NCT04088656).

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Scaling-up the Systems Analysis and Improvement Approach for prevention of mother-to-child HIV transmission in Mozambique (SAIA-SCALE): a stepped-wedge cluster randomized trial

Authors:

Kenneth Sherr, Kristjana Ásbjörnsdóttir, Jonny Crocker, Joana Coutinho, Maria de Fatima Cuembelo, Esperança Tavede, Nélia Manaca, Keshet Ronen, Felipe Murgorgo, Ruanne Barnabas, Grace John-Stewart, Sarah Holte, Bryan J. Weiner, James Pfeiffer & Sarah Gimbel

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2019

Read the full text in the open access journal Implementation Science

Abstract:

Background

The introduction of option B+ — rapid initiation of lifelong antiretroviral therapy regardless of disease status for HIV-infected pregnant and breastfeeding women — can dramatically reduce HIV transmission during pregnancy, birth, and breastfeeding. Despite significant investments to scale-up Option B+, results have been mixed, with high rates of loss to follow-up, sub-optimal viral suppression, continued pediatric HIV transmission, and HIV-associated maternal morbidity. The Systems Analysis and Improvement Approach (SAIA) cluster randomized trial demonstrated that a package of systems engineering tools improved flow through the prevention of mother-to-child HIV transmission (PMTCT) cascade. This five-step, facility-level intervention is designed to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). This protocol describes a novel model for SAIA delivery (SAIA-SCALE) led by district nurse supervisors (rather than research nurses), and evaluation procedures, to serve as a foundation for national scale-up.

Methods

The SAIA-SCALE stepped wedge trial includes three implementation waves, each 12 months in duration. Districts are the unit of assignment, with four districts randomly assigned per wave, covering all 12 districts in Manica province, Mozambique. In each district, the three highest volume health facilities will receive the SAIA-SCALE intervention (totaling 36 intervention facilities). The RE-AIM framework will guide SAIA-SCALE’s evaluation. Reach describes the proportion of clinics and population in Manica province reached, and sub-groups not reached. Effectiveness assesses impact on PMTCT process measures and patient-level outcomes. Adoption describes the proportion of districts/clinics adopting SAIA-SCALE, and determinants of adoption using the Organizational Readiness for Implementing Change (ORIC) tool. Implementation will identify SAIA-SCALE core elements and determinants of successful implementation using the Consolidated Framework for Implementation Research (CFIR). Maintenance describes the proportion of districts sustaining the intervention. We will also estimate the budget and program impact from the payer perspective for national scale-up.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by frontline health workers, and to identify low-cost, contextually appropriate PMTCT improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial is designed to test a model for national intervention scale-up.

Trial Registration

ClinicalTrials.gov NCT03425136 (registered 02/06/2018).

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Health facility factors and quality of services to prevent mother-to-child HIV transmission in Côte d’Ivoire, Kenya, and Mozambique

Authors:

Alison S Rustagi, Sarah Gimbel, Ruth Nduati, Maria de Fatima Cuembelo, Judith N Wasserheit, Carey Farquhar, Stephen Gloyd, Kenneth Sherr, with input from the SAIA Study Team

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: September 2016

Read the full text in the subscription access International Journal of STD & AIDS

✪ Evaluation of a Systems Analysis and Improvement Approach to Optimize Prevention of Mother-To-Child Transmission of HIV Using the Consolidated Framework for Implementation Research

Authors:

Sarah Gimbel, Alison S. Rustagi, Julia Robinson, Seydou Kouyate, Joana Coutinho, Ruth Nduati, James Pfeiffer, Stephen Gloyd, Kenneth Sherr, with input from the SAIA study team (S. Adam Granato, Ahoua Kone, Emilia Cruz, Joao Luis Manuel, Justina Zucule, Manuel Napua, Grace Mbatia, Grace Wariua, and Martin Maina)

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2016

Read the full text open access in the subscription journal JAIDS