Skip to content

✪ Assessing the sustainability of the Systems Analysis and Improvement Approach to increase HIV testing in family planning clinics in Mombasa, Kenya: results of a cluster randomized trial

Authors:

Jessica E. Long, McKenna C. Eastment, George Wanje, Barbra A. Richardson, Emily Mwaringa, Mwanakarama Athman Mohamed, Kenneth Sherr, Ruanne V. Barnabas, Kishorchandra Mandaliya, Walter Jaoko, and R. Scott McClelland

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2022

Read the full text in the open access journal Implementation Science

Abstract:

Background

In Kenya, HIV incidence is highest among reproductive-age women. A key HIV mitigation strategy is the integration of HIV testing and counseling (HTC) into family planning services, but successful integration remains problematic. We conducted a cluster-randomized trial using the Systems Analysis and Improvement Approach (SAIA) to identify and address bottlenecks in HTC integration in family planning clinics in Mombasa County, Kenya. This trial (1) assessed the efficacy of this approach and (2) examined if SAIA could be sustainably incorporated into the Department of Health Services (DOHS) programmatic activities. In Stage 1, SAIA was effective at increasing HTC uptake. Here, we present Stage 2, which assessed if SAIA delivery would be sustained when implemented by the Mombasa County DOHS and if high HTC performance would continue to be observed.

Methods

Twenty-four family planning clinics in Mombasa County were randomized to either the SAIA implementation strategy or standard care. In Stage 1, the study staff conducted all study activities. In Stage 2, we transitioned SAIA implementation to DOHS staff and compared HTC in the intervention versus control clinics 1-year post-transition. Study staff provided training and minimal support to DOHS implementers and collected quarterly HTC outcome data. Interviews were conducted with family planning clinic staff to assess barriers and facilitators to sustaining HTC delivery.

Results

Only 39% (56/144) of planned SAIA visits were completed, largely due to the COVID-19 pandemic and a prolonged healthcare worker strike. In the final study quarter, 81.6% (160/196) of new clients at intervention facilities received HIV counseling, compared to 22.4% (55/245) in control facilities (prevalence rate ratio [PRR]=3.64, 95% confidence interval [CI]=2.68–4.94). HIV testing was conducted with 60.5% (118/195) of new family planning clients in intervention clinics, compared to 18.8% (45/240) in control clinics (PRR=3.23, 95% CI=2.29–4.55). Interviews with family planning clinic staff suggested institutionalization contributed to sustained HTC delivery, facilitated by low implementation strategy complexity and continued oversight.

Conclusions

Intervention clinics demonstrated sustained improvement in HTC after SAIA was transitioned to DOHS leadership despite wide-scale healthcare disruptions and incomplete delivery of the implementation strategy. These findings suggest that system interventions may be sustained when integrated into DOHS programmatic activities.

Trial registration

ClinicalTrials.gov (NCT02994355) registered on 16 December 2016.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying the Consolidated Framework for Implementation Research to Identify Implementation Determinants for the Integrated District Evidence-to-Action Program, Mozambique

Authors:

Celso Inguane, Caroline Soi, Sarah Gimbel, Nélia Manaca, Isaías Ramiro, Florência Floriano, Georgina de Castro, Orvalho Augusto, Stélio Tembe, James Pfeiffer, Quinhas Fernandes, and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2022

Read the full text in the open access journal Global Health: Science and Practice

Abstract

Introduction

The Integrated District Evidence-to-Action program is an audit and feedback intervention introduced in 2017 in Manica and Sofala provinces, Mozambique, to reduce mortality in children younger than 5 years. We describe barriers and facilitators to early-stage effectiveness of that intervention.

Method

We embedded the Consolidated Framework for Implementation Research (CFIR) into an extended case study design to inform sampling, data collection, analysis, and interpretation. We collected data in 4 districts in Manica and Sofala Provinces in November 2018. Data collection included document review, 22 in-depth individual interviews, and 2 focus group discussions (FGDs) with 19 provincial, district, and facility managers and nurses. Most participants (70.2%) were nurses and facility managers and the majority were women (87.8%). We audio-recorded all but 2 interviews and FGDs and conducted a consensus-based iterative analysis.

Results

Facilitators of effective intervention implementation included: implementation of the core intervention components of audit and feedback meetings, supportive supervision and mentorship, and small grants as originally planned; positive pressure from district managers and study nurses on health facility staff to strive for excellence; and easy access to knowledge and information about the intervention. Implementation barriers were the intervention’s lack of compatibility in not addressing the scarcity of human and financial resources and inadequate infrastructures for maternal and child health services at district and facility levels and; the intervention’s lack of adaptability in having little flexibility in the design and decision making about the use of intervention funds and data collection tools.

Discussion

Our comprehensive and systematic use of the CFIR within an extended case study design generated granular evidence on CFIR’s contribution to implementation science efforts to describe determinants of early-stage intervention implementation. It also provided baseline findings to assess subsequent implementation phases, considering similarities and differences in barriers and facilitators across study districts and facilities. Sharing preliminary findings with stakeholders promoted timely decision making about intervention implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A pragmatic approach to identifying implementation barriers and facilitators for a novel pre-exposure prophylaxis (PrEP) delivery model at public facilities in urban Uganda

Authors:

Dorothy Thomas, Andrew Mujugira, Katrina Ortblad, Sylvia Namanda, Joseph Kibuuka, Mai Nakitende, Florence Nambi, Lylianne Nakabugo, Caitlin Scoville, Timothy Muwonge, Renee Heffron

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2022

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Scalable HIV pre-exposure prophylaxis (PrEP) delivery models for resource-limited settings are critical for improving PrEP coverage and interrupting HIV transmission. This research uses technical assistance (TA) reports to evaluate implementation barriers and facilitators for a novel delivery model integrating PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples in public health facilities in Kampala, Uganda.

Methods

We used data from the Partners PrEP Program (PPP)—a stepped-wedge cluster randomized trial that is launching PrEP delivery through an integrated model of oral PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples at public health facilities in Kampala and Wakiso, Uganda (NCT03586128). Technical assistance teams, comprised of PPP program staff, conducted monthly TA visits to implementing facilities where they identified and addressed implementation challenges in collaboration with health facility staff. Findings were recorded in TA reports, a standardized form structured using the Consolidated Framework for Implementation Research (CFIR). We used a conceptual content analysis approach to evaluate TA reports completed from January to December 2019 and identify implementation barriers and facilitators.

Results

Among 39 reports from the 8 implementing facilities (~ 5 per facility), we identified 11 CFIR constructs. Key implementation facilitators included sensitizing and educating facility staff about PrEP (knowledge and beliefs about the innovation); establishing formal and informal feedback and accountability mechanisms (reflecting and evaluating); and empowering facility staff to address implementation challenges (self-efficacy). Key implementation barriers were related to ineffective recruitment and referral of sero-different couples to and from nearby facilities (cosmopolitanism) as well as stockouts of laboratory resources and testing supplies (available resources).

Conclusions

This analysis featured a robust implementation science framework to assess the relationship between early implementation determinants and outcomes of this innovative PrEP delivery model. Further, we have provided important descriptions of early implementation barriers and facilitators that will inform scale-up efforts for PrEP delivery within and beyond Uganda. Future work will refine the analysis of pragmatic program data, qualitatively investigate the identified key themes, and explore strategies for addressing implementation barriers.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Understanding the Organizational Implementation Context of Schools: A Qualitative Study of School District Administrators, Principals, and Teachers

Authors:

Jill Locke, Kristine Lee, Clayton R. Cook, Lindsay Frederick, Cheryl Vázquez-Colón, Mark G. Ehrhart, Gregory A. Aarons, Chayna Davis, & Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

Published: November 2019

Subscription Required for Full Text Access
Read the full text in the subscription access journal School Mental Health

✪ Readiness to Change Over Time: Change Commitment and Change Efficacy in a Workplace Health-Promotion Trial

Authors:

Christian D. Helfrich, Marlana J. Kohn, Austin Stapleton, Claire L. Allen, Kristen Elizabeth Hammerback, K. C. Gary Chan, Amanda T. Parrish, Daron E. Ryan, Bryan J. Weiner, Jeffrey R. Harris, & Peggy A. Hannon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2018

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Introduction

Organizational readiness to change may be a key determinant of implementation success and a mediator of the effectiveness of implementation interventions. If organizational readiness can be reliably and validly assessed at the outset of a change initiative, it could be used to assess the effectiveness of implementation-support activities by measuring changes in readiness factors over time.

Methods

We analyzed two waves of readiness-to-change survey data collected as part of a three-arm, randomized controlled trial to implement evidence-based health promotion practices in small worksites in low-wage industries. We measured five readiness factors: context (favorable broader conditions); change valence (valuing health promotion); information assessment (demands and resources to implement health promotion); change commitment (an intention to implement health promotion); and change efficacy (a belief in shared ability to implement health promotion). We expected commitment and efficacy to increase at intervention sites along with their self-reported effort to implement health promotion practices, termed wellness-program effort. We compared means between baseline and 15 months, and between intervention and control sites. We used linear regression to test whether intervention and control sites differed in their change-readiness scores over time.

Results

Only context and change commitment met reliability thresholds. Change commitment declined significantly for both control (−0.39) and interventions sites (−0.29) from baseline to 15 months, while context did not change for either. Only wellness program effort at 15 months, but not at baseline, differed significantly between control and intervention sites (1.20 controls, 2.02 intervention). Regression analyses resulted in two significant differences between intervention and control sites in changes from baseline to 15 months: (1) intervention sites exhibited significantly smaller change in context scores relative to control sites over time and (2) intervention sites exhibited significantly higher changes in wellness program effort relative to control sites.

Discussion

Contrary to our hypothesis, change commitment declined significantly at both Healthlinks and control sites, even as wellness-program effort increased significantly at HealthLinks sites. Regression to the mean may explain the decline in change commitment. Future research needs to assess whether baseline commitment is an independent predictor of wellness-program effort or an effect modifier of the HealthLinks intervention.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Improving data quality across 3 sub-Saharan African countries using the Consolidated Framework for Implementation Research (CFIR): results from the African Health Initiative

Authors:

Sarah Gimbel, Moses Mwanza, Marie Paul Nisingizwe, Cathy Michel, Lisa Hirschhorn and the AHI PHIT Partnership Collaborative

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2017

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

High-quality data are critical to inform, monitor and manage health programs. Over the seven-year African Health Initiative of the Doris Duke Charitable Foundation, three of the five Population Health Implementation and Training (PHIT) partnership projects in Mozambique, Rwanda, and Zambia introduced strategies to improve the quality and evaluation of routinely-collected data at the primary health care level, and stimulate its use in evidence-based decision-making. Using the Consolidated Framework for Implementation Research (CFIR) as a guide, this paper: 1) describes and categorizes data quality assessment and improvement activities of the projects, and 2) identifies core intervention components and implementation strategy adaptations introduced to improve data quality in each setting.

Methods

The CFIR was adapted through a qualitative theme reduction process involving discussions with key informants from each project, who identified two domains and ten constructs most relevant to the study aim of describing and comparing each country’s data quality assessment approach and implementation process. Data were collected on each project’s data quality improvement strategies, activities implemented, and results via a semi-structured questionnaire with closed and open-ended items administered to health management information systems leads in each country, with complementary data abstraction from project reports.

Results

Across the three projects, intervention components that aligned with user priorities and government systems were perceived to be relatively advantageous, and more readily adapted and adopted. Activities that both assessed and improved data quality (including data quality assessments, mentorship and supportive supervision, establishment and/or strengthening of electronic medical record systems), received higher ranking scores from respondents.

Conclusion

Our findings suggest that, at a minimum, successful data quality improvement efforts should include routine audits linked to ongoing, on-the-job mentoring at the point of service. This pairing of interventions engages health workers in data collection, cleaning, and analysis of real-world data, and thus provides important skills building with on-site mentoring. The effect of these core components is strengthened by performance review meetings that unify multiple health system levels (provincial, district, facility, and community) to assess data quality, highlight areas of weakness, and plan improvements.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Intentional research design in implementation science: Implications for the use of nomothetic and idiographic assessment

Authors:

Aaron R. Lyon, Elizabeth Connors, Amanda Jensen-Doss, Sara J. Landes, Cara C. Lewis, Bryce D. McLeod, Christopher Rutt, Cameo Stanick, Bryan J. Weiner

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: September 2017

Read the full text in the subscription access journal Translational Behavioral Medicine