Skip to content

✪ Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation

Authors:

Cara C. Lewis, Meredith R. Boyd, C. Nathan Marti & Karen Albright

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2022

Read the full text in the open access journal Implementation Science

Abstract:

Background

Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization.

Methods

Using a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites

Results

Although tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice.

Conclusions

Although rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Assessing the sustainability of the Systems Analysis and Improvement Approach to increase HIV testing in family planning clinics in Mombasa, Kenya: results of a cluster randomized trial

Authors:

Jessica E. Long, McKenna C. Eastment, George Wanje, Barbra A. Richardson, Emily Mwaringa, Mwanakarama Athman Mohamed, Kenneth Sherr, Ruanne V. Barnabas, Kishorchandra Mandaliya, Walter Jaoko, and R. Scott McClelland

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2022

Read the full text in the open access journal Implementation Science

Abstract:

Background

In Kenya, HIV incidence is highest among reproductive-age women. A key HIV mitigation strategy is the integration of HIV testing and counseling (HTC) into family planning services, but successful integration remains problematic. We conducted a cluster-randomized trial using the Systems Analysis and Improvement Approach (SAIA) to identify and address bottlenecks in HTC integration in family planning clinics in Mombasa County, Kenya. This trial (1) assessed the efficacy of this approach and (2) examined if SAIA could be sustainably incorporated into the Department of Health Services (DOHS) programmatic activities. In Stage 1, SAIA was effective at increasing HTC uptake. Here, we present Stage 2, which assessed if SAIA delivery would be sustained when implemented by the Mombasa County DOHS and if high HTC performance would continue to be observed.

Methods

Twenty-four family planning clinics in Mombasa County were randomized to either the SAIA implementation strategy or standard care. In Stage 1, the study staff conducted all study activities. In Stage 2, we transitioned SAIA implementation to DOHS staff and compared HTC in the intervention versus control clinics 1-year post-transition. Study staff provided training and minimal support to DOHS implementers and collected quarterly HTC outcome data. Interviews were conducted with family planning clinic staff to assess barriers and facilitators to sustaining HTC delivery.

Results

Only 39% (56/144) of planned SAIA visits were completed, largely due to the COVID-19 pandemic and a prolonged healthcare worker strike. In the final study quarter, 81.6% (160/196) of new clients at intervention facilities received HIV counseling, compared to 22.4% (55/245) in control facilities (prevalence rate ratio [PRR]=3.64, 95% confidence interval [CI]=2.68–4.94). HIV testing was conducted with 60.5% (118/195) of new family planning clients in intervention clinics, compared to 18.8% (45/240) in control clinics (PRR=3.23, 95% CI=2.29–4.55). Interviews with family planning clinic staff suggested institutionalization contributed to sustained HTC delivery, facilitated by low implementation strategy complexity and continued oversight.

Conclusions

Intervention clinics demonstrated sustained improvement in HTC after SAIA was transitioned to DOHS leadership despite wide-scale healthcare disruptions and incomplete delivery of the implementation strategy. These findings suggest that system interventions may be sustained when integrated into DOHS programmatic activities.

Trial registration

ClinicalTrials.gov (NCT02994355) registered on 16 December 2016.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying the Consolidated Framework for Implementation Research to Identify Implementation Determinants for the Integrated District Evidence-to-Action Program, Mozambique

Authors:

Celso Inguane, Caroline Soi, Sarah Gimbel, Nélia Manaca, Isaías Ramiro, Florência Floriano, Georgina de Castro, Orvalho Augusto, Stélio Tembe, James Pfeiffer, Quinhas Fernandes, and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2022

Read the full text in the open access journal Global Health: Science and Practice

Abstract

Introduction

The Integrated District Evidence-to-Action program is an audit and feedback intervention introduced in 2017 in Manica and Sofala provinces, Mozambique, to reduce mortality in children younger than 5 years. We describe barriers and facilitators to early-stage effectiveness of that intervention.

Method

We embedded the Consolidated Framework for Implementation Research (CFIR) into an extended case study design to inform sampling, data collection, analysis, and interpretation. We collected data in 4 districts in Manica and Sofala Provinces in November 2018. Data collection included document review, 22 in-depth individual interviews, and 2 focus group discussions (FGDs) with 19 provincial, district, and facility managers and nurses. Most participants (70.2%) were nurses and facility managers and the majority were women (87.8%). We audio-recorded all but 2 interviews and FGDs and conducted a consensus-based iterative analysis.

Results

Facilitators of effective intervention implementation included: implementation of the core intervention components of audit and feedback meetings, supportive supervision and mentorship, and small grants as originally planned; positive pressure from district managers and study nurses on health facility staff to strive for excellence; and easy access to knowledge and information about the intervention. Implementation barriers were the intervention’s lack of compatibility in not addressing the scarcity of human and financial resources and inadequate infrastructures for maternal and child health services at district and facility levels and; the intervention’s lack of adaptability in having little flexibility in the design and decision making about the use of intervention funds and data collection tools.

Discussion

Our comprehensive and systematic use of the CFIR within an extended case study design generated granular evidence on CFIR’s contribution to implementation science efforts to describe determinants of early-stage intervention implementation. It also provided baseline findings to assess subsequent implementation phases, considering similarities and differences in barriers and facilitators across study districts and facilities. Sharing preliminary findings with stakeholders promoted timely decision making about intervention implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Development of a Field Guide for Assessing Readiness to Implement Evidence-Based Cancer Screening Interventions in Primary Care Clinics

Authors:

Sarah D. Hohl, Stephanie Melillo, Thuy T. Vu, Cam Escoffery, Amy DeGroff, Dara Schlueter, Leslie W. Ross, Annette E. Maxwell, Krishna P. Sharma, Jennifer Boehm, Djenaba Joseph, Peggy A. Hannon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2022

Read the full text in the open access journal Preventing Chronic Disease: Public Health Research, Practice, and Policy

Abstract:

Evidence-based interventions, including provider assessment and feedback, provider reminders, patient reminders, and reduction of structural barriers, improve colorectal cancer screening rates. Assessing primary care clinics’ readiness to implement these interventions can help clinics use strengths, identify barriers, and plan for success. However, clinics may lack tools to assess readiness and use findings to plan for successful implementation. To address this need, we developed the Field Guide for Assessing Readiness to Implement Evidence-Based Cancer Screening Interventions (Field Guide) for the Centers for Disease Control and Prevention’s (CDC’s) Colorectal Cancer Control Program (CRCCP).

We conducted a literature review of evidence and existing tools to measure implementation readiness, reviewed readiness tools from selected CRCCP award recipients (n = 35), and conducted semi-structured interviews with key informants (n = 8). We sought feedback from CDC staff and recipients to inform the final document. The Field Guide, which is publicly available online, outlines 4 assessment phases: 1) convene team members and determine assessment activities, 2) design and administer the readiness assessment, 3) evaluate assessment data, and 4) develop an implementation plan. Assessment activities and tools are included to facilitate completion of each phase. The Field Guide integrates implementation science and practical experience into a relevant tool to bolster clinic capacity for implementation, increase potential for intervention sustainability, and improve colorectal cancer screening rates, with a focus on patients served in safety net clinic settings. Although this tool was developed for use in primary care clinics for cancer screening, the Field Guide may have broader application for clinics and their partners for other chronic diseases.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A pragmatic approach to identifying implementation barriers and facilitators for a novel pre-exposure prophylaxis (PrEP) delivery model at public facilities in urban Uganda

Authors:

Dorothy Thomas, Andrew Mujugira, Katrina Ortblad, Sylvia Namanda, Joseph Kibuuka, Mai Nakitende, Florence Nambi, Lylianne Nakabugo, Caitlin Scoville, Timothy Muwonge, Renee Heffron

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2022

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Scalable HIV pre-exposure prophylaxis (PrEP) delivery models for resource-limited settings are critical for improving PrEP coverage and interrupting HIV transmission. This research uses technical assistance (TA) reports to evaluate implementation barriers and facilitators for a novel delivery model integrating PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples in public health facilities in Kampala, Uganda.

Methods

We used data from the Partners PrEP Program (PPP)—a stepped-wedge cluster randomized trial that is launching PrEP delivery through an integrated model of oral PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples at public health facilities in Kampala and Wakiso, Uganda (NCT03586128). Technical assistance teams, comprised of PPP program staff, conducted monthly TA visits to implementing facilities where they identified and addressed implementation challenges in collaboration with health facility staff. Findings were recorded in TA reports, a standardized form structured using the Consolidated Framework for Implementation Research (CFIR). We used a conceptual content analysis approach to evaluate TA reports completed from January to December 2019 and identify implementation barriers and facilitators.

Results

Among 39 reports from the 8 implementing facilities (~ 5 per facility), we identified 11 CFIR constructs. Key implementation facilitators included sensitizing and educating facility staff about PrEP (knowledge and beliefs about the innovation); establishing formal and informal feedback and accountability mechanisms (reflecting and evaluating); and empowering facility staff to address implementation challenges (self-efficacy). Key implementation barriers were related to ineffective recruitment and referral of sero-different couples to and from nearby facilities (cosmopolitanism) as well as stockouts of laboratory resources and testing supplies (available resources).

Conclusions

This analysis featured a robust implementation science framework to assess the relationship between early implementation determinants and outcomes of this innovative PrEP delivery model. Further, we have provided important descriptions of early implementation barriers and facilitators that will inform scale-up efforts for PrEP delivery within and beyond Uganda. Future work will refine the analysis of pragmatic program data, qualitatively investigate the identified key themes, and explore strategies for addressing implementation barriers.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Comparing Patients’ Experiences in Three Differentiated Service Delivery Models for HIV Treatment in South Africa

Authors:

Ferdinand C. Mukumbang, Sibusiso Ndlovu, and Brian van Wyk

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2021

Read the full text in the open access journal Qualitative Health Research

Abstract:

Differentiated service delivery for HIV treatment seeks to enhance medication adherence while respecting the preferences of people living with HIV. Nevertheless, patients’ experiences of using these differentiated service delivery models or approaches have not been qualitatively compared. Underpinned by the tenets of descriptive phenomenology, we explored and compared the experiences of patients in three differentiated service delivery models using the National Health Services’ Patient Experience Framework. Data were collected from 68 purposively selected people living with HIV receiving care in facility adherence clubs, community adherence clubs, and quick pharmacy pick-up. Using the constant comparative thematic analysis approach, we compared themes identified across the different participant groups. Compared to facility adherence clubs and community adherence clubs, patients in the quick pharmacy pick-up model experienced less information sharing; communication and education; and emotional/psychological support. Patients’ positive experience with a differentiated service delivery model is based on how well the model fits into their HIV disease self-management goals.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Factors Affecting the Initiation of a Shared Decision Making Program in Obstetric Practices

Authors:

Deborah J. Bowen, Ann M. Nguyen, Cynthia LeRouge, Erin LePoire, & Tao Sheng Kwan-Gett

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Healthcare

Abstract:

As healthcare systems progress toward initiatives that increase patient engagement, stakeholder hopes are that shared decision making (SDM) will become routine practice. Yet, there is limited empirical evidence to guide such SDM program implementations, particularly in obstetric practices. The first stage of any project implementation is the "initiation stage", in which project leaders define a project's purpose and stakeholders and structures are put in place to support the new initiative.

Our study's objective was to identify factors affecting the initiation stage of an SDM program implementation project for TOLAC, trial of labor after Cesarean. We conducted a multiple-case study of an SDM program implementation in three obstetric settings in Washington State. The research design and analysis were guided by implementation science frameworks and project management literature. Data sources included interviews with key informants from the State, SDM tool vendors, and three project sites, as well as implementation documents.

The study results provide insight into how the identified project implementation factors provide an essential foundation for informing project planning, execution, and reflection/evaluation. In this study, the State's decision aid certification program pressured the project sites to shape the project purpose and engage stakeholders that would meet immediate project requirements (specifically, state requirements).

The study reveals that external demands may not be in perfect alignment with the internal necessities required for an SDM program's long-term viability and sustainability. Findings may be used by implementers and researchers to model and strategize the early stages of SDM program implementation projects, particularly in the obstetric setting.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Exploring the impact of workforce turnover on the sustainability of evidence-based programs: A scoping review

Authors:

Kelley M. Pascoe, Miruna Petrescu-Prahova, Lesley Steinman, Jennifer Bacci, Siobhan Mahorter, Basia Belza, & Bryan Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Evidence-based programs (EBPs) are used across disciplines to integrate research into practice and improve outcomes at the individual and/or community level. Despite widespread development and implementation of EBPs, many programs are not sustained beyond the initial implementation period due to many factors, including workforce turnover. This scoping review summarizes research on the impact of workforce turnover on the sustainability of EBPs and recommendations for mitigating these impacts.

Methods

We searched 10 databases for articles that focused on an EBP and described an association between workforce turnover and the sustainment or sustainability of the program. We created a data abstraction tool to extract relevant information from each article and applied the data abstraction tool to all included articles to create the dataset. Data were mapped and analyzed using the program sustainability framework (PSF).

Results and Discussion

A total of 30 articles were included in this scoping review and mapped to the PSF. Twenty-nine articles described impacts of workforce turnover and 18 articles proposed recommendations to address the impacts. The most frequent impacts of workforce turnover included increased need for training, loss of organizational knowledge, lack of EBP fidelity, and financial stress. Recommendations to address the impact of workforce turnover included affordable and alternative training modalities, the use of champions or volunteers, increasing program alignment with organizational goals, and generating diverse funding portfolios.

Conclusion

The sustainment of EBPs is critical to ensure and maintain the short- and long-term benefits of the EBP for all participants and communities. Understanding the impacts of workforce turnover, a determinant of sustainability, can create awareness among EBP-implementing organizations and allow for proactive planning to increase the likelihood of program sustainability.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Process evaluation of PrEP implementation in Kenya: adaptation of practices and contextual modifications in public HIV care clinics

Authors:

Elizabeth M. Irungu, Josephine Odoyo, Elizabeth Wamoni, Elizabeth A. Bukusi, Nelly R. Mugo, Kenneth Ngure, Jennifer F. Morton, Kenneth K. Mugwanya, Jared M. Baeten, & Gabrielle O'Malley, for the Partners Scale-Up Project Team

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access Journal of the International AIDS Society

Abstract:

Introduction

In Africa, oral pre-exposure prophylaxis (PrEP) is largely provided via over-burdened public HIV care clinics. Successfully incorporating PrEP services into these clinics may require adaptations to practices outlined in national implementation guidelines and modifications to routine existing service delivery. We aimed to describe adaptations made by public HIV clinics in Kenya to integrate PrEP delivery into existing services.

Methods

The Partners Scale-Up Project aimed to catalyze integration of PrEP in 25 public HIV care clinics. Between May and December 2018, we conducted qualitative interviews with health providers and documented clinic observations in technical assistance (TA) reports to understand the process of PrEP service integration. We analyzed 36 health provider interview transcripts and 25 TA reports to identify clinic-level adaptations to activities outlined in Kenyan Ministry of Health PrEP guidelines and modifications made to existing service delivery practices to successfully incorporate PrEP services. Identified adaptations were reported using the expanded framework for reporting adaptations and modifications (FRAME).

Results

All clinics (n = 25) performed HIV testing, HIV risk assessment, PrEP education and adherence counseling as stipulated in the guidelines. Most clinics initiated clients on PrEP without creatinine testing if otherwise healthy. While monthly refill appointments are recommended, a majority of clinics issued PrEP users two to three months of pills at a time. Clinics also implemented practices that had not been specified in the guidelines including incorporating PrEP-related topics into routine health talks, calling clients with missed PrEP appointments, discussing PrEP service delivery in regular staff meetings, ‘fast-tracking’ PrEP clients and dispensing PrEP in clinic rooms rather than at clinic-based pharmacies. PrEP initiation numbers were highest among clinics that did not require creatinine testing, conducted peer on-the-job PrEP training and those that discussed PrEP delivery in their routine meetings. Above-average continuation was observed among clinics that discussed PrEP in their routine meetings, dispensed PrEP in clinic rooms and offered PrEP at non-regular hours.

Conclusions

Health providers in public HIV care clinics instituted practices and made innovative adaptations to PrEP delivery to reduce barriers for clients and staff. Encouraging clinic level adaptations to national implementation guidelines will facilitate scale-up of PrEP delivery.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**