Skip to content
Implementation Science at UW

Keywords: Context

✪ Applying and reporting relevance, richness and rigour in realist evidence appraisals: Advancing key concepts in realist reviews

Authors:

Sara Dada, Sonia Dalkin, Brynne Gilmore, Rebecca Hunter & Ferdinand C Mukumbang

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Research Synthesis Methods

Abstract:

The realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps. This includes selecting and appraising evidence sources, which are often considered for their ‘relevance, richness and rigour.’ In contrast to other review approaches, for example, narrative reviews and meta-analyses, the inclusion criteria and appraisal of evidence within realist reviews depend less on the study's methodological quality and more on its contribution to our understanding of generative causation, uncovered through the process of retroductive theorising. This research brief aims to discuss the current challenges and practices for appraising documents' relevance, richness and rigour and to provide pragmatic suggestions for how realist reviewers can put this into practice.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ “We are the sun for our community:” Partnering with community health workers/promotores to adapt, deliver and evaluate a home-based collaborative care model to improve equity in access to quality depression care for older U.S. Latino adults who are underserved

Authors:

Lesley E. Steinman, Amelia Gasca, Theresa J. Hoeft, Patrick J. Raue, Stuart Henderson, Rosa Perez, Alfredo Huerta, Alex Fajardo, Melinda A. Vredevoogd, Katherine James, Ladson Hinton, Laura Rath, and Jurgen Unützer.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2023

Read the full text in the open access journal Frontiers in Public Health
BACK TO THE ARCHIVE

Abstract:

Background:

While depression is a leading cause of poor health, less than half of older adults receive adequate care. Inequities in both access and outcomes are even more pronounced for socially disadvantaged older adults. The collaborative care model (CCM) has potential to reduce this burden through community-based organizations (CBOs) who serve these populations. However, CCM has been understudied in diverse cultural and resource-constrained contexts. We evaluated the implementation and effectiveness of PEARLS, a home-based CCM adapted with and for community health workers/promotores (CHWs/Ps).

Methods:

We used an instrumental case study design. Our case definition is a community-academic partnership to build CHW/P capacity for evidence-based depression care for older U.S. Latino adults in the Inland Empire region of California (2017–2020). We aimed to understand adaptations to fit local context; acceptability, feasibility, and fidelity; clinical effectiveness; and contextual determinants of implementation success or failure. Data sources included quantitative and qualitative administrative and evaluation data from participants and providers. We used descriptive statistics and paired t-tests to characterize care delivery and evaluate effectiveness post-intervention, and deductive thematic analysis to answer other aims.

Findings:

This case study included 152 PEARLS participants and nine data sources (N = 67 documents). The CBO including their CHWs/Ps partnered with the external implementation team made adaptations to PEARLS content, context, and implementation strategies to support CHWs/Ps and older adults. PEARLS was acceptable, feasible and delivered with fidelity. Participants showed significant reductions in depression severity at 5 months (98% clinical response rate [mean (SD), 13.7 (3.9) drop in pre/post PHQ-9; p < 0.001] and received support for 2.6 social needs on average. PEARLS delivery was facilitated by its relative advantage, adaptability, and trialability; the team's collective efficacy, buy-in, alignment with organization mission, and ongoing reflection and evaluation during implementation. Delivery was challenged by weak partnerships with clinics for participant referral, engagement, reimbursement, and sustainability post-grant funding.

Discussion:

This case study used existing data to learn how home-based CCM was adapted by and for CHWs/Ps to reduce health inequities in late-life depression and depression care among older Latino immigrants. The CBOs and CHWs/Ps strong trust and rapport, addressing social and health needs alongside depression care, and regular internal and external coaching and consultation, appeared to drive successful implementation and effectiveness.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation

Authors:

Cara C. Lewis, Meredith R. Boyd, C. Nathan Marti & Karen Albright

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2022

Read the full text in the open access journal Implementation Science

Abstract:

Background

Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization.

Methods

Using a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites

Results

Although tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice.

Conclusions

Although rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Process evaluation of PrEP implementation in Kenya: adaptation of practices and contextual modifications in public HIV care clinics

Authors:

Elizabeth M. Irungu, Josephine Odoyo, Elizabeth Wamoni, Elizabeth A. Bukusi, Nelly R. Mugo, Kenneth Ngure, Jennifer F. Morton, Kenneth K. Mugwanya, Jared M. Baeten, & Gabrielle O'Malley, for the Partners Scale-Up Project Team

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access Journal of the International AIDS Society
BACK TO THE ARCHIVE

Abstract:

Introduction

In Africa, oral pre-exposure prophylaxis (PrEP) is largely provided via over-burdened public HIV care clinics. Successfully incorporating PrEP services into these clinics may require adaptations to practices outlined in national implementation guidelines and modifications to routine existing service delivery. We aimed to describe adaptations made by public HIV clinics in Kenya to integrate PrEP delivery into existing services.

Methods

The Partners Scale-Up Project aimed to catalyze integration of PrEP in 25 public HIV care clinics. Between May and December 2018, we conducted qualitative interviews with health providers and documented clinic observations in technical assistance (TA) reports to understand the process of PrEP service integration. We analyzed 36 health provider interview transcripts and 25 TA reports to identify clinic-level adaptations to activities outlined in Kenyan Ministry of Health PrEP guidelines and modifications made to existing service delivery practices to successfully incorporate PrEP services. Identified adaptations were reported using the expanded framework for reporting adaptations and modifications (FRAME).

Results

All clinics (n = 25) performed HIV testing, HIV risk assessment, PrEP education and adherence counseling as stipulated in the guidelines. Most clinics initiated clients on PrEP without creatinine testing if otherwise healthy. While monthly refill appointments are recommended, a majority of clinics issued PrEP users two to three months of pills at a time. Clinics also implemented practices that had not been specified in the guidelines including incorporating PrEP-related topics into routine health talks, calling clients with missed PrEP appointments, discussing PrEP service delivery in regular staff meetings, ‘fast-tracking’ PrEP clients and dispensing PrEP in clinic rooms rather than at clinic-based pharmacies. PrEP initiation numbers were highest among clinics that did not require creatinine testing, conducted peer on-the-job PrEP training and those that discussed PrEP delivery in their routine meetings. Above-average continuation was observed among clinics that discussed PrEP in their routine meetings, dispensed PrEP in clinic rooms and offered PrEP at non-regular hours.

Conclusions

Health providers in public HIV care clinics instituted practices and made innovative adaptations to PrEP delivery to reduce barriers for clients and staff. Encouraging clinic level adaptations to national implementation guidelines will facilitate scale-up of PrEP delivery.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Aligning implementation science with improvement practice: A call to action

Authors:

Jennifer Leeman, Catherine Rohweder, Matthew Lee, Alison Brenner, Andrea Dwyer, Linda K. Ko, Meghan C. O’Leary, Grace Ryan, Thuy Vu, & Shoba Ramanadhan

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Implementation Science Communications
BACK TO THE ARCHIVE

Abstract:

Background

In several recent articles, authors have called for aligning the fields of implementation and improvement science. In this paper, we call for implementation science to also align with improvement practice. Multiple implementation scholars have highlighted the importance of designing implementation strategies to fit the existing culture, infrastructure, and practice of a healthcare system. Worldwide, healthcare systems are adopting improvement models as their primary approach to improving healthcare delivery and outcomes. The prevalence of improvement models raises the question of how implementation scientists might best align their efforts with healthcare systems’ existing improvement infrastructure and practice.

Main body

We describe three challenges and five benefits to aligning implementation science and improvement practice. Challenges include (1) use of different models, terminology, and methods, (2) a focus on generalizable versus local knowledge, and (3) limited evidence in support of the effectiveness of improvement tools and methods. We contend that implementation science needs to move beyond these challenges and work toward greater alignment with improvement practice. Aligning with improvement practice would benefit implementation science by (1) strengthening research/practice partnerships, (2) fostering local ownership of implementation, (3) generating practice-based evidence, (4) developing context-specific implementation strategies, and (5) building practice-level capacity to implement interventions and improve care. Each of these potential benefits is illustrated in a case study from the Centers for Disease Control and Prevention’s Cancer Prevention and Control Research Network.

Conclusion

To effectively integrate evidence-based interventions into routine practice, implementation scientists need to align their efforts with the improvement culture and practice that is driving change within healthcare systems worldwide. This paper provides concrete examples of how researchers have aligned implementation science with improvement practice across five implementation projects.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review

Authors:

Rosemary D. Meza, Noah S. Triplett, Grace S. Woodard, Prerna Martin, Alya N. Khairuzzaman, Gabrielle Jamora, & Shannon Dorsey

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2021

Read the full text in the open access journal Implementation Science
BACK TO THE ARCHIVE

Abstract:

Background

First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders’ access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes.

Methods

A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks.

Results

Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership’s positive relationship with providers’ EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers’ role in implementation.

Conclusions

Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ HIV-exposed infant follow-up in Mozambique: Formative research findings for the design of a cluster randomized controlled trial to improve testing and ART initiation

Authors:

Lúcia Vieira, Arlete Miloque Mahumane, Manuel Napua, Falume Chale, João Luís Manuel, Jessica Greenberg Cowan, Kenneth Sherr, Rachel R. Chapman & James T. Pfeiffer

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Early infant diagnosis (EID) of HIV-exposed and initiation of HIV-positive infants on anti-retroviral therapy (ART) requires a well-coordinated cascade of care. Loss-to-follow-up (LTFU) can occur at multiple steps and effective EID is impeded by human resource constraints, difficulty with patient tracking, and long waiting periods. The objective of this research was to conduct formative research to guide the development of an intervention to improve the pediatric HIV care cascade in central Mozambique. The study was conducted in Manica and Sofala Provinces where the adult HIV burden is higher than the national average. The research focused on 3 large clinics in each province, along the highly populated Beira corridor.

Methods

The research was conducted in 2014 over 3 months at six facilities and consisted of 1) patient flow mapping and collection of health systems data from postpartum, child-at-risk, and ART service registries, 2) measurement of clinic waiting times, and 3) patient and health worker focus groups.

Results

HIV testing and ART initiation coverage for mothers tends to be high, but EID and pediatric ART initiation are hampered by lack of patient tracking, long waiting times, and inadequate counseling to navigate the care cascade. About 76% of HIV-positive infants were LTFU and did not initiate ART.

Conclusions

Effective interventions to reduce LTFU in EID and improve pediatric ART initiation should focus on patient tracking, active follow-up of defaulting patients, reduction in EID turn-around times for PCR results, and initiation of ART by nurses in child-at-risk services.

Trial registration

Retrospectively registered, ISRCTN67747315, July 24, 2019.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study

Authors:

Alex R. Dopp, Kathryn E. Parisi, Sean A. Munson, & Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2020

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Innovative approaches are needed to maximize fit between the characteristics of evidence-based practices (EBPs), implementation strategies that support EBP use, and contexts in which EBPs are implemented. Standard approaches to implementation offer few ways to address such issues of fit. We characterized the potential for collaboration with experts from a relevant complementary approach, user-centered design (UCD), to increase successful implementation.

Method

Using purposive and snowball sampling, we recruited 56 experts in implementation (n = 34) or UCD (n = 22). Participants had 5+ years of professional experience (M = 10.31), worked across many settings (e.g., healthcare, education, human services), and were mostly female (59%) and white (73%). Each participant completed a web-based concept mapping structured conceptualization task. They sorted strategies from established compilations for implementation (36 strategies) and UCD (30 strategies) into distinct clusters, then rated the importance and feasibility of each strategy.

Results

We used multidimensional scaling techniques to examine patterns in the sorting of strategies. Based on conceptual clarity and fit with established implementation frameworks, we selected a final set of 10 clusters (i.e., groups of strategies), with five implementation-only clusters, two UCD-only clusters, and three trans-discipline clusters. The highest-priority activities (i.e., above-average importance and feasibility) were the trans-discipline clusters plus facilitate change and monitor change. Implementation and UCD experts sorted strategies into similar clusters, but each gave higher importance and feasibility ratings to strategies/clusters from their own discipline.

Conclusions

In this concept mapping study, experts in implementation and UCD had perspectives that both converged (e.g., trans-discipline clusters, which were all rated as high-priority) and diverged (e.g., in importance/feasibility ratings). The results provide a shared understanding of the alignment between implementation science and UCD, which can increase the impact and sustainability of EBP implementation efforts. Implications for improved collaboration among implementation and UCD experts are discussed.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**