Skip to content
Implementation Science at UW

Keywords: Review

✪ The relationship between first-level leadership and inner-context and implementation outcomes in behavioral health: a scoping review

Authors:

Rosemary D. Meza, Noah S. Triplett, Grace S. Woodard, Prerna Martin, Alya N. Khairuzzaman, Gabrielle Jamora, & Shannon Dorsey

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2021

Read the full text in the open access journal Implementation Science
BACK TO THE ARCHIVE

Abstract:

Background

First-level leadership is uniquely positioned to support evidence-based practice (EBP) implementation for behavioral health due to first-level leaders’ access to and relationship with service providers. First-level leaders are individuals who directly supervise and manage frontline employees who do not manage others. However, first-level leadership is underrepresented in existing reviews of the impact of leadership on EBP implementation. This review describes the relationship between first-level leadership and implementation determinants and outcomes.

Methods

A scoping review was performed to synthesize the literature on the relationship between first-level leadership and inner-context and implementation outcomes. A literature search was conducted in PubMed, Eric, PsycINFO, CINAHL, Scopus, and Web of Science. To be eligible, studies had to examine first-level leadership, be conducted in settings providing behavioral health services, and examine the relationship between first-level leadership and an implementation or inner-context outcome. Data extraction and synthesis were performed to describe study characteristics, leader-outcome relationships, and overlap in leadership frameworks.

Results

Twenty-one records met our inclusion criteria. Studies primarily relied on observational designs and were often cross-sectional. Studies more often examined general leadership rather than leadership strategically focused on EBP implementation (i.e., strategic implementation leadership). Our findings suggest that several forms of first-level leadership are inconsistently related to a broad set of implementation determinants, with infrequent examination of specific implementation outcomes. The broad set of implementation determinants studied, limited number of replications, and inconsistent findings have resulted in sparse evidence for any specific leadership-outcome relationship. The greatest accumulation of evidence exists for general leadership’s positive relationship with providers’ EBP attitudes, most notably in the form of transformational leadership. This was followed by evidence for strategic implementation leadership facilitating general implementation. Our synthesis revealed moderate conceptual overlap of strategic implementation leadership behaviors described in the theory of implementation leadership and theory of middle managers’ role in implementation.

Conclusions

Our findings suggest that first-level leadership may play an important role in shaping implementation determinants and outcomes, but consistent empirical support is sparse and confidence dampened by methodological issues. To advance the field, we need studies that adopt stronger methodological rigor, address the conceptual overlap in leadership frameworks, examine a broader set of implementation outcomes, and examine conditions under which leadership impacts implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A systematic review of empirical studies examining mechanisms of implementation in health

Authors:

Cara C. Lewis, Meredith R. Boyd, Callie Walsh-Bailey, Aaron R. Lyon, Rinad Beidas, Brian Mittman, Gregory A. Aarons, Bryan J. Weiner, & David A. Chambers

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2020

Read the full text in the open access journal Implementation Science

Abstract:

Background

Understanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms.

Methods

We systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms “mechanism,” “mediator,” or “moderator.” Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality.

Results

Search strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms.

Conclusions

Researchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Evaluating the implementation of cervical cancer screening programs in low-resource settings globally: a systematized review

Authors:

J. Andrew Dykens, Jennifer S. Smith, Margaret Demment, E. Marshall, Tina Schuh, Karen Peters, Tracy Irwin, Scott McIntosh, Angela Sy & Timothy Dye

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal Cancer Causes & Control

Abstract:

Purpose

Cervical cancer disproportionately burdens low-resource populations where access to quality screening services is limited. A greater understanding of sustainable approaches to implement cervical cancer screening services is needed.

Methods

We conducted a systematized literature review of evaluations from cervical cancer screening programs implemented in resource-limited settings globally that included a formal evaluation and intention of program sustainment over time. We categorized the included studies using the continuum of implementation research framework which categorizes studies progressively from “implementation light” to more implementation intensive.

Results

Fifty-one of 13,330 initially identified papers were reviewed with most study sites in low-resource settings of middle-income countries (94.1%) ,while 9.8% were in low-income countries. Across all studies, visual inspection of the cervix with acetic acid (58.8%) was the most prevalent screening method followed by cytology testing (39.2%). Demand-side (client and community) considerations were reported in 86.3% of the articles, while 68.6% focused scientific inquiry on the supply side (health service). Eighteen articles (35.3%) were categorized as “Informing Scale-up” along the continuum of implementation research.

Conclusions

The number of cervical cancer screening implementation reports is limited globally, especially in low-income countries. The 18 papers we classified as Informing Scale-up provide critical insights for developing programs relevant to implementation outcomes. We recommend that program managers report lessons learnt to build collective implementation knowledge for cervical cancer screening services, globally.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Evaluating and optimizing the consolidated framework for implementation research (CFIR) for use in low- and middle-income countries: a systematic review

Authors:

Arianna Rubin Means, Christopher G. Kemp, Marie-Claire Gwayi-Chore, Sarah Gimbel, Caroline Soi, Kenneth Sherr, Bradley H. Wagenaar, Judith N. Wasserheit, & Bryan J. Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal Implementation Science

Abstract:

Background

The Consolidated Framework for Implementation Research (CFIR) is a determinants framework that may require adaptation or contextualization to fit the needs of implementation scientists in low- and middle-income countries (LMICs). The purpose of this review is to characterize how the CFIR has been applied in LMIC contexts, to evaluate the utility of specific constructs to global implementation science research, and to identify opportunities to refine the CFIR to optimize utility in LMIC settings.

Methods

A systematic literature review was performed to evaluate the use of the CFIR in LMICs. Citation searches were conducted in Medline, CINAHL, PsycINFO, CINAHL, SCOPUS, and Web of Science. Data abstraction included study location, study design, phase of implementation, manner of implementation (ex., data analysis), domains and constructs used, and justifications for use, among other variables. A standardized questionnaire was sent to the corresponding authors of included studies to determine which CFIR domains and constructs authors found to be compatible with use in LMICs and to solicit feedback regarding ways in which CFIR performance could be improved for use in LMICs.

Results

Our database search yielded 504 articles, of which 34 met final inclusion criteria. The studies took place across 21 countries and focused on 18 different health topics. The studies primarily used qualitative study designs (68%). Over half (59%) of the studies applied the CFIR at study endline, primarily to guide data analysis or to contextualize study findings. Nineteen (59%) of the contacted authors participated in the survey. Authors unanimously identified culture and engaging as compatible with use in global implementation research. Only two constructs, patient needs and resources and individual stages of change were commonly identified as incompatible with use. Author feedback centered on team level influences on implementation, as well as systems characteristics, such as health system architecture. We propose a “Characteristics of Systems” domain and eleven novel constructs be added to the CFIR to increase its compatibility for use in LMICs.

Conclusions

These additions provide global implementation science practitioners opportunities to account for systems-level determinants operating independently of the implementing organization. Newly proposed constructs require further reliability and validity assessments.

Trial registration

PROSPERO, CRD42018095762

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation outcomes and strategies for depression interventions in low- and middle-income countries: A systematic review

Authors:

Bradley H. Wagenaar, Wilson H. Hammett, Courtney Jackson, Dana L. Atkins, Jennifer M. Belus, and Christopher G. Kemp

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal Global Mental Health

Abstract:

Background

We systematically reviewed implementation research targeting depression interventions in low- and middle-income countries (LMICs) to assess gaps in methodological coverage.

Methods

PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of depression interventions in LMICs reporting at least one implementation outcome published through March 2019.

Results

A total of 8714 studies were screened, 759 were assessed for eligibility, and 79 studies met inclusion criteria. Common implementation outcomes reported were acceptability (n = 50; 63.3%), feasibility (n = 28; 35.4%), and fidelity (n = 18; 22.8%). Only four studies (5.1%) reported adoption or penetration, and three (3.8%) reported sustainability. The Sub-Saharan Africa region (n = 29; 36.7%) had the most studies. The majority of studies (n = 59; 74.7%) reported outcomes for a depression intervention implemented in pilot researcher-controlled settings. Studies commonly focused on Hybrid Type-1 effectiveness-implementation designs (n = 53; 67.1), followed by Hybrid Type-3 (n = 16; 20.3%). Only 21 studies (26.6%) tested an implementation strategy, with the most common being revising professional roles (n = 10; 47.6%). The most common intervention modality was individual psychotherapy (n = 30; 38.0%). Common study designs were mixed methods (n = 27; 34.2%), quasi-experimental uncontrolled pre-post (n = 17; 21.5%), and individual randomized trials (n = 16; 20.3).

Conclusions

Existing research has focused on early-stage implementation outcomes. Most studies have utilized Hybrid Type-1 designs, with the primary aim to test intervention effectiveness delivered in researcher-controlled settings. Future research should focus on testing and optimizing implementation strategies to promote scale-up of evidence-based depression interventions in routine care. These studies should use high-quality pragmatic designs and focus on later-stage implementation outcomes such as cost, penetration, and sustainability.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Supply chain management and accessibility to point-of-care testing in resource-limited settings: a systematic scoping review

Authors:

Desmond Kuupiel, Vitalis Bawontuo, Paul K. Drain, Nonjabulo Gwala, & Tivani P. Mashamba-Thompson

University of Washington affiliated authors are displayed in bold.

Published: July 2019

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

World Health Organization (WHO) has created an essential list of in-vitro diagnostics. Supply chain management (SCM) is said to be the vehicle that ensures that developed point-of-care (POC) tests reach their targeted settings for use. We therefore, mapped evidence on SCM of and accessibility to POC testing (availability and use of POC tests) in low- and middle-income countries (LMICs).

Methods

We conducted a systematic scoping review using Arksey and O’Malley’s framework as a guide. We searched PubMed; CINAHL; MEDLINE; WEB of Science; Science Direct; and Google Scholar databases for studies that focused on POC diagnostic tests and SCM. The review included studies that were undertaken in 140 countries defined by the World Bank as LMICs published up to August 2017. Two reviewers independently screened the abstracts and full articles against the eligibility criteria. The study used the mixed methods appraisal tool version 2011 to assess the risk of bias for the included studies. NVivo version 11 was employed to extract themes from all included studies and results presented using a narrative approach.

Results

Of 292 studies identified in this review, only 15 published between 2009 and 2017 included evidence on POC diagnostics and SCM. Of the 15 studies, three were conducted in Zambia, one each in Mozambique, Uganda, Guatemala; South Africa, one in Burkina Faso, Zimbabwe, and one multi-country study (Tanzania, Uganda, China, Peru and Zambia and Brazil). Six studies were not country specific since they were not primary studies. Majority of the studies reported stock-outs of HIV, syphilis, and malaria POC tests. There was a moderate to substantial level of agreement between the reviewers’ responses at full article screening stage (Kappa statistic = 0.80, p <  0.01). Nine studies underwent methodological quality appraisal and all, scored between 90 and 100%.

Conclusions

The results demonstrated limited published research on SCM of and accessibility to POC testing in LMICs. Further studies aimed at investigating SCM of POC tests in resource-limited settings to identify the barriers/challenges and provide a context-specific evidence-based solutions for policy/decision makers, implementers, and POC developers, funders, and development partners would be essential.

PROSPERO registration number

CRD42016043711

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Enhance®Fitness Dissemination and Implementation: 2010–2015: A Scoping Review

Authors:

Miruna G. Petrescu-Prahova, Thomas J. Eagen, Sarah L. Fishleder, Basia Belza

University of Washington affiliated authors are displayed in bold.

Published: February 2017

Read the full text in the open access journal American Journal of Preventive Medicine

Abstract:

Introduction

Physical activity has many benefits for older adult physical and mental health. Enhance®Fitness (EF) is an evidence-based group exercise program delivered by community-based organizations. The purpose of this study was to review recent evidence on the dissemination and implementation of EF.

Methods

A scoping review of qualitative and quantitative studies with EF as main focus was conducted. CINAHL, PubMed, PubMed Central, SCOPUS, Web of Science, PsycINFO, and Google Scholar were searched between October and November 2015 for data-based studies on EF published in 2010–2015. Two team members abstracted each paper independently using a data abstraction tool. Results were summarized using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework.

Results

Seventeen publications met inclusion criteria. EF has reached and is effective across a broad population base, including individuals with low SES and diverse ethnic/racial backgrounds. EF participation may be associated with reduced risk for falls requiring medical care, and is associated with fewer hospital admissions. Analyses of medical cost savings from EF participation and program implementation costs suggest economic benefits of EF implementation for communities. Organization-level maintenance is facilitated by program-specific and organizational factors, such as instructor training and funding. Individual-level maintenance is facilitated by program structure, absence of pain, and increased quality of life.

Conclusions

More-rigorous evidence is needed about the association between participation in EF and conditions such as falls. Evaluation of program fidelity, adaptations, and sustainability is limited; more-systematic examination across population groups and types of organizations would help ensure older adults continue to benefit from EF participation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Cost-Effectiveness Tool to Guide the Prioritization of Interventions for Rheumatic Fever and Rheumatic Heart Disease Control in African Nations

Authors:

David Watkins, Solomon J. Lubinga, Bongani Mayosi, Joseph B. Babigumira

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2016

Read the full text in the open access journal PLOS Neglected Tropical Diseases

Abstract:

Background

Rheumatic heart disease (RHD) prevalence and mortality rates remain especially high in many parts of Africa. While effective prevention and treatment exist, coverage rates of the various interventions are low. Little is known about the comparative cost-effectiveness of different RHD interventions in limited resource settings. We developed an economic evaluation tool to assist ministries of health in allocating resources and planning RHD control programs.

Methodology/Principal Findings

We constructed a Markov model of the natural history of acute rheumatic fever (ARF) and RHD, taking transition probabilities and intervention effectiveness data from previously published studies and expert opinion. Our model estimates the incremental cost-effectiveness of scaling up coverage of primary prevention (PP), secondary prevention (SP) and heart valve surgery (VS) interventions for RHD. We take a healthcare system perspective on costs and measure outcomes as disability-adjusted life-years (DALYs), discounting both at 3%. Univariate and probabilistic sensitivity analyses are also built into the modeling tool. We illustrate the use of this model in a hypothetical low-income African country, drawing on available disease burden and cost data. We found that, in our hypothetical country, PP would be cost saving and SP would be very cost-effective. International referral for VS (e.g., to a country like India that has existing surgical capacity) would be cost-effective, but building in-country VS services would not be cost-effective at typical low-income country thresholds.

Conclusions/Significance

Our cost-effectiveness analysis tool is designed to inform priorities for ARF/RHD control programs in Africa at the national or subnational level. In contrast to previous literature, our preliminary findings suggest PP could be the most efficient and cheapest approach in poor countries. We provide our model for public use in the form of a Supplementary File. Our research has immediate policy relevance and calls for renewed efforts to scale up RHD prevention.

Author Summary

Rheumatic heart disease is a major cause of cardiovascular morbidity and mortality in Africa. Although there are effective medications and surgical procedures for rheumatic heart disease, they are under-used. What is more, these interventions can be expensive—even if they are feasible and effective. Unfortunately, there are currently very few economic studies on rheumatic heart disease, leaving ministries of health with little guidance on how to choose among various interventions and allocate resources to control programs. Our study describes the methods and data we used to develop a cost-effectiveness analysis tool that was intended specifically for decision-making in African countries. In our study, we also illustrate, in a hypothetical low-income African country, how the tool could be used. In our illustrative example, a prevention-oriented approach would save money in the long term, although other interventions could be cost-effective and feasible if enough financial resources were present. These findings contrast with previous studies and make a strong case that rheumatic heart disease prevention could be a high-priority intervention in Africa. We are making our tool publicly available and anticipate that ministries of health will use it as they develop or expand their rheumatic heart disease control programs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**