Review Archives - Page 3 of 4 - Implementation Science at UW

✪ Application of the Expert Recommendations for Implementing Change (ERIC) compilation of strategies to health intervention implementation in low- and middle-income countries: a systematic review

Abstract:

Background

The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research.

Methods

We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies.

Results

The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1–46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness.

Conclusions

While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Content validity of an item bank to assess intervention characteristic determinants of implementing evidence-based practices

Abstract:

Background

Barriers and facilitators, collectively called determinants, of evidence-based practice implementation are key to identifying the best strategies for promoting implementation. Assessing determinants before implementation can help tailor strategies to those that would be most effective. Current measures of determinants are not comparable across implementation settings and implementation scientists and practitioners often have to create their own measures. This study was the first step in creating determinants item banks that are usable across settings and focused on intervention characteristics. We aimed to establish the content validity of the item bank.

Method

This study used a concurrent mixed methods approach. Items for assessing intervention characteristic determinants were first identified through systematic reviews. Implementation scientists then completed a survey where they provided both quantitative and qualitative feedback on the items. Finally, three experts with both clinical and implementation experience provided feedback on redundancy and representativeness.

Results

The systematic reviews identified over 1,959 items so subsequent steps were limited to focus on intervention characteristic determinants (271 items) such as adaptability of the practice. Based on feedback from thirty implementation scientists, the items were reduced to 92 but an additional 53 were added, most due to qualitative feedback. Items were also rewritten based on qualitative results. Three experts reviewed the remaining 145 items. Based on their feedback, the number of items was reduced to 109.

Conclusions

Creating a determinants item bank was feasible and the final items had content validity. The next steps include testing reliability and validity in a larger sample of clinicians implementing evidence-based practices.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Twenty years of capacity building across the cancer prevention and control research network

Abstract:

Purpose

To improve population health, community members need capacity (i.e., knowledge, skills, and tools) to select and implement evidence-based interventions (EBIs) to fit the needs of their local settings. Since 2002, the Centers for Disease Control and Prevention has funded the national Cancer Prevention and Control Research Network (CPCRN) to accelerate the implementation of cancer prevention and control EBIs in communities. The CPCRN has developed multiple strategies to build community members’ capacity to implement EBIs. This paper describes the history of CPCRN’s experience developing and lessons learned through the use of five capacity-building strategies: (1) mini-grant programs, (2) training, (3) online tools, (4) evidence academies, and (5) evaluation support for partners’ capacity-building initiatives.

Methods

We conducted a narrative review of peer-reviewed publications and grey literature reports on CPCRN capacity-building activities. Guided by the Interactive Systems Framework, we developed histories, case studies, and lessons learned for each strategy. Lessons were organized into themes.

Results

Three themes emerged: the importance of (1) community-engagement prior to and during implementation of capacity-building strategies, (2) establishing and sustaining partnerships, and (3) co-learning at the levels of centers, networks, and beyond.

Conclusion

CPCRN activities have increased the ability of community organizations to compete for external funds to support implementation, increased the use of evidence in real-world settings, and promoted the broad-scale implementation of cancer control interventions across more than eight states. Lessons from this narrative review highlight the value of long-term thematic networks and provide useful guidance to other research networks and future capacity-building efforts.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A Conceptual Framework for Group Well-Child Care: A Tool to Guide Implementation, Evaluation, and Research

Abstract:

Objective

To use scoping review methods to construct a conceptual framework based on current evidence of group well-child care to guide future practice and research.

Methods

We conducted a scoping review using Arksey and O’Malley’s (2005) six stages. We used constructs from the Consolidated Framework for Implementation Research and the quadruple aim of health care improvement to guide the construction of the conceptual framework.

Results

The resulting conceptual framework is a synthesis of the key concepts of group well-child care, beginning with a call for a system redesign of well-child care to improve outcomes while acknowledging the theoretical antecedents structuring the rationale that supports the model. Inputs of group well-child care include health systems contexts; administration/logistics; clinical setting; group care clinic team; community/patient population; and curriculum development and training. The core components of group well-child care included structure (e.g., group size, facilitators), content (e.g., health assessments, service linkages). and process (e.g., interactive learning and community building). We found clinical outcomes in all four dimensions of the quadruple aim of healthcare.

Conclusion

Our conceptual framework can guide model implementation and identifies several outcomes that can be used to harmonize model evaluation and research. Future research and practice can use the conceptual framework as a tool to standardize model implementation and evaluation and generate evidence to inform future healthcare policy and practice.

Significance

What is already known on this subject? Group well-child care (GWCC) is associated with improved healthcare utilization (e.g., attendance, immunization rates), parent outcomes (e.g., psychological well-being, satisfaction), and clinician outcomes (e.g., self-efficacy).

What this study adds? Scoping review methodology was used to generate a conceptual framework of GWCC which can be used as a guide to standardize practices for implementation, evaluation, and research in GWCC.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Successful ingredients of effective Collaborative Care programs in low- and middle-income countries: A rapid review

Abstract:

Integrating mental health care in primary healthcare settings is a compelling strategy to address the mental health treatment gap in low- and middle-income countries (LMICs). Collaborative Care is the integrated care model with the most evidence supporting its effectiveness, but most research has been conducted in high-income countries. Efforts to implement this complex multi-component model at scale in LMICs will be enhanced by understanding the model components that have been effective in LMIC settings.

Following Cochrane Rapid Reviews Methods Group recommendations, we conducted a rapid review to identify studies of the effectiveness of Collaborative Care for priority adult mental disorders of mhGAP (mood and anxiety disorders, psychosis, substance use disorders and epilepsy) in outpatient medical settings in LMICs. Article screening and data extraction were performed using Covidence software. Data extraction by two authors utilized a checklist of key components of effective interventions. Information was aggregated to examine how frequently the components were applied.

Our search yielded 25 articles describing 20 Collaborative Care models that treated depression, anxiety, schizophrenia, alcohol use disorder or epilepsy in nine different LMICs. Fourteen of these models demonstrated statistically significantly improved clinical outcomes compared to comparison groups. Successful models shared key structural and process-of-care elements: a multi-disciplinary care team with structured communication; standardized protocols for evidence-based treatments; systematic identification of mental disorders, and a stepped-care approach to treatment intensification. There was substantial heterogeneity across studies with respect to the specifics of model components, and clear evidence of the importance of tailoring the model to the local context.

This review provides evidence that Collaborative Care is effective across a range of mental disorders in LMICs. More work is needed to demonstrate population-level and longer-term outcomes, and to identify strategies that will support successful and sustained implementation in routine clinical settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Addictions treatment mechanisms of change science and implementation science: A critical review

Abstract:

This manuscript aims to contribute to the next phase of mechanisms of behavior change (MOBC) science on alcohol or other drug use. Specifically, we encourage the transition from a basic science orientation (i.e., knowledge generation) to a translational science orientation (i.e., knowledge application or Translational MOBC Science). To inform that transition, we examine MOBC science and implementation science and consider how these two research areas can intersect to capitalize on the goals, strengths, and key methodologies of each. First, we define MOBC science and implementation science and offer a brief historical rationale for these two areas of clinical research. Second, we summarize similarities in rationale and discuss two scenarios where one draws from the other—MOBC science on implementation strategy outcomes and implementation science on MOBC. We then focus on the latter scenario, and briefly review the MOBC knowledge base to consider its readiness for knowledge translation. Finally, we provide a series of research recommendations to facilitate the translation of MOBC science. These recommendations include: (1) identifying and targeting MOBC that are well suited for implementation, (2) use of MOBC research results to inform broader health behavior change theory, and (3) triangulation of a more diverse set of research methodologies to build a translational MOBC knowledge base. Ultimately, it is important for gains borne from MOBC science to affect direct patient care, while basic MOBC research continues to be developed and refined over time. Potential implications of these developments include greater clinical significance for MOBC science, an efficient feedback loop between clinical research methodologies, a multi-level approach to understanding behavioral change, and reduced or eliminated siloes between MOBC science and implementation science.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Applying and reporting relevance, richness and rigour in realist evidence appraisals: Advancing key concepts in realist reviews

Abstract:

The realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps. This includes selecting and appraising evidence sources, which are often considered for their ‘relevance, richness and rigour.’ In contrast to other review approaches, for example, narrative reviews and meta-analyses, the inclusion criteria and appraisal of evidence within realist reviews depend less on the study's methodological quality and more on its contribution to our understanding of generative causation, uncovered through the process of retroductive theorising. This research brief aims to discuss the current challenges and practices for appraising documents' relevance, richness and rigour and to provide pragmatic suggestions for how realist reviewers can put this into practice.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Economic evaluation of implementation science outcomes in low- and middle-income countries: a scoping review

Abstract:

Background

Historically, the focus of cost-effectiveness analyses has been on the costs to operate and deliver interventions after their initial design and launch. The costs related to design and implementation of interventions have often been omitted. Ignoring these costs leads to an underestimation of the true price of interventions and biases economic analyses toward favoring new interventions. This is especially true in low- and middle-income countries (LMICs), where implementation may require substantial up-front investment. This scoping review was conducted to explore the topics, depth, and availability of scientific literature on integrating implementation science into economic evaluations of health interventions in LMICs.

Methods

We searched Web of Science and PubMed for papers published between January 1, 2010, and December 31, 2021, that included components of both implementation science and economic evaluation. Studies from LMICs were prioritized for review, but papers from high-income countries were included if their methodology/findings were relevant to LMIC settings.

Results

Six thousand nine hundred eighty-six studies were screened, of which 55 were included in full-text review and 23 selected for inclusion and data extraction. Most papers were theoretical, though some focused on a single disease or disease subset, including: mental health (n = 5), HIV (n = 3), tuberculosis (n = 3), and diabetes (n = 2). Manuscripts included a mix of methodology papers, empirical studies, and other (e.g., narrative) reviews. Authorship of the included literature was skewed toward high-income settings, with 22 of the 23 papers featuring first and senior authors from high-income countries. Of nine empirical studies included, no consistent implementation cost outcomes were measured, and only four could be mapped to an existing costing or implementation framework. There was also substantial heterogeneity across studies in how implementation costs were defined, and the methods used to collect them.

Conclusion

A sparse but growing literature explores the intersection of implementation science and economic evaluation. Key needs include more research in LMICs, greater consensus on the definition of implementation costs, standardized methods to collect such costs, and identifying outcomes of greatest relevance. Addressing these gaps will result in stronger links between implementation science and economic evaluation and will create more robust and accurate estimates of intervention costs.

Trial registration/h5>

The protocol for this manuscript was published on the Open Science Framework. It is available at: https://osf.io/ms5fa/ (DOI: 10.17605/OSF.IO/32EPJ).

^{This abstract is posted with permission under the Creative Commons Attribution 4.0 International License}

✪ Exploring the impact of workforce turnover on the sustainability of evidence-based programs: A scoping review

Abstract:

Background

Evidence-based programs (EBPs) are used across disciplines to integrate research into practice and improve outcomes at the individual and/or community level. Despite widespread development and implementation of EBPs, many programs are not sustained beyond the initial implementation period due to many factors, including workforce turnover. This scoping review summarizes research on the impact of workforce turnover on the sustainability of EBPs and recommendations for mitigating these impacts.

Methods

We searched 10 databases for articles that focused on an EBP and described an association between workforce turnover and the sustainment or sustainability of the program. We created a data abstraction tool to extract relevant information from each article and applied the data abstraction tool to all included articles to create the dataset. Data were mapped and analyzed using the program sustainability framework (PSF).

Results and Discussion

A total of 30 articles were included in this scoping review and mapped to the PSF. Twenty-nine articles described impacts of workforce turnover and 18 articles proposed recommendations to address the impacts. The most frequent impacts of workforce turnover included increased need for training, loss of organizational knowledge, lack of EBP fidelity, and financial stress. Recommendations to address the impact of workforce turnover included affordable and alternative training modalities, the use of champions or volunteers, increasing program alignment with organizational goals, and generating diverse funding portfolios.

Conclusion

The sustainment of EBPs is critical to ensure and maintain the short- and long-term benefits of the EBP for all participants and communities. Understanding the impacts of workforce turnover, a determinant of sustainability, can create awareness among EBP-implementing organizations and allow for proactive planning to increase the likelihood of program sustainability.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Method

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Cancer Causes and Control

Abstract:

Purpose

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access Maternal and Child Health Journal

Abstract:

Objective

Methods

Results

Conclusion

Significance

Authors:

✪ Open Access

Read the full text in the open access journal Cambridge University Press

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Research Synthesis Methods

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusion

Trial registration/h5> The protocol for this manuscript was published on the Open Science Framework. It is available at: https://osf.io/ms5fa/ (DOI: 10.17605/OSF.IO/32EPJ). **This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Methods

Results and Discussion

Conclusion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Current Psychiatry Reports

Trial registration/h5>

The protocol for this manuscript was published on the Open Science Framework. It is available at: https://osf.io/ms5fa/ (DOI: 10.17605/OSF.IO/32EPJ).

^{This abstract is posted with permission under the Creative Commons Attribution 4.0 International License}