Open Access Archives - Page 29 of 35 - Implementation Science at UW

✪ Implementation Determinants and Outcomes of a Technology-Enabled Service Targeting Suicide Risk in High Schools: Mixed Methods Study

Abstract:

Background

Technology-enabled services (TESs), which integrate human service and digital components, are popular strategies to increase the reach and impact of mental health interventions, but large-scale implementation of TESs has lagged behind their potential.

Objective

This study applied a mixed qualitative and quantitative approach to gather input from multiple key user groups (students and educators) and to understand the factors that support successful implementation (implementation determinants) and implementation outcomes of a TES for universal screening, ongoing monitoring, and support for suicide risk management in the school setting.

Methods

A total of 111 students in the 9th to 12th grade completed measures regarding implementation outcomes (acceptability, feasibility, and appropriateness) via an open-ended survey. A total of 9 school personnel (school-based mental health clinicians, nurses, and administrators) completed laboratory-based usability testing of a dashboard tracking the suicide risk of students, quantitative measures, and qualitative interviews to understand key implementation outcomes and determinants. School personnel were presented with a series of scenarios and common tasks focused on the basic features and functions of the dashboard. Directed content analysis based on the Consolidated Framework for Implementation Research was used to extract multilevel determinants (ie, the barriers or facilitators at the levels of the outer setting, inner setting, individuals, intervention, and implementation process) related to positive implementation outcomes of the TES.

Results

Overarching themes related to implementation determinants and outcomes suggest that both student and school personnel users view TESs for suicide prevention as moderately feasible and acceptable based on the Acceptability of Intervention Measure and Feasibility of Intervention Measure and as needing improvements in usability based on the System Usability Scale. Qualitative results suggest that students and school personnel view passive data collection based on social media data as a relative advantage to the current system; however, the findings indicate that the TES and the school setting need to address issues of privacy, integration into existing workflows and communication patterns, and options for individualization for student-centered care.

Conclusions

Innovative suicide prevention strategies that rely on passive data collection in the school context are a promising and appealing idea. Usability testing identified key issues for revision to facilitate widespread implementation.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A systematic review of empirical studies examining mechanisms of implementation in health

Abstract:

Background

Understanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms.

Methods

We systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms “mechanism,” “mediator,” or “moderator.” Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality.

Results

Search strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms.

Conclusions

Researchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Evaluating the implementation of cervical cancer screening programs in low-resource settings globally: a systematized review

Abstract:

Purpose

Cervical cancer disproportionately burdens low-resource populations where access to quality screening services is limited. A greater understanding of sustainable approaches to implement cervical cancer screening services is needed.

Methods

We conducted a systematized literature review of evaluations from cervical cancer screening programs implemented in resource-limited settings globally that included a formal evaluation and intention of program sustainment over time. We categorized the included studies using the continuum of implementation research framework which categorizes studies progressively from “implementation light” to more implementation intensive.

Results

Fifty-one of 13,330 initially identified papers were reviewed with most study sites in low-resource settings of middle-income countries (94.1%) ,while 9.8% were in low-income countries. Across all studies, visual inspection of the cervix with acetic acid (58.8%) was the most prevalent screening method followed by cytology testing (39.2%). Demand-side (client and community) considerations were reported in 86.3% of the articles, while 68.6% focused scientific inquiry on the supply side (health service). Eighteen articles (35.3%) were categorized as “Informing Scale-up” along the continuum of implementation research.

Conclusions

The number of cervical cancer screening implementation reports is limited globally, especially in low-income countries. The 18 papers we classified as Informing Scale-up provide critical insights for developing programs relevant to implementation outcomes. We recommend that program managers report lessons learnt to build collective implementation knowledge for cervical cancer screening services, globally.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Systems analysis and improvement approach to optimize the hypertension diagnosis and care cascade for PLHIV individuals (SAIA-HTN): A hybrid type III cluster randomized trial

Authors:

Sarah Gimbel, Ana Olga Mocumbi, Kristjana Ásbjörnsdóttir, Joana Coutinho, Leonel Andela, Bonifacio Cebola, Heidi Craine, Jonny Crocker, Leecreesha Hicks, Sarah Holte, Rodrigues Hossieke, Edgar Itai, Carol Levin, Nelia Manaca, Filipe Murgorgo, Miguel Nhumba, James Pfeiffer, Isaias Ramiro, Keshet Ronen, Nona Sotoodehnia, Onei Uetela, Anjuli Wagner, Bryan J. Weiner, & Kenneth Sherr

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: March 2020

Read the full text in the open access journal Implementation Science

Abstract:

Background

Across sub-Saharan Africa, evidence-based clinical guidelines to screen and manage hypertension exist; however, country level application is low due to lack of service readiness, uneven health worker motivation, weak accountability of health worker performance, and poor integration of hypertension screening and management with chronic care services. The systems analysis and improvement approach (SAIA) is an evidence-based implementation strategy that combines systems engineering tools into a five-step, facility-level package to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). As hypertension screening and management are integrated into chronic care services in sub-Saharan Africa, an opportunity exists to test whether SAIA interventions shown to be effective in improving efficiency and coverage of HIV services can be effective when applied to the non-communicable disease services that leverage the same platform. We hypothesize that SAIA-hypertension (SAIA-HTN) will be effective as an adaptable, scalable model for broad implementation.

Methods

We will deploy a hybrid type III cluster randomized trial to evaluate the impact of SAIA-HTN on hypertension management in eight intervention and eight control facilities in central Mozambique. Effectiveness outcomes include hypertension cascade flow measures (screening, diagnosis, management, control), as well as hypertension and HIV clinical outcomes among people living with HIV. Cost-effectiveness will be estimated as the incremental costs per additional patient passing through the hypertension cascade steps and the cost per additional disability-adjusted life year averted, from the payer perspective (Ministry of Health). SAIA-HTN implementation fidelity will be measured, and the Consolidated Framework for Implementation Research will guide qualitative evaluation of the implementation process in high- and low-performing facilities to identify determinants of intervention success and failure, and define core and adaptable components of the SAIA-HTN intervention. The Organizational Readiness for Implementing Change scale will measure facility-level readiness for adopting SAIA-HTN.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line health workers to identify low-cost, contextually appropriate chronic care improvement strategies. By integrating SAIA into routine hypertension screening and management structures, this pragmatic trial is designed to test a model for national scale-up.

Trial registration

Registered 09/13/2019; NCT04088656).

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation outcomes and strategies for depression interventions in low- and middle-income countries: A systematic review

Abstract:

Background

We systematically reviewed implementation research targeting depression interventions in low- and middle-income countries (LMICs) to assess gaps in methodological coverage.

Methods

PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of depression interventions in LMICs reporting at least one implementation outcome published through March 2019.

Results

A total of 8714 studies were screened, 759 were assessed for eligibility, and 79 studies met inclusion criteria. Common implementation outcomes reported were acceptability (n = 50; 63.3%), feasibility (n = 28; 35.4%), and fidelity (n = 18; 22.8%). Only four studies (5.1%) reported adoption or penetration, and three (3.8%) reported sustainability. The Sub-Saharan Africa region (n = 29; 36.7%) had the most studies. The majority of studies (n = 59; 74.7%) reported outcomes for a depression intervention implemented in pilot researcher-controlled settings. Studies commonly focused on Hybrid Type-1 effectiveness-implementation designs (n = 53; 67.1), followed by Hybrid Type-3 (n = 16; 20.3%). Only 21 studies (26.6%) tested an implementation strategy, with the most common being revising professional roles (n = 10; 47.6%). The most common intervention modality was individual psychotherapy (n = 30; 38.0%). Common study designs were mixed methods (n = 27; 34.2%), quasi-experimental uncontrolled pre-post (n = 17; 21.5%), and individual randomized trials (n = 16; 20.3).

Conclusions

Existing research has focused on early-stage implementation outcomes. Most studies have utilized Hybrid Type-1 designs, with the primary aim to test intervention effectiveness delivered in researcher-controlled settings. Future research should focus on testing and optimizing implementation strategies to promote scale-up of evidence-based depression interventions in routine care. These studies should use high-quality pragmatic designs and focus on later-stage implementation outcomes such as cost, penetration, and sustainability.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study

Abstract:

Background

Innovative approaches are needed to maximize fit between the characteristics of evidence-based practices (EBPs), implementation strategies that support EBP use, and contexts in which EBPs are implemented. Standard approaches to implementation offer few ways to address such issues of fit. We characterized the potential for collaboration with experts from a relevant complementary approach, user-centered design (UCD), to increase successful implementation.

Method

Using purposive and snowball sampling, we recruited 56 experts in implementation (n = 34) or UCD (n = 22). Participants had 5+ years of professional experience (M = 10.31), worked across many settings (e.g., healthcare, education, human services), and were mostly female (59%) and white (73%). Each participant completed a web-based concept mapping structured conceptualization task. They sorted strategies from established compilations for implementation (36 strategies) and UCD (30 strategies) into distinct clusters, then rated the importance and feasibility of each strategy.

Results

We used multidimensional scaling techniques to examine patterns in the sorting of strategies. Based on conceptual clarity and fit with established implementation frameworks, we selected a final set of 10 clusters (i.e., groups of strategies), with five implementation-only clusters, two UCD-only clusters, and three trans-discipline clusters. The highest-priority activities (i.e., above-average importance and feasibility) were the trans-discipline clusters plus facilitate change and monitor change. Implementation and UCD experts sorted strategies into similar clusters, but each gave higher importance and feasibility ratings to strategies/clusters from their own discipline.

Conclusions

In this concept mapping study, experts in implementation and UCD had perspectives that both converged (e.g., trans-discipline clusters, which were all rated as high-priority) and diverged (e.g., in importance/feasibility ratings). The results provide a shared understanding of the alignment between implementation science and UCD, which can increase the impact and sustainability of EBP implementation efforts. Implications for improved collaboration among implementation and UCD experts are discussed.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Research translation for military and veteran health: research, practice, policy

Authors:

Jeffrey P. Haibach, Katherine D. Hoerster, Lindsey Dorflinger, Lisa M. McAndrew, Daniel G. Cassidy, David E. Goodrich, Jill E. Bormann, Julie Lowery, Steven M. Asch, Susan D. Raffa, Tannaz Moin, Alan L. Peterson, Michael G. Goldstein, Tracy Neal-Walden, Gerald W. Talcott, Christopher L. Hunter, & Sara J. Knight

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: February 2020

Read the full text in the journal Translational Behavioral Medicine

✪ Longitudinal Remote Coaching for Implementation of Perinatal Collaborative Care: A Mixed-Methods Analysis

Abstract:

The collaborative care model (CoCM) is a multicomponent, team-based integrated behavioral health framework. Its effectiveness in the treatment of perinatal depression is established, but implementation has been limited. The authors used longitudinal remote coaching (LRC) as a novel implementation strategy to support systematic case review in a multistate cluster-randomized trial of CoCM for perinatal depression. They describe LRC for perinatal CoCM in three clinics and use of a mixed-methods analysis of data from LRC feedback forms and interviews with participants. LRC is a scalable implementation strategy with potential to support complex models of integrated behavioral health, such as perinatal CoCM.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Addressing low-value pharmacological prescribing in primary prevention of CVD through a structured evidence-based and theory-informed process for the design and testing of de-implementation strategies: the DE-imFAR study

Abstract:

Background

De-implementation or abandonment of ineffective or low-value healthcare is becoming a priority research field globally due to the growing empirical evidence of the high prevalence of such care and its impact in terms of patient safety and social inefficiency. Little is known, however, about the factors, barriers, and facilitators involved or about interventions that are effective in promoting and accelerating the de-implementation of low-value healthcare. The De-imFAR study seeks to carry out a structured, evidence-based, and theory-informed process involving the main stakeholders (clinicians, managers, patients, and researchers) for the design, deployment, and assessment of de-implementation strategies for reducing low-value pharmacological prescribing.

Methods

A phase I formative study using a systematic and comprehensive framework based on theory and evidence for the design of implementation strategies—specifically, the Behavior Change Wheel (BCW)—will be conducted to design and model de-implementation strategies to favor reductions in low-value pharmacological prescribing of statins in primary prevention of cardiovascular disease (CVD) by main stakeholders (clinicians, managers, patients, and researchers) in a collegiate way. Subsequently, a phase II comparative hybrid trial will be conducted to assess the feasibility and potential effectiveness of at least one active de-implementation strategy to reduce low-value pharmacological prescribing of statins in primary prevention of CVD compared to the usual procedures for dissemination of clinical practice guidelines (“what-not-to-do” recommendations). A mixed-methods evaluation will be used: quantitative for the results of the implementation at the professional level (e.g., adoption, reach and implementation or execution of the recommended clinical practice); and qualitative to determine the feasibility and perceived impact of the de-implementation strategies from the clinicians’ perspective, and patients’ experiences related to the clinical care received.

Discussion

The DE-imFAR study aims to generate valid scientific knowledge about the design and development of de-implementation strategies using theory- and evidence-based methodologies suggested by implementation science. It will explore the effectiveness of these strategies and their acceptability among clinicians, policymakers, and patients. Its ultimate goal is to maximize the quality and efficiency of our health system by abandoning low-value pharmacological prescribing.

Trial Registration

Clinicaltrials.gov identifier: NCT04022850. Registered 17 July 2019

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Measuring fidelity, feasibility, costs: an implementation evaluation of a cluster-controlled trial of group antenatal care in rural Nepal

Abstract:

Background

Access to high-quality antenatal care services has been shown to be beneficial for maternal and child health. In 2016, the WHO published evidence-based recommendations for antenatal care that aim to improve utilization, quality of care, and the patient experience. Prior research in Nepal has shown that a lack of social support, birth planning, and resources are barriers to accessing services in rural communities. The success of CenteringPregnancy and participatory action women’s groups suggests that group care models may both improve access to care and the quality of care delivered through women’s empowerment and the creation of social networks. We present a group antenatal care model in rural Nepal, designed and implemented by the healthcare delivery organization Nyaya Health Nepal, as well as an assessment of implementation outcomes.

Methods

The study was conducted at Bayalata Hospital in Achham, Nepal, via a public private partnership between the Nepali non-profit, Nyaya Health Nepal, and the Ministry of Health and Population, with financial and technical assistance from the American non-profit, Possible. We implemented group antenatal care as a prospective non-randomized cluster-controlled, type I hybrid effectiveness-implementation study in six village clusters. The implementation approach allows for iterative improvement in design, making changes to improve the quality of the intervention. Assessments of implementation process and model fidelity were undertaken using a mobile checklist completed by nurse supervisors, and observation forms completed by program leadership. We evaluated data quarterly using descriptive statistics to identify trends. Qualitative interviews and team communications were analyzed through immersion crystallization to identify major themes that evolved during the implementation process.

Results

A total of 141 group antenatal sessions were run during the study period. This paper reports on implementation results, whereas we analyze and present patient-level effectiveness outcomes in a complementary paper in this journal. There was high process fidelity to the model, with 85.7% (95% CI 77.1–91.5%) of visits completing all process elements, and high content fidelity, with all village clusters meeting the minimum target frequency for 80% of topics. The annual per capita cost for group antenatal care was 0.50 USD. Qualitative analysis revealed the compromise of stable gestation-matched composition of the group members in order to make the intervention feasible. Major adaptations were made in training, documentation, feedback and logistics.

Conclusion

Group antenatal care provided in collaboration with local government clinics has the potential to provide accessible and high quality antenatal care to women in rural Nepal. The intervention is a feasible and affordable alternative to individual antenatal care. Our experience has shown that adaptation from prior models was important for the program to be successful in the local context within the national healthcare system.

Trial registration

ClinicalTrials.gov Identifier: NCT02330887, registered 01/05/2015, retroactively registered.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Mental Health

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Cancer Causes & Control

Abstract:

Purpose

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal Global Mental Health

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Method

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the journal Translational Behavioral Medicine

Authors:

✪ Open Access

Read the full text in the open access journal Psychiatric Services

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial Registration

Authors:

✪ Open Access

Read the full text in the open access journal Reproductive Health

Abstract:

Background

Methods

Results

Conclusion

Trial registration