Skip to content

✪ Team-focused implementation strategies to improve implementation of mental health screening and referral in rural Children’s Advocacy Centers: study protocol for a pilot cluster randomized hybrid type 2 trial

Authors:

Elizabeth A. McGuier, Gregory A. Aarons, Jaely D. Wright, John C. Fortney, Byron J. Powell, Scott D. Rothenberger, Laurie R. Weingart, Elizabeth Miller & David J. Kolko

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Children’s Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs’ capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings.

Methods

We will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers’ understanding of their child’s mental health needs and caregivers’ intentions to initiate mental health services (effectiveness aim).

Conclusions

Targeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

“Another tool in the toolkit”—Perceptions, suggestions, and concerns of emergency service providers about the implementation of a supervised consumption site

Authors:

David Perlmutter, Courteney Wettemann, Callan Elswick Fockele, Tessa Frohe, Will Williams, Nathan Holland, Thea Oliphant-Wells, Hendrika Meischke, & Jenna van Draanen

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: May 2023

Read the full text in the subscription access journal The International Journal on Drug Policy

✪ Integrating pragmatic and implementation science randomized clinical trial approaches: a PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) analysis

Authors:

Douglas Zatzick, Lawrence Palinkas, David A. Chambers, Lauren Whiteside, Kathleen Moloney, Allison Engstrom, Laura Prater, Joan Russo, Jin Wang, Khadija Abu, Matt Iles-Shih & Eileen Bulger

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Trials

Abstract:

Background

Over the past two decades, pragmatic and implementation science clinical trial research methods have advanced substantially. Pragmatic and implementation studies have natural areas of overlap, particularly relating to the goal of using clinical trial data to leverage health care system policy changes. Few investigations have addressed pragmatic and implementation science randomized trial methods development while also considering policy impact.

Methods

The investigation used the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) and PRECIS-2-Provider Strategies (PRECIS-2-PS) tools to evaluate the design of two multisite randomized clinical trials that targeted patient-level effectiveness outcomes, provider-level practice changes and health care system policy. Seven raters received PRECIS-2 training and applied the tools in the coding of the two trials. Descriptive statistics were produced for both trials, and PRECIS-2 wheel diagrams were constructed. Interrater agreement was assessed with the Intraclass Correlation (ICC) and Kappa statistics. The Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) qualitative approach was applied to understanding integrative themes derived from the PRECIS-2 ratings and an end-of-study policy summit.

Results

The ICCs for the composite ratings across the patient and provider-focused PRECIS-2 domains ranged from 0.77 to 0.87, and the Kappa values ranged from 0.25 to 0.37, reflecting overall fair-to-good interrater agreement for both trials. All four PRECIS-2 wheels were rated more pragmatic than explanatory, with composite mean and median scores ≥ 4. Across trials, the primary intent-to-treat analysis domain was consistently rated most pragmatic (mean = 5.0, SD = 0), while the follow-up/data collection domain was rated most explanatory (mean range = 3.14–3.43, SD range = 0.49–0.69). RAPICE field notes identified themes related to potential PRECIS-2 training improvements, as well as policy themes related to using trial data to inform US trauma care system practice change; the policy themes were not captured by the PRECIS-2 ratings.

Conclusions

The investigation documents that the PRECIS-2 and PRECIS-2-PS can be simultaneously used to feasibly and reliably characterize clinical trials with patient and provider-level targets. The integration of pragmatic and implementation science clinical trial research methods can be furthered by using common metrics such as the PRECIS-2 and PRECIS-2-PS. Future study could focus on clinical trial policy research methods development.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Adaptation of the collaborative care model to integrate behavioral health care into a low-barrier HIV clinic

Authors:

Julia C. Dombrowski, Scott Halliday, Judith I. Tsui, Deepa Rao, Kenneth Sherr, Meena S. Ramchandani, Ramona Emerson, Mark Fleming, Teagan Wood & Lydia Chwastiak

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

The collaborative care management (CoCM) model is an evidence-based intervention for integrating behavioral health care into nonpsychiatric settings. CoCM has been extensively studied in primary care clinics, but implementation in nonconventional clinics, such as those tailored to provide care for high-need, complex patients, has not been well described.

Method

We adapted CoCM for a low-barrier HIV clinic that provides walk-in medical care for a patient population with high levels of mental illness, substance use, and housing instability. The Exploration, Preparation, Implementation, and Sustainment model guided implementation activities and support through the phases of implementing CoCM. The Framework for Reporting Adaptations and Modifications to Evidence-Based Interventions guided our documentation of adaptations to process-of-care elements and structural elements of CoCM. We used a multicomponent strategy to implement the adapted CoCM model. In this article, we describe our experience through the first 6 months of implementation.

Results

The key contextual factors necessitating adaptation of the CoCM model were the clinic team structure, lack of scheduled appointments, high complexity of the patient population, and time constraints with competing priorities for patient care, all of which required substantial flexibility in the model. The process-of-care elements were adapted to improve the fit of the intervention with the context, but the core structural elements of CoCM were maintained.

Conclusions

The CoCM model can be adapted for a setting that requires more flexibility than the usual primary care clinic while maintaining the core elements of the intervention.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Twenty years of capacity building across the cancer prevention and control research network

Authors:

Mary Wangen, Cam Escoffery, Maria E. Fernandez, Daniela B. Friedman, Peggy Hannon, Linda K. Ko, Annette E. Maxwell, Courtney Petagna, Betsy Risendal, Catherine Rohweder & Jennifer Leeman

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Cancer Causes and Control

Abstract:

Purpose

To improve population health, community members need capacity (i.e., knowledge, skills, and tools) to select and implement evidence-based interventions (EBIs) to fit the needs of their local settings. Since 2002, the Centers for Disease Control and Prevention has funded the national Cancer Prevention and Control Research Network (CPCRN) to accelerate the implementation of cancer prevention and control EBIs in communities. The CPCRN has developed multiple strategies to build community members’ capacity to implement EBIs. This paper describes the history of CPCRN’s experience developing and lessons learned through the use of five capacity-building strategies: (1) mini-grant programs, (2) training, (3) online tools, (4) evidence academies, and (5) evaluation support for partners’ capacity-building initiatives.

Methods

We conducted a narrative review of peer-reviewed publications and grey literature reports on CPCRN capacity-building activities. Guided by the Interactive Systems Framework, we developed histories, case studies, and lessons learned for each strategy. Lessons were organized into themes.

Results

Three themes emerged: the importance of (1) community-engagement prior to and during implementation of capacity-building strategies, (2) establishing and sustaining partnerships, and (3) co-learning at the levels of centers, networks, and beyond.

Conclusion

CPCRN activities have increased the ability of community organizations to compete for external funds to support implementation, increased the use of evidence in real-world settings, and promoted the broad-scale implementation of cancer control interventions across more than eight states. Lessons from this narrative review highlight the value of long-term thematic networks and provide useful guidance to other research networks and future capacity-building efforts.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact

Authors:

Aaron Lyon, Sean A. Munson, Madhu Reddy, Stephen M. Schueller, Elena Agapie, Svetlana Yarosh, Alex Dopp, Ulrica von Thiele Schwarz, Gavin Doherty, Andrea K Graham, Kaylee Payne Kruzan & Rachel Kornfield

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: April 2023

Read the full text in the subscription access journal Extended Abstracts on Human Factors Computing Systems. CHI Conference

✪ A policy implementation study of earmarked taxes for mental health services: study protocol

Authors:

Jonathan Purtle, Nicole A. Stadnick, Megan Wynecoop, Eric J. Bruns, Margaret E. Crane, & Gregory Aarons

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Insufficient funding is frequently identified as a critical barrier to the implementation and sustainment of evidence-based practices (EBPs). Thus, increasing access to funding is recognized as an implementation strategy. Policies that create earmarked taxes—defined as taxes for which revenue can only be spent on specific activities—are an increasingly common mental health financing strategy that could improve the reach of EBPs. This project’s specific aims are to (1) identify all jurisdictions in the USA that have implemented earmarked taxes for mental health and catalogue information about tax design; (2) characterize experiences implementing earmarked taxes among local (e.g., county, city) mental health agency leaders and other government and community organization officials and assess their perceptions of the acceptability and feasibility of different types of policy implementation strategies; and (3) develop a framework to guide effect earmarked tax designs, inform the selection of implementation strategies, and disseminate the framework to policy audiences.

Methods

The project uses the Exploration, Preparation, Implementation, Sustainment (EPIS) framework to inform data collection about the determinants and processes of tax implementation and Leeman’s typology of implementation strategies to examine the acceptability and feasibility strategies which could support earmarked tax policy implementation. A legal mapping will be conducted to achieve aim 1. To achieve aim 2, a survey will be conducted of 300 local mental health agency leaders and other government and community organization officials involved with the implementation of earmarked taxes for mental health. The survey will be followed by approximately 50 interviews with these officials. To achieve aim 3, quantitative and qualitative data will be integrated through a systematic framework development and dissemination process.

Discussion

This exploratory policy implementation process study will build the evidence base for outer-context implementation determinants and strategies by focusing on policies that earmarked taxes for mental health services.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementing Mailed Colorectal Cancer Fecal Screening Tests in Real-World Primary Care Settings: Promising Implementation Practices and Opportunities for Improvement

Authors:

Sarah D. Hohl, Annette E. Maxwell, Krishna P. Sharma, Juzhong Sun, Thuy T. Vu, Amy DeGroff, Cam Escoffery, Dara Schlueter & Peggy A. Hannon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Prevention Science

Abstract:

Colorectal cancer (CRC) screening reduces morbidity and mortality, but screening rates in the USA remain suboptimal. The Colorectal Cancer Control Program (CRCCP) was established in 2009 to increase screening among groups disproportionately affected. The CRCCP utilizes implementation science to support health system change as a strategy to reduce disparities in CRC screening by directing resources to primary care clinics to implement evidence-based interventions (EBIs) proven to increase CRC screening. As COVID-19 continues to impede in-person healthcare visits and compel the unpredictable redirection of clinic priorities, understanding clinics’ adoption and implementation of EBIs into routine care is crucial. Mailed fecal testing is an evidence-based screening approach that offers an alternative to in-person screening tests and represents a promising approach to reduce CRC screening disparities. However, little is known about how mailed fecal testing is implemented in real-world settings. In this retrospective, cross-sectional analysis, we assessed practices around mailed fecal testing implementation in 185 clinics across 62 US health systems. We sought to (1) determine whether clinics that do and do not implement mailed fecal testing differ with respect to characteristics (e.g., type, location, and proportion of uninsured patients) and (2) identify implementation practices among clinics that offer mailed fecal testing. Our findings revealed that over half (58%) of clinics implemented mailed fecal testing. These clinics were more likely to have a CRC screening policy than clinics that did not implement mailed fecal testing (p = 0.007) and to serve a larger patient population (p = 0.004), but less likely to have a large proportion of uninsured patients (p = 0.01). Clinics that implemented mailed fecal testing offered it in combination with EBIs, including patient reminders (92%), provider reminders (94%), and other activities to reduce structural barriers (95%). However, fewer clinics reported having the leadership support (58%) or funding stability (29%) to sustain mailed fecal testing. Mailed fecal testing was widely implemented alongside other EBIs in primary care clinics participating in the CRCCP, but multiple opportunities for enhancing its implementation exist. These include increasing the proportion of community health centers/federally qualified health centers offering mailed screening; increasing the proportion that provide pre-paid return mail supplies with the screening kit; increasing the proportion of clinics monitoring both screening kit distribution and return; ensuring patients with abnormal tests can obtain colonoscopy; and increasing sustainability planning and support.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Optimizing naloxone distribution to prevent opioid overdose fatalities: results from piloting the Systems Analysis and Improvement Approach within syringe service programs

Authors:

Sheila V. Patel, Lynn D. Wenger, Alex H. Kral, Kenneth Sherr, Anjuli D. Wagner, Peter J. Davidson & Barrot H. Lambdin

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Opioid overdose fatalities are preventable with timely administration of naloxone, an opioid antagonist, during an opioid overdose event. Syringe service programs have pioneered naloxone distribution for potential bystanders of opioid overdose. The objective of this study was to pilot test a multi-component implementation strategy—the systems analysis and improvement approach for naloxone (SAIA-Naloxone)—with the goal of improving naloxone distribution by syringe service programs.

Methods

Two syringe service programs participated in a 6-month pilot of SAIA-Naloxone, which included (1) analyzing program data to identify gaps in the naloxone delivery cascade, (2) flow mapping to identify causes of attrition and brainstorm programmatic changes for improvement, and (3) conducting continuous quality improvement to test and assess whether modifications improve the cascade. We conducted an interrupted time series analysis using 52 weeks of data before and 26 weeks of data after initiating SAIA-Naloxone. Poisson regression was used to evaluate the association between SAIA-Naloxone and the weekly number of participants receiving naloxone and number of naloxone doses distributed.

Results

Over the course of the study, 11,107 doses of naloxone were distributed to 6,071 participants. Through SAIA-Naloxone, syringe service programs prioritized testing programmatic modifications to improve data collection procedures, proactively screen and identify naloxone-naïve participants, streamline naloxone refill systems, and allow for secondary naloxone distribution. SAIA-Naloxone was associated with statistically significant increases in the average number of people receiving naloxone per week (37% more SPP participants; 95% CI, 12% to 67%) and average number of naloxone doses distributed per week (105% more naloxone doses; 95% CI, 79% to 136%) beyond the underlying pre-SAIA-Naloxone levels. These initial increases were extended by ongoing positive changes over time (1.6% more SSP participants received naloxone and 0.3% more naloxone doses were distributed in each subsequent week compared to the weekly trend in the pre-SAIA Naloxone period).

Conclusions

SAIA-Naloxone has strong potential for improving naloxone distribution from syringe service programs. These findings are encouraging in the face of the worsening opioid overdose crisis in the United States and support testing SAIA-Naloxone in a large-scale randomized trial within syringe service programs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A sequential, multiple assignment randomized trial comparing web-based education to mobile video interpreter access for improving provider interpreter use in primary care clinics: the mVOCAL hybrid type 3 study protocol

Authors:

K. Casey Lion, Chuan Zhou, Paul Fishman, Kirsten Senturia, Allison Cole, Kenneth Sherr, Douglas J. Opel, James Stout, Carmen E. Hazim, Louise Warren, Bonnie H. Rains, & Cara C. Lewis.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Implementation Science

Abstract:

Background

Individuals who use a language other than English for medical care are at risk for disparities related to healthcare safety, patient-centered care, and quality. Professional interpreter use decreases these disparities but remains underutilized, despite widespread access and legal mandates. In this study, we compare two discrete implementation strategies for improving interpreter use: (1) enhanced education targeting intrapersonal barriers to use delivered in a scalable format (interactive web-based educational modules) and (2) a strategy targeting system barriers to use in which mobile video interpreting is enabled on providers’ own mobile devices.

Methods

We will conduct a type 3 hybrid implementation-effectiveness study in 3–5 primary care organizations, using a sequential multiple assignment randomized trial (SMART) design. Our primary implementation outcome is interpreter use, calculated by matching clinic visits to interpreter invoices. Our secondary effectiveness outcome is patient comprehension, determined by comparing patient-reported to provider-documented visit diagnosis. Enrolled providers (n = 55) will be randomized to mobile video interpreting or educational modules, plus standard interpreter access. After 9 months, providers with high interpreter use will continue as assigned; those with lower use will be randomized to continue as before or add the alternative strategy. After another 9 months, both strategies will be available to enrolled providers for 9 more months. Providers will complete 2 surveys (beginning and end) and 3 in-depth interviews (beginning, middle, and end) to understand barriers to interpreter use, based on the Theoretical Domains Framework. Patients who use a language other than English will be surveyed (n = 648) and interviewed (n = 75) following visits with enrolled providers to understand their experiences with communication. Visits will be video recorded (n = 100) to assess fidelity to assigned strategies. We will explore strategy mechanism activation to refine causal pathway models using a quantitative plus qualitative approach. We will also determine the incremental cost-effectiveness of each implementation strategy from a healthcare organization perspective, using administrative and provider survey data.

Discussion

Determining how these two scalable strategies, alone and in sequence, perform for improving interpreter use, the mechanisms by which they do so, and at what cost, will provide critical insights for addressing a persistent cause of healthcare disparities.

Trial registration

NCT05591586

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**