Skip to content

✪ Study protocol for testing the efficacy of the Helping Educational Leaders Mobilize Evidence (HELM) implementation strategy in elementary schools: a hybrid type 3 effectiveness-implementation randomized controlled trial

Authors:

Jill Locke, Nathaniel J. Williams, Aksheya Sridhar, Mark G. Ehrhart, Alex Dopp, Marissa Thirion, Christine Espeland, Brandon Riddle, Kelcey Schmitz, Kurt Hatch, Lindsey Buehler & Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

Schools need to implement universal student supports that prevent social, emotional, and behavioral difficulties; minimize associated risks; and promote social, emotional, and behavioral competencies. The purpose of this study is to examine the efficacy of the Helping Educational Leaders Mobilize Evidence (HELM) implementation strategy for promoting school-level implementation leadership, implementation climate, and high-fidelity delivery of an evidence-based practice. We will test HELM with an exemplar EBP, Positive Behavioral Interventions and Supports (PBIS). The specific aims of the study are to: 1) experimentally evaluate the effects of HELM versus PBIS training and technical assistance only (control condition); and 2) explore for whom, under what conditions, how equitably, and through which processes HELM works to improve outcomes, as well as its cost-effectiveness.

Methods

This study will use a hybrid type 3 effectiveness-implementation trial to provide a rigorous test of the effects of HELM in elementary schools. Schools will be randomly assigned to HELM + PBIS training and technical assistance (n = 21 schools; n = 210 educators) or PBIS training and technical assistance only (n = 21 schools; n = 210 educators) in a 1:1 ratio within cohorts using covariate constrained randomization that accounts for degree of prior PBIS exposure (measured using the Tiered Fidelity Inventory at baseline) and school size. A series of mixed effects models (time within educator, educator within school) will test within-subject/between-subject interactions across three timepoints (12 months total) to examine whether HELM will show steeper gains than the control on implementation leadership (primary outcome), implementation climate, PBIS fidelity, and student outcomes. Mediational analyses will test hypothesized mechanisms of change (i.e., implementation leadership and climate) of HELM on PBIS fidelity. Sequential mixed-methods data collection and analyses will further explore how organizational mechanisms are linked to implementation outcomes. Cost-effectiveness analyses will compare costs and outcomes of PBIS training and technical assistance only versus PBIS implementation with HELM.

Discussion

The nature of leadership support in schools can make the difference between successful and unsuccessful EBP implementation. Testing HELM within the context of PBIS implementation will provide rigorous evidence about whether and how HELM can equitably address important EBP and student outcomes.

Trial Registration

Clinical Trials ID: NCT06586723. Date of Registration: August 27, 2024. Prospectively registered. URL of Trial Registry Record: https://clinicaltrials.gov/study/NCT06586723?intr=helm&rank=1

Contributions to the Literature

  • Few effective strategies to enhance evidence-based practice implementation in schools address implementation leadership and climate, and those that do have only been evaluated qualitatively.
  • Schools have unique organizational characteristics, and it is important to test whether organizational implementation strategies developed in other contexts can be effective in improving implementation outcomes in schools.
  • This study will evaluate the effects of a tailored adaptation of the Leadership and Organizational Change for Implementation (LOCI) strategy for schools, entitled Helping Educational Leaders Mobilize Evidence (HELM), on implementation mechanisms (implementation leadership and implementation climate), PBIS fidelity, and student outcomes.
  • This study also will explore for whom, under what conditions, and how equitably HELM demonstrates its effects, providing critical information about influence on – and the limitations of – the impact of this organizational implementation strategy.
  • Finally, the study will evaluate the processes through which HELM works to improve outcomes, contributing to the emerging literature on implementation mechanisms, as well as its cost-effectiveness.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Name of the registry
clinicaltrials.gov.

Peer Review reports

✪ Lessons learnt from the 2021 Pacific Northwest heat dome: a qualitative study of western Washington’s healthcare community response

Authors:

Matias Korfmacher, Cat Hartwell, Kelly Hill, Nathaniel Matthews-Trigg, Jeremy Hess, Amruta Nori-Sarma, & Gregory Wellenius

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal BMJ Open

Abstract:

Objective

The 2021 Pacific Northwest heat dome was Washington state’s deadliest recorded weather event and presented unprecedented response challenges to the state’s health sector. Understanding the impacts of this extreme heat event (EHE) on the sector as well as the barriers to and facilitators of implementing effective heat response is critical to preparing for future events, which are happening more frequently in the region due to climate change.

Design

Guided by an implementation science framework, we convened listening sessions and focus groups of the health sector in western Washington to reflect on regional response efforts.

Setting

Health sector organisations in 15 counties in western Washington State, USA: Clallam, Grays Harbor, Island, Jefferson, King, Kitsap, Lewis, Mason, Pacific, Pierce, San Juan, Skagit, Snohomish, Thurston and Whatcom.

Participants

A convenience sample of 109 listening group participants was recruited through the professional networks of the Northwest Healthcare Response Network, a regional healthcare coalition. 27 of the health sector professionals were recruited using purposive sampling to participate in seven focus groups organised by organisation type.

Results

The co-presence of the COVID-19 pandemic, limited staff capacity, resource acquisition challenges and inadequate regional collaboration emerged as key barriers, while advanced planning, indoor cooling capabilities, adapting strategies to local needs, robust internal relationships and strong external partnerships were reported to facilitate effective response. Establishing centralised coordination ahead of heat events, making improvements to the cooling capabilities of the built environment, developing plans and policies for EHEs that have co-benefits for other events, adopting evidence-informed response strategies, institutionalising the knowledge and relationships developed through prior events and improving evaluative processes (such as developing real-time monitoring capacity) will enable more effective response to future EHEs.

Conclusions

Western Washington’s health sector implemented EHE response activities that enabled essential service continuity, despite limited resources, unfamiliarity with EHEs and other systemic challenges. The recency of the heat dome presents an opportunity to incorporate lessons learnt into practice, policies, plans and built environment; these are necessary improvements ahead of future large-scale events the region may experience in the coming decades.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Developing Implementation Science Capacity Within Health Departments Located in Ending the HIV Epidemic Priority Areas

Authors:

Christine M Khosropour, Arianna Rubin Means, Roxanne P Kerani, Emma M Murphy, Krupa Mehta, Kristina Santana, Kenneth Sherr, & Matthew R Golden.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text open access in the journal JAIDS: Journal of Acquired Immune Deficiency Syndrome

✪ Mechanism-Based Middle-Range Theories: Using Realist Syntheses to Reconcile Specificity to Context and Generalizability

Authors:

Ferdinand C. Mukumbang and Geoff Wong

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2025

Read the full text in the open access journal Qualitative Health Research

Abstract:

Realist synthesis is a recognized methodological approach to evidence synthesis to inform evidence-based health policy and practice. The implicit assumption behind research synthesis is that the evidence it generates should be generalizable––drawing broad inferences from specific observations. While this understanding is generally shared among social scientists, tensions exist between having generalizable evidence and how this evidence can be useful in specific contexts. This paper considers the role of mechanism-based middle-range theories obtained from realist synthesis in bridging specificity to context and generalizability. Retroductive theorizing in realist synthesis helps to identify ideas about mechanisms related to the phenomenon embedded in the social and organizational contexts that could, in principle, have a much broader application. Also, because mechanism-based middle-range theories are linked to contextual features, they capture contextual nuances to enhance evidence implementation. We conclude that middle-range mechanisms provide an opportunity to achieve generalizability and contextualization in implementation science.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Perspectives on Implementing a Communication Facilitator Intervention From a Critical Care Setting

Authors:

Jennifer Im, Erin Blakeney, Danae Dotolo, Anna Ungar, Rebecca Barton, Bryan J Weiner, Kathryn I Pollak, Elizabeth Nielsen, Lisa Hudson, Nancy Kentish-Barnes, Claire Creutzfeldt, Ruth A Engelberg, J Randall Curtis

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access Journal of Pain and Symptom Management

✪ Usability of a cross-system housing stability program for juvenile courts: A multimethod study of probation counselor perspectives

Authors:

Asia S. Bishop, Sarah C. Walker, Ella B. Baumgarten, Kristin Vick, & Taquesha Dean

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2025

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Youth in contact with the juvenile legal system experience disproportionate rates of homelessness. While system contact is a critical intervening point, juvenile courts do not typically offer housing services. One solution is to refer youth to evidence-based, community-based services to meet housing-related needs, but a myriad of individual and organizational factors often impede court staff from making such referrals. Housing Stability for Youth in Courts (HSYNC) is a novel, cross-system service linkage model for court-involved youth facing housing instability. HSYNC was developed using codesign as a strategy to improve usability and incorporated evidence on juvenile court linkage strategies effective at increasing service referrals and improving outcomes.

Method

The current study utilized a multimethod approach to evaluate the usability of HSYNC from the perspective of juvenile probation counselors (JPCs) as one group of end-users. As part of the pilot implementation study, survey (N = 15) and semi-structured interview (N = 20) data were obtained from JPCs from four juvenile courts in one northwestern state.

Results

Survey results indicated good usability for HSYNC (mean implementation strategy usability scale score of 80). Themes from the interviews complemented survey findings, pointing to HSYNC as a value-added program that integrated well with existing probation practices. The housing navigator's approach was highlighted as a strong facilitator of program usability. Themes also provided greater insight into implementation barriers (i.e., individual and contextual factors) and areas for improvement (e.g., eligibility screening process).

Conclusions

Drivers of program usability and implications for program improvement to address identified implementation challenges to ensure the HSYNC model is effective and sustainable long-term are discussed.

Plain Language Summary

A study examining the key factors impacting successful implementation of a novel housing stability program to address homelessness risk for court-involved youth and their families.
Court-involved youth experience disproportionate rates of homelessness, yet housing services are not traditionally offered by juvenile courts. Court staff, such as probation staff, can refer youth to community-based services to meet their housing needs. Unfortunately, many factors complicate whether these referrals are made, including staff feeling overburdened by other work obligations and uncertainty about whether referring youth to community services fits within their job responsibilities. In this study, we surveyed and interviewed probation staff who were responsible for implementing a new referral-based housing stability program—Housing Stability for Youth in Courts (HSYNC)—to understand whether the program addressed previously identified barriers to referral-making. A unique feature of HSYNC is that there is a dedicated housing navigator, who works as a “linkage specialist” to support probation staff in making referrals while working directly with youth and families to access housing-related services in the community. Our findings suggest that, from the perspective of probation staff, HSYNC is considered to be a user-friendly program that is well-aligned with existing court practices. The housing navigator and their unique approach to working with probation staff, youth, and families was perceived as the strongest facilitator of implementation success; meanwhile, screening for program eligibility was the biggest barrier, pointing to the need for improvement before HSYNC is widely implemented. The persistent intersection of youth housing instability and court involvement calls for better coordination between juvenile courts and community agencies providing housing-related services. From the probation perspective, HSYNC offers a viable solution to meeting youths’ housing needs without creating additional workload burden for court staff.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

The difference-making role of staff support in implementing nurse care management for opioid use disorder treatment: A configurational analysis

Authors:

Theresa E Matson, Amy K Lee, Edward J Miech, Paige D Wartko, Rebecca C Phillps, Mary Shea, Andrea Altschuler, Aimee N C Campbell, Colleen T Labelle, Julia H Arnsten, Jordan M Braciszewski, Joseph E Glass, Viviana E Horigian, Mark T Murphy, Mohammad Zare-Mehrjerdi, and Katharine A Bradley

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access Journal of Substance Use and Addiction Treatment

Feasibility of Using Patient Navigation to Improve Identification of Hereditary Cancer Syndromes in Newly Diagnosed Colorectal Cancer Patients

Authors:

Emma Sears, Jacky Dahlquist, Sarah Stayman, Cynthia Ko, Eric Q. Konnick, Allison Cole, Ying Zhang, Marlana Kohn, Vida Henderson, and Sarah Knerr

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access journal Genetics in Medicine

✪ How integrated knowledge translation worked to reduce federal policy barriers to the implementation of medication abortion in Canada: a realist evaluation

Authors:

Sarah Munro, Kate Wahl, Sheila Dunn, Courtney Devane, Linda C. Li, & Wendy V. Norman

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2025

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Initial Canadian federal regulations for the abortion pill, mifepristone, had the potential to impede safe and equitable access to this medication. To catalyze evidence-based regulatory change, we engaged health policy, health system, and health services decision makers, and health professional organizations in integrated knowledge translation (iKT), a research approach that engages the users of research as equal partners.

Methods

We conducted a realist evaluation of what iKT strategies worked, for whom, and in what context to impact federal mifepristone regulations. We constructed initial program theories (if–then statements about how iKT worked). We tested the initial program theories using interviews with researchers and knowledge partners and triangulated with analysis of research programme documents. We configured the evidence in relation to the initial program theories, and refined program theories into causal explanatory configurations.

Results

We analyzed 38 interviews with researchers, health professional leaders, advocacy group leaders, and administrative government policy makers, as well as 49 program documents. Our results indicated that researcher partnerships with stakeholders had a meaningful impact on the removal of restrictions. We found key components of the causal explanatory configurations included: researcher motivation to move evidence into action, trusted reputations as credible sources of evidence, strategic partnerships, understanding of health policy processes, and researcher roles as a trusted convenor between key groups and decision makers.

Conclusions

Our study identifies several practical and transferable approaches to impactful iKT. The findings may be of relevance to researchers focused on public health topics subject to stigma.

Contributions to the literature
  • The effect of integrated knowledge translation (iKT) on public health policy is ambiguous, especially for issues that may be stigmatized, like abortion.
  • To bridge this knowledge gap, we evaluated the iKT used to support Canadian federal drug regulatory decisions to remove restrictions for the medication abortion pill, mifepristone.
  • Our realist evaluation identified several practical and transferable approaches to impactful iKT in complex policy systems that comprise an ‘iKT mindset’.
  • Key approaches for researchers include acting on motivations to move evidence into policy, building trusted reputations as credible sources of evidence, understanding and targeting policy levers, acting as a source of strategic evidence, and acting as a trusted convenor between key groups and decision makers.
  • Our use of realist methodology contributes to theoretical and empirical understandings of iKT with policy makers and has relevance for other stigmatized topics including opioid safe supply, vaccination, and climate change.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Pilot Testing a Digital Transdiagnostic Mental Health Intervention for Use Among Immigrant and Refugee Youth in the USA: A Mixed Methods Evaluation of Clinical and Implementation Outcomes

Authors:

Katrin E. Fabian, Morgan Turner, Katherine T. Foster, Lydia Chwastiak & Bradley H. Wagenaar

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access Journal of Technology in Behavioral Science