Skip to content

✪ Helping Educational Leaders Mobilize Evidence (HELM): The iterative redesign of the Leadership and Organizational Change for Implementation (LOCI) intervention for use in schools

Authors:

Jill Locke, Cathy M. Corbin, Vaughan K. Collins, Mark G. Ehrhart, Roger Goosey, Kurt Hatch, Christine Espeland, Clayton R. Cook, and Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2024

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Few “intervention agnostic” strategies have been developed that can be applied to the broad array of evidence-based practices (EBPs) in schools. This paper describes two studies that reflect the initial iterative redesign phases of an effective leadership-focused implementation strategy—Leadership and Organizational Change for Implementation (LOCI)—to ensure its acceptability, feasibility, contextual appropriateness, and usability when used in elementary schools. Our redesigned strategy—Helping Educational Leaders Mobilize Evidence (HELM)—is designed to improve principals’ use of strategic implementation leadership to support the adoption and high-fidelity delivery of a universal EBP to improve student outcomes.

Method

In Study 1, focus groups were conducted (n = 6) with 54 district administrators, principals, and teachers. Stakeholders provided input on the appropriateness of original LOCI components to maximize relevance and utility in schools. Transcripts were coded using conventional content analysis. Key themes referencing low appropriateness were summarized to inform LOCI adaptations. We then held a National Expert Summit (Study 2) with 15 research and practice experts. Participants provided feedback via a nominal group process (NGP; n = 6 groups) and hackathon (n = 4 groups). The research team rated each NGP suggestion for how actionable, impactful/effective, and feasible it was. We also coded hackathon notes for novel ideas or alignment with LOCI components.

Results

Study 1 suggestions included modifications to LOCI content and delivery. Study 2's NGP results revealed most recommendations to be actionable, impactful/effective, and feasible. Hackathon results surfaced two novel ideas (distributed leadership teams and leaders’ knowledge to support educators EBP use) and several areas of alignment with LOCI components.

Conclusion

Use of these iterative methods informed the redesign of LOCI and the development of HELM. Because it was collaboratively constructed, HELM has the potential to be an effective implementation strategy to support the use of universal EBP in schools.

Plain Language Summary

Our research team designed a strategy (HELM) for school principals to improve the support they provide to staff to implement practices proven to work in research for improving student outcomes. We designed HELM by conducting focus groups with school district administrators, principals, and teachers. Participants were asked for their feedback on how to adapt an existing leadership strategy (LOCI) to the school context. After collecting this feedback, we held a meeting with 15 research and practice experts. During this meeting, the group of experts reviewed the focus group feedback and decided how to incorporate it into the design of the HELM strategy. We believe that collecting this feedback and involving research and practice experts in interpreting and integrating participant feedback into the HELM strategy will make HELM a more effective strategy for supporting school principals’ in implementing supports in their schools.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Scaling-up and scaling-out the Systems Analysis and Improvement Approach to optimize the hypertension diagnosis and care cascade for HIV infected individuals (SCALE SAIA-HTN): a stepped-wedge cluster randomized trial

Authors:

Carmen E. Hazim , Igor Dobe, Stephen Pope, Kristjana H. Ásbjörnsdóttir, Orvalho Augusto, Fernando Pereira Bruno, Sergio Chicumbe, Norberto Lumbandali, Inocêncio Mate, Elso Ofumhan, Sam Patel, Riaze Rafik, Kenneth Sherr, Veronica Tonwe, Onei Uetela, David Watkins, Sarah Gimbel, & Ana O. Mocumbi

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2024

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Undiagnosed and untreated hypertension is a main driver of cardiovascular disease and disproportionately affects persons living with HIV (PLHIV) in low- and middle-income countries. Across sub-Saharan Africa, guideline application to screen and manage hypertension among PLHIV is inconsistent due to poor service readiness, low health worker motivation, and limited integration of hypertension screening and management within HIV care services. In Mozambique, where the adult HIV prevalence is over 13%, an estimated 39% of adults have hypertension. As the only scaled chronic care service in the county, the HIV treatment platform presents an opportunity to standardize and scale hypertension care services.
Low-cost, multi-component systems-level strategies such as the Systems Analysis and Improvement Approach (SAIA) have been found effective at integrating hypertension and HIV services to improve the effectiveness of hypertension care delivery for PLHIV, reduce drop-offs in care, and improve service quality. To build off lessons learned from a recently completed cluster randomized trial (SAIA-HTN) and establish a robust evidence base on the effectiveness of SAIA at scale, we evaluated a scaled-delivery model of SAIA (SCALE SAIA-HTN) using existing district health management structures to facilitate SAIA across six districts of Maputo Province, Mozambique.

Methods

This study employs a stepped-wedge design with randomization at the district level. The SAIA strategy will be “scaled up” with delivery by district health supervisors (rather than research staff) and will be “scaled out” via expansion to Southern Mozambique, to 18 facilities across six districts in Maputo Province. SCALE SAIA-HTN will be introduced over three, 9-month waves of intensive intervention, where technical support will be provided to facilities and district managers by study team members from the Mozambican National Institute of Health. Our evaluation of SCALE SAIA-HTN will be guided by the RE-AIM framework and will seek to estimate the budget impact from the payer’s perspective.

Discussion

SAIA packages user-friendly systems engineering tools to support decision-making by frontline health workers and to identify low-cost, contextually relevant improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial will determine an effective strategy for national scale-up and inform program planning.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Centering School Leaders’ Expertise: Usability Evaluation of a Leadership-Focused Implementation Strategy to Support Tier 1 Programs in Schools

Authors:

Vaughan K. Collins, Catherine M. Corbin, Jill J. Locke, Clayton R. Cook, Mark G. Ehrhart, Kurt D. Hatch & Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2024

Read the full text open access in the journal School Mental Health

Abstract:

Although there are a growing number of implementation strategies to increase the adoption, fidelity, and sustainment of evidence-based practices (EBP), they are often complex and bulky, which can interfere with their widespread application. To address these challenges, the Helping Educational Leaders Mobilize Evidence (HELM) strategy was created as an adaptation of the evidence-based Leadership and Organizational Change for Implementation (LOCI) implementation strategy to enhance elementary school principals’ use of strategic implementation leadership to support the adoption and delivery of Tier 1 (i.e., universal social, emotional, and behavioral) EBP. In service of its iterative development, a human-centered design methodology was employed to increase the successful uptake and use of HELM. The Cognitive Walkthrough for Implementation Strategies (CWIS), a novel mixed-methods approach to evaluate implementation strategy usability, was applied to identify and test HELM strategy tasks of critical importance. A sample of 15 elementary school principals participated in group cognitive walkthrough testing as either school principal recipients or HELM coaches. Both user types rated the strategy as acceptable (principal M = 77.8, SD = 15.5; coach M = 87.5, SD = 7.9). Five usability issues were identified using a highly structured common usability issue framework and provided direction for the generation of redesign solutions to be incorporated in a subsequent version of the HELM strategy. The evaluation of the strategy’s usability improved its alignment with user needs, expectations, and contextual constraints, rendering a more usable strategy and broadly applicable information surrounding the development of psychosocial implementation strategies in real-world settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ The Effect of Stigma on Family Planning and HIV Pre-exposure Prophylaxis Decisions of Young Women Accessing Post-Abortion Care in Kenya

Authors:

Yasaman Zia, Lydia Etyang, Margaret Mwangi, Roy Njiru, Felix Mogaka, Lavender June, Irene Njeru, Job Makoyo, Susan Kimani, Kenneth Ngure, Inviolata Wanyama, Elizabeth Bukusi, Bernard Nyerere, Cyprian Nyamwaro, Nelly Mugo, Renee Heffron & PrEDIRA team

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2024

Read the full text in the open access journal AIDS and Behavior

Abstract:

Adolescent girls and young women (AGYW) in Eastern and Southern Africa face parallel epidemics of unintended pregnancy and HIV. Their sexual health decisions are often dominated by intersecting stigmas. In an implementation science project integrating delivery of daily, oral pre-exposure prophylaxis (PrEP) for HIV prevention into 14 post-abortion care (PAC) clinics in Kenya, we enrolled a subset of PrEP initiating AGYW (aged 15 to 30 years) into a research cohort. Utilizing log binomial models, we estimated the effect of PrEP stigma on PrEP continuation (measured via self-report and urine assay for tenofovir) and abortion stigma on contraceptive initiation. Between April 2022 and February 2023, 401 AGYW were enrolled after initiating PrEP through their PAC provider, of which 120 (29.9%) initiated highly-effective contraception. Overall, abortion and PrEP stigmas were high in this cohort. Abortion stigma was more prevalent among those that were adolescents, unmarried, and reported social harm. Among 114 AGYW returning for the month 1 follow-up visit, 83.5% reported continuing PrEP and 52.5% had tenofovir detected. In this subset, higher levels of PrEP stigma were significantly associated with greater likelihood of PrEP adherence, but not PrEP continuation. For abortion stigma, greater scores in the subdomain of isolation were significantly associated with greater likelihood of initiating a highly-effective contraception, while greater scores in the subdomain of community condemnation were significantly associated with reduced likelihood of initiating a highly-effective contraception. Given the burden of stigma documented by our work, PAC settings are a pivotal space to integrate stigma-informed counseling and to empower young women to optimize contraceptive and PrEP decisions.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Organize and mobilize for implementation effectiveness to improve overdose education and naloxone distribution from syringe services programs: A randomized controlled trial

Authors:

Barrot H. Lambdin, Ricky N. Bluthenthal, Bryan R. Garner, Lynn D. Wenger, Erica N. Browne, Terry Morris, Lee Ongais, Cariné E. Megerian & Alex H. Kral

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal Implementation Science

Abstract:

Background

The United States (US) continues to face decades-long increases in opioid overdose fatalities. As an opioid overdose reversal medication, naloxone can dramatically reduce opioid overdose mortality rates when distributed to people likely to experience or witness an opioid overdose and packaged with education on its use, known as overdose education and naloxone distribution (OEND). Syringe services programs (SSPs) are ideal venues for OEND with staff who are culturally competent in providing services for people who are at risk of experiencing or observing an opioid overdose. We carried out a randomized controlled trial of SSPs to understand the effectiveness of the organize and mobilize for implementation effectiveness (OMIE) approach at improving OEND implementation effectiveness within SSPs

Methods

Using simple randomization, 105 SSPs were enrolled into the trial and assigned to one of two study arms — (1) dissemination of OEND best practice recommendations (Control SSPs) or the OMIE approach along with dissemination of the OEND best practice recommendations (i.e., OMIE SSPs). OMIE SSPs could participate in 60-min OMIE sessions once a month for up to 12 months. At 12-month post-baseline, 102 of 105 SSPs (97%) responded to the follow-up survey.

Results

The median number of sessions completed by OMIE SSPs was 10. Comparing OMIE SSPs to control SSPs, we observed significant increases in the number of participants receiving naloxone (incidence rate ratio: 2.15; 95% CI: 1.42, 3.25; p < 0.01) and the rate of naloxone doses distributed per SSP participant (adjusted incidence rate ratio: 1.97; 95% CI: 1.18, 3.30; p = 0.01). We observed no statistically significant difference in the number of adopted best practices between conditions (difference in means 0.2, 95% CI: − 0.7, 1.0; p = 0.68). We also observed a threshold effect where SSPs receiving a higher OMIE dose had greater effect sizes with regard to the number of people given naloxone and the number of naloxone doses distributed.

Conclusions

In conclusion, the multifaceted OMIE approach was effective at increasing naloxone distribution from SSPs, despite substantial external shocks during the trial. These findings have major implications for addressing the overdose crisis, which has continued unabated for decades.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Drivers of success: improving implementation research tools for better health outcomes

Authors:

Quinhas Fernandes, Orvalho Augusto & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Pediatrics

Abstract:

A thorough examination of context, and how it influences implementation of evidence-based interventions, is a promising strategy for enhancing child survival initiatives. Spreading approaches that are identified as drivers of successful reduction in under-five mortality from ‘exemplar’ countries could be pivotal in leading to reductions in other settings facing stagnant mortality rates, in particular for low- and middle-income countries with high disease burden and insufficient programmatic capacity to effectively implement evidence-based interventions at scale. Yet there remains a lack of robust analytic methods to accurately assess mortality and describe the drivers of interventions’ implementation success at both national and subnational levels. The field of implementation science and its defining targets and tools is well positioned to address this knowledge gap by integrating qualitative and quantitative research methods into an adaptable evaluation framework that can be tailored to meet the specific needs across varying country contexts. These tools enhance the measurement of population health outcomes and provide crucial evidence on implementation barriers and facilitators that can inform policies that can be adjusted for diverse contexts. This commentary aims to emphasize the role of implementation research in understanding how exemplar countries achieved significant improvements in child survival and in identifying replicable lessons for other settings. Ultimately, all manuscripts underscore the relevance of implementation research in bolstering the reduction of under-five mortality.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Adaptation of a Tailored Lung Cancer Screening Decision Aid for People With HIV

Authors:

Meagan C. Brown, Madison Snidarich, Jehan Z. Budak, Nicholas Murphy, Nicholas Giustini, Perrin E. Romine, Bryan J. Weiner, Tanner Caverly, Kristina Crothers, and Matthew Triplette.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal CHEST Pulmonary

Abstract:

Background

People with HIV are both at elevated risk of lung cancer and at high risk of multimorbidity, which makes shared decision-making (SDM) for lung cancer screening (LCS) in people with HIV complex. Currently no known tools have been adapted for SDM in people with HIV.

Research Question

Can an SDM decision aid be adapted to include HIV-specific measures with input from both people with HIV and their providers?

Study Design and Methods

This study used qualitative methods including focus groups of people with HIV and interviews with HIV care providers to adapt and iterate an SDM tool for people with HIV. Eligible participants were those with HIV enrolled in an HIV primary care clinic who met age and smoking eligibility criteria for LCS and HIV care providers at the clinic. Both the focus groups and interviews included semistructured discussions of SDM and decision aid elements for people with HIV. We used a framework-guided thematic analysis, mapping themes onto the Health Equity Implementation framework.

Results

Forty-three people with HIV participated in eight focus groups; 10 providers were interviewed. Key themes from patients included broad interest in adapting LCS SDM specifically for people with HIV, a preference for clear LCS recommendations, and the need for positive framing emphasizing survival. Providers were enthusiastic about personalized LCS risk assessments and point-of-care tools. Both patients and providers gave mixed views on the usefulness of HIV-specific risk measures in patient-facing tools. Themes were used to adapt a personalized and flexible SDM tool for LCS in people with HIV.

Interpretation

People with HIV and providers were enthusiastic about specific tools for SDM that are personalized and tailored for people with HIV, that make recommendations, and that inform LCS decision-making. Divergent views on presenting patient-facing quantitative risk assessments suggests that these elements could be optional but available for review. This tool may have usefulness in complex decision-making for LCS in this population and currently is being evaluated in a pilot prospective trial.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation outcomes of the integrated district evidence to action (IDEAs) program to reduce neonatal mortality in central Mozambique: an application of the RE-AIM evaluation framework

Authors:

Aneth Dinis, Quinhas Fernandes, Bradley H Wagenaar, Sarah Gimbel, Bryan J Weiner, Grace John-Stewart, Ermyas Birru, Stephen Gloyd, Ruth Etzioni, Dorlim Uetela, Isaías Ramiro, Artur Gremu, Orvalho Augusto, Stélio Tembe, Jaime L Mário, Jalilo E Chinai, Alfredo F Covele, Cassimo M Sáide, Nélia Manaca & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Scarce evidence exists on audit and feedback implementation processes in low-resource health systems. The Integrated District Evidence to Action (IDEAs) is a multi-component audit and feedback strategy designed to improve the implementation of maternal and child guidelines in Mozambique. We report IDEAs implementation outcomes.

Methods

IDEAs was implemented in 154 health facilities across 12 districts in Manica and Sofala provinces between 2016 and 2020 and evaluated using a quasi-experimental design guided by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Reach is the proportion of pregnant women attending IDEAs facilities. Adoption is the proportion of facilities initiating audit and feedback meetings. Implementation is the fidelity to the strategy components, including readiness assessments, meetings (frequency, participation, action plan development), and targeted financial support and supervision. Maintenance is the sustainment at 12, 24, and 54 months.

Results

Across both provinces, 56% of facilities were exposed to IDEAs (target 57%). Sixty-nine and 73% of pregnant women attended those facilities’ first and fourth antenatal consultations (target 70%). All facilities adopted the intervention. 99% of the expected meetings occurred with an average interval of 5.9 out of 6 months. Participation of maternal and child managers was high, with 3076 attending meetings, of which 64% were from the facility, 29% from the district, and 7% from the province level. 97% of expected action plans were created, and 41 specific problems were identified. “Weak diagnosis or management of obstetric complications” was identified as the main problem, and “actions to reinforce norms and protocols” was the dominant subcategory of micro-interventions selected. Fidelity to semiannual readiness assessments was low (52% of expected facilities), and in completing micro-interventions (17% were completed). Ninety-six and 95% of facilities sustained the intervention at 12 and 24 months, respectively, and 71% had completed nine cycles at 54 months.

Conclusion

Maternal and child managers can lead audit and feedback processes in primary health care in Mozambique with high reach, adoption, and maintenance. The IDEAs strategy should be adapted to promote higher fidelity around implementing action plans and conducting readiness assessments. Adding effectiveness to these findings will help to inform strategy scale-up.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Acceptability and Utility of a Digital Group Intervention to Prevent Perinatal Depression in Youths via Interactive Maternal Group for Information and Emotional Support (IMAGINE): Pilot Cohort Study

Authors:

Keshet Ronen, Anupa Gewali, Kristin Dachelet, Erica White, Marimirca Jean-Baptiste, Yolanda N Evans, Jennifer A Unger, S. Darius Tandon, Amritha Bhat

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2024

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Perinatal depression (depression during pregnancy or the first year postpartum) affects 10%-25% of perinatal individuals, with a higher risk among youths aged <25 years. The Mothers and Babies Course (MB) is an evidence-based intervention for the prevention of perinatal depression, grounded in cognitive behavioral therapy, attachment theory, and psychoeducation.

Objective

We developed a digital adaptation of MB (Interactive Maternal Group for Information and Emotional Support [IMAGINE]) and evaluated it in a pre-post mixed methods pilot among young perinatal people in the United States

Methods

IMAGINE was a structured digital group of up to 7 participants, with scheduled MB content and open discussion for 12 weeks, facilitated by a social worker. Scheduled content included asynchronous SMS text messages, graphics, prerecorded videos, mood polls, and optional weekly synchronous video calls. Eligible participants were pregnant or ≤80 days postpartum, aged 16 to 24 years, had access to a smartphone, spoke English, and had a Patient Health Questionnaire score <10. Participants were recruited throughout the United States from August 2020 to January 2021 through paid social media ads, in-person outreach at clinics, and respondent-driven sampling. Participants completed quantitative questionnaires at enrollment and 3 months, and qualitative interviews at 3 months. We determined uptake, acceptability (by Acceptability of Intervention Measure score), and utility (by use of cognitive behavioral therapy skills). We compared depression symptoms (by Patient Health Questionnaire score), social support (by abbreviated Social Support Behavior score), and perceived stress (by Perceived Stress Score) between enrollment and follow-up by paired 2-tailed t test.

Results

Among 68 individuals who contacted this study, 22 were screened, 13 were eligible, and 10 enrolled, for an uptake of 76.9%. Furthermore, 4 (40%) participants were pregnant at enrollment. Participants had a median age of 17.9 (IQR 17.4-21.7) years, 6 (67%) identified as Black, 5 (56%) Latinx, and 6 (67%) using Medicaid health insurance. Further, 9 (90%) participants completed follow-up. Among these, the mean acceptability score was 4.3 out of 5 (SD 0.6) and all participants said they would recommend IMAGINE to a friend. Participants reported using a median of 7 of 11 skills (IQR 5-7 skills) at least half the days. We found no significant changes in depression symptoms, perceived stress, or social support. Qualitatively, participants reported one-to-one support from the facilitator, connection with other parents, and regular mood reflection were especially helpful aspects of the intervention. Additionally, participants reported that the intervention normalized their mental health challenges, improved their ability to manage their mood, and increased their openness to mental health care.

Conclusions

This pilot study provides promising evidence of the acceptability and utility of IMAGINE among perinatal youths. Our study’s small sample size did not detect changes in clinical outcomes; our findings suggest IMAGINE warrants larger-scale evaluation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Participatory development of a target policy profile to support soil-transmitted helminth elimination

Authors:

Arianna Rubin Means, Kellie List, Amy Roll, Marie-Claire Gwayi-Chore, Shawn Dolley, Holger J. Schünemann, Thea C. Norman and Judd L. Walson

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2024

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Soil-transmitted helminths (STH) are parasitic worms that infect nearly a quarter of the world's population, particularly those living in communities without access to adequate water, sanitation, and housing. Emerging evidence suggests that it may be possible to interrupt transmission of STH by deworming individuals of all ages via community-wide MDA (cMDA), as opposed to only treating children and other focal populations. Transitioning from a policy of STH control to STH elimination in targeted areas would require a fundamental shift in STH policy and programming. This policy change would require updated guidance to support countries as they adapt their current approaches for STH surveillance, supply chain management, community mobilization, and core programmatic activities in pursuit of STH elimination. There is an opportunity to engage with key stakeholders, such as program implementers and implementation partners, to understand what evidence they need to confidently adopt a new policy guideline and to deliver guideline adherent management at scale.

Methods

We aimed to engage with STH stakeholders to develop a Target Policy Profile (TPoP), a single document that describes optimal characteristics and evidence requirements that STH stakeholders prioritized in future potential STH transmission interruption efforts. Steps in TPoP development included a scoping review and key informant interviews (KIIs), which were used to design a two-stage Delphi technique to identify and verify TPoP components.

Results

The scoping review resulted in 25 articles, and 8 experts participated in KII's. Twenty respondents completed the first Delphi survey and 10 respondents completed the second. This systematic effort resulted in a net of 3 key information domains (background/context, clinical considerations, and implementation considerations) encompassing 24 evidence categories (examples include evidence regarding safety and adverse events, implementation feasibility, or evidence dissemination). For each evidence category, STH stakeholders reviewed, endorsed, or revised a range of options for how the evidence could be presented.

Discussion

This information can be used by guideline committees or global policy makers prior to convening guideline advisory groups. The TPoP tool may also speed the process of stakeholder consensus building around guidelines, accelerating progress towards implementing evidence-based policy at scale.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**