Skip to content
Implementation Science at UW

Keywords: Assessment

✪ Not getting better but not getting worse: A cluster randomized controlled pilot trial of a leadership implementation strategy

Authors:

Jill Locke, Catherine M. Corbin, Roger Goosey, Vaughan K. Collins, Mark G. Ehrhart, Kurt Hatch, Christine Espeland, and Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2025

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Implementation of evidence-based practices (EBPs) in schools is fraught with challenges. Even when EBPs are initiated, deterioration of implementation efforts often hinders their long-term success. School leadership behaviors can influence teachers’ EBP implementation. Our study tested an implementation strategy called Helping Educational Leaders Mobilize Evidence (HELM), adapted from the Leadership and Organizational Change for Implementation strategy, to enhance EBP implementation through improvements in school leadership teams’ implementation leadership and climate to buffer against the deterioration of implementation efforts. This study explores the impact of HELM on theorized mechanisms of change (i.e., implementation leadership, climate), educator-level factors (i.e., implementation citizenship), and implementation outcomes (i.e., fidelity, initiative stability).

Method

One school district and 10 schools in Washington participated. Five of the schools were randomized to receive the HELM strategy and the remaining five schools received an alternative leadership training as an implementation attention control. Teachers at every school (n = 341) received training for an EBP called Positive Greetings at the Door that has been previously demonstrated to reduce student behavior problems. Principals and Assistant Principals (n = 18) received the HELM strategy or alternative leadership training. Three district Administrators also participated in HELM as part of the Organizational Strategy Development meetings.

Results

HELM significantly slowed the average decline of implementation leadership (perseverant leadership and communication), three dimensions of implementation climate (recognition, rewards, and existing supports) and total implementation climate, and one dimension of implementation citizenship (keeping informed). No significant effects were found with regard to implementation outcomes (i.e., fidelity, initiative stability).

Conclusions

HELM shows promise in buffering the deterioration of EBP implementation efforts in schools. HELM positively influenced implementation leadership and climate, which are the hypothesized mechanisms for promoting successful long-term implementation efforts. An appropriately powered trial is needed to determine the efficacy of HELM in the future.

Trial Registration Information

Name of the registry: clinicaltrials.gov
Trial registration number: NCT06340074
Date of registration: March 29, 2024. Retrospectively registered
URL of trial registry record: https://clinicaltrials.gov/study/NCT06340074?intr=helm&rank=

Plain Language Summary

Using practices that have been proven to work in research to support youth social, emotional, and behavioral well-being in schools is hard. Efforts to use these practices decrease across the school year. School leadership behaviors can influence educators’ use of these practices. Our study tested an implementation strategy or support designed to help educators use a research-backed practice called Helping Educational Leaders Mobilize Evidence (HELM). HELM was adapted from the Leadership and Organizational Change for Implementation (LOCI) strategy, to enhance school leadership teams’ specific leadership behaviors to protect against the decline in implementation effort. This study explores the impact of HELM on outcomes related to practice use. One school district and 10 schools in western Washington State participated. Five of the schools received the HELM strategy and the remaining five schools received an alternative leadership training. Teachers at every school (n = 341) received training in a practice called Positive Greetings at the Door (PGD) that has been shown to reduce student behavior problems. Principals and Assistant Principals (n = 18) received the HELM strategy or alternative leadership training. Three district administrators also participated in HELM. HELM unexpectedly slowed the average decline of implementation leadership (perseverant leadership and communication), three dimensions of implementation climate (recognition, rewards, and existing supports), total implementation climate, and one dimension of implementation citizenship (keeping informed). No significant effects were found with regard to use of the practice. The HELM strategy shows promise in slowing the deterioration of practice in schools and positively influenced implementation leadership behaviors.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Looking under the hood of a hybrid two-way texting intervention to improve early retention on antiretroviral therapy in Malawi: an implementation fidelity evaluation

Authors:

Robin E. Klabbers, Caryl Feldacker, Jacqueline Huwa, Christine Kiruthu-Kamamia, Agness Thawani, & Hannock Tweya

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: Janurary 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

While key to interpreting findings and assessing generalizability, implementation fidelity is underreported in mobile health (mHealth) literature. We evaluated implementation fidelity of an opt-in, hybrid, two-way texting (2wT) intervention previously demonstrated to improve 12-month retention on antiretroviral therapy (ART) among people living with HIV (PLHIV) in a quasi-experimental study in Lilongwe, Malawi.

Methods

Short message service (SMS) data and ART refill visit records were used to evaluate adherence to 2wT content, frequency and duration through the lens of the Conceptual Framework for Implementation Fidelity. Message delivery and 2wT participant interactions were considered across four core 2wT components: 1) weekly motivational SMS messages; 2) proactive SMS appointment reminders; 3) SMS reminders after missed appointments; and 4) interactive messaging with 2wT staff about transfers and appointment rescheduling. Using mixed-effects logistic regression models adjusted for participant demographics, we examined the effect of core 2wT component fidelity on a) on-time appointment attendance and b) timely return to care after a missed appointment, presenting adjusted odds ratios (aORs) and 95% confidence intervals (CIs).

Results

The 468 2wT participants had a median of 52 study weeks (interquartile range [IQR] 34 – 52) with 6 ART appointments (IQR 4—7) of which 2 (IQR 1 – 3) were missed. On average, participants received a motivation message for 75% (IQR 56%—83%) of enrolled weeks, a reminder before 83% (IQR 67%—100%) of appointments, and after 67% (IQR 0%—100%) of missed appointments. Participants reported 9 transfers and rescheduled 46 appointments through 2wT prompts; 196 appointments were changed via unprompted interaction. Participants with 10% higher expected motivation message delivery were more likely to attend clinic appointments on time (aOR: 1.08; 95%CI: 1.01 – 1.16, p = 0.03). Receiving and responding to an appointment reminder in any way were also associated with increased on-time appointment attendance (aOR: 1.35; 95%CI: 1.03 – 1.79, p = 0.03 and aOR: 1.47, 95%CI: 1.16 – 1.87, p = 0.001, respectively). No associations were found for 2wT messages and timely return to care following a missed appointment.

Conclusion

Greater 2wT implementation fidelity was associated with improved care outcomes. Although implementation fidelity monitoring of mHealth interventions is complex, it should be integrated into study design.

Contributions to the literature
  • Despite the recognized importance of implementation fidelity in digital health research, few studies evaluate and transparently report the extent to which mHealth interventions were implemented as intended.
  • This study presents a framework-based evaluation of the implementation fidelity of a two-way texting intervention for HIV retention in a routine care setting in Malawi. Findings demonstrate how fidelity assessment not only facilitates replication of findings and generalizability assessment, but uncovers implementation challenges and generates hypotheses about intervention mechanisms of action.
  • The benefits and complexity of implementation fidelity evaluation underscore the need to consider fidelity early and integrate monitoring mechanisms into study design.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Healthcare provider perspectives on integrating HIV care into cancer centers in Malawi, South Africa, Uganda, and Zimbabwe

Authors:

Michalina A Montaño, Alfred Jatho, Cecilia Nassolo, Noleb Mugisha, Agatha Bula, Maganizo B Chagomerana, Margaret Borok, Takudzwa J Mtisi, Maureen Joffe, Rachel A. Bender Ignacio, and Ntokozo Ndlovu

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2025

Read the full text open access in the journal Translational Oncology

Abstract:

Background

In East and Southern Africa, treatment of people with concomitant cancer and HIV is complicated by siloed service delivery pathways, which exacerbate barriers to care and impact clinical decision-making. Integrating HIV care into cancer treatment centers may improve service delivery and overall patient outcomes.

Methods

We administered a questionnaire to clinicians and support staff at tertiary cancer referral centers in Malawi, Zimbabwe, Uganda, and South Africa to assess level of concern about clinical management of people with HIV (PWH) and cancer, barriers to integrating HIV service delivery into cancer treatment delivery, and beliefs related to HIV, antiretroviral therapy (ART), and integrated care.

Results

Of 195 clinician and support staff participants, 165 (85 %) were direct providers of cancer-associated care. Over 50 % indicated that they held concerns about survival, treatment complications, co-morbidities, and drug-drug interactions in PWH compared to patients without HIV. Over 80 % agreed that knowing cancer patients’ HIV status, ART status, and ART regimen would facilitate better care and should be considered in cancer care decision-making. Overall, respondents were optimistic that HIV-related care could be easily integrated into cancer care provision. The most-frequently endorsed barriers to integrated care were workspace limitations, disruptions to workflow, availability of staff, and cost to the hospital and to patients.

Conclusions

Cancer clinicians and support staff report overall positive attitudes toward integrating HIV and cancer service delivery. Research to elucidate service delivery pathways and contextualize system-based barriers to integrating care are critical next steps to optimize linked HIV and cancer care delivery.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying health equity implementation science frameworks to population genetic screening

Authors:

Nandana D Rao, Stephanie M Fullerton, Brian H Shirts, Annie T Chen, & Nora B Henrikson

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2024

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Implementation science frameworks with a focus on health equity have emerged to help guide the introduction of new interventions into healthcare and community settings while limiting health disparities. The purpose of this research was to explore the applicability of such frameworks to guide the equitable implementation of population genetic screening programs.

Methods

We searched PubMed and reference lists for relevant frameworks and examples of their use in health settings. We then assessed if and how selected frameworks provide guidance for different stages of population genetic screening: recruitment, sample collection, result return, follow-up care and long-term management, and cascade screening. Findings were synthesized into a list of health equity considerations specific to each stage.

Results

We identified 5 implementation frameworks that focus on health equity. Guidance varied by framework type: determinant (explaining what affects implementation outcomes), process (translating research into practice), or evaluation (assessing implementation). Common characteristics included focusing implementation efforts on populations who have historically experienced health inequities and adapting interventions to fit local contexts. Process models also highlighted the importance of community partnerships.

Discussion

Overall, frameworks offered broad recommendations applicable to population genetic screening program implementation. However, gaps still exist in guidance provided for later stages of population genetic screening. To improve the equitable implementation of genetic screening, future programs may benefit from utilizing one or more of these frameworks or by incorporating the health equity considerations and outcomes compiled in this analysis.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Acceptability of single-dose HPV vaccination schedule among health-care professionals in Kenya: a mixed-methods study

Authors:

Grace Umutesi, Bryan J Weiner, Lynda Oluoch, Elizabeth Bukusi, Maricianah Onono, Betty Njoroge, Lucy Mecca, Kenneth Ngure, Nelly R Mugo, Ruanne V Barnabas

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2024

Read the full text in the open access journal JNCI Monographs

Abstract:

Background

The World Health Organization recommends a single-dose human papillomavirus (HPV) vaccination schedule for girls and boys to accelerate progress toward cervical cancer elimination. We applied the Theoretical Framework of Acceptability (TFA) within the context of HPV vaccination to assess the acceptability of a single-dose schedule among health-care professionals in Kenya.

Methods

A REDCap survey was developed using relevant Theoretical Framework of Acceptability domains and validated with health-care professionals. Descriptive analyses and multivariate Poisson regression were conducted to assess factors associated with increased acceptability. Free-text responses were analyzed using a rapid qualitative approach, and findings were presented using a joint display.

Results

Among 385 responses, 74.2% of health-care professionals were female and 48.6% were nurses. On average, respondents had been in their position for 60 months, and one-third (33.2%) were based at level-4 facilities. The majority (75.84%) thought that giving a single-dose of the HPV vaccine to adolescent girls and young women was either acceptable or very acceptable. Qualitative findings highlighted that lack of information was the underlying reason for health-care professionals who were resistant, and most clinicians thought that a singled-dose schedule was less burdensome to clinicians and patients. Hospital directors had a non–statistically significantly lower acceptability likelihood than nurses (incident rate ratio = 0.93, 95% confidence interval = 0.45 to 1.71) and health-care professionals at urban facilities had a non–statistically significantly lower acceptability likelihood than clinicians in rural facilities (incident rate ratio = 0.97, 95% confidence interval = 0.83 to 1.13).

Conclusion

Although not statistically significant, predictors of increased acceptability provide information to tailor strategies to increase HPV vaccination coverage and accelerate progress toward cervical cancer elimination.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Barriers and facilitators to implementing enteral resuscitation for major burn injuries: Reflections from Nepalese care providers

Authors:

Raslina Shrestha, Kajal Mehta, Aldina Mesic, Dinasha Dahanayake, Manish Yadav, Shankar Rai, Kiran Nakarmi, Pariwesh Bista, Tam Pham, & Barclay T Stewart

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: October 2024

Read the full text in the subscription access journal Burns

✪ Acceptability of six-monthly PrEP dispensing supported with interim HIV self-testing to simplify PrEP delivery in Kenya: findings from qualitative research

Authors:

Nicholas Thuo, Ashley R. Bardon, Peter Mogere, Catherine Kiptinness, Edinah Casmir, Njeri Wairimu, Emmah Owidi, Phelix Okello, Nelly R. Mugo, Jared M. Baeten, Kenneth Ngure & Katrina F. Ortblad

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

In Africa, dispensing oral HIV pre-exposure prophylaxis (PrEP) within already strained public health facilities has led to prolonged waiting periods and suboptimal experiences for clients. We sought to explore the acceptability of dispensing PrEP semiannually with interim HIV self-testing (HIVST) versus quarterly PrEP dispensing with clinic-based HIV testing to optimize clinic-delivered PrEP services.

Methods

We conducted a qualitative study within a non-inferiority individual-level randomized controlled trial testing the effect of six-monthly PrEP dispensing with HIVST compared to the standard-of-care three-monthly PrEP dispensing on PrEP clinical outcomes in Kenya (ClinicalTrials.gov: NCT03593629). Eligible participants were ≥ 18 years, refilling PrEP for the first time, and either in an HIV serodifferent relationship (men and women) or singly enrolled (women only). A subset of participants in the intervention group completed serial in-depth interviews (IDIs) at enrollment, six months, and 12 months. We utilized stratified purposive sampling to ensure representation across participant groups. We analyzed our qualitative data thematically using a combination of inductive and deductive approaches, the latter guided by the Theoretical Framework of Acceptability (TFA).

Results

Between May 2018 and June 2021, we conducted 120 serial IDIs with 55 participants; 64% (35/55) were in a serodifferent relationship, 64% (35/55) were women, and the median age was 32 years (IQR 27–40). Overall, participants found this novel PrEP delivery model highly acceptable; it was well-liked, private (TFA construct: affective attitude), and less burdensome (TFA construct: burden) compared to standard PrEP delivery. Additionally, participants were confident in their ability to participate in the intervention (TFA construct: self-efficacy). Some participants, however, highlighted model disadvantages, including fewer opportunities for in-person counseling and potentially less accurate HIV testing (TFA construct: opportunity costs). Ultimately, most participants reported that the intervention allowed them to achieve their HIV prevention goals (TFA construct: perceived effectiveness) and that their confidence in at-home HIVST and PrEP continuation increased following each semiannual clinic visit.

Conclusions

Semiannual PrEP clinic visits supported with six-monthly drug dispensing and interim HIVST was acceptable among PrEP users who experienced the intervention in Kenya. More comprehensive pre-intervention counseling and training on HIVST may help alleviate the client concerns presented, which were often resolved over time with intervention experience.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ VA’s EHR transition and health professions trainee programs: Findings and impacts of a multistakeholder learning community

Authors:

Julian Brunner, Ellen A. Ahlness, Ekaterina Anderson, Brianne K. Molloy-Paolillo, Alexandre Braga, Sarah L. Cutrona, Christian D. Helfrich, Deborah Levy, Erin Matteau, Edward Walton, George Sayre, Seppo T. Rinne

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal Learning Health System

Abstract:

Introduction

The Department of Veterans Affairs (VA) is undergoing an unprecedented electronic health record (EHR) transition, switching from its homegrown EHR to a commercial system. The transition affects nearly every clinical employee but is particularly disruptive to health professions trainees (HPTs)—an often-overlooked population in EHR transitions. To better understand and address trainee challenges with the EHR transition, we formed a multistakeholder learning community. In this study, we describe the findings of this learning community and the practices and policies developed in response.

Methods

In the qualitative study designed and executed by our learning community, we conducted 51 interviews with HPTs, program leaders, and preceptors before and multiple times after an EHR transition site's go-live (February 16, 2022 to April 7, 2023). We merged interview transcripts with 125 survey free-text responses from a survey conducted with preceptors 2 months post-go-live and conducted thematic analysis to identify key themes. To complement qualitative findings, we also include a quantitative survey finding, and, where applicable, we note policy and practice responses spurred by our learning community.

Results

Interviews yielded six key themes: (1) High satisfaction with HPT programs, despite negative impacts of the EHR transition; (2) early delays, then substantial improvements, in HPTs' EHR access; (3) persistent challenges with HPTs' EHR training and support, mitigated by local and national efforts; (4) the challenge of learning to use a rapidly evolving EHR during clinical training; (5) reduced visit volume as a continuing barrier to education; and (6) an impression that HPTs' relative lack of exposure to the prior EHR facilitated their proficiency with the new EHR.

Conclusions

Findings highlighted challenges for HPT programs related to the EHR transition, which spurred important changes including the creation of a national VA council to represent the needs of HPTs in the EHR transition, and improvements to HPTs' EHR training and access.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**