Skip to content

Formative Evaluation to Inform Implementation of Sepsis Bundles in Emergency Departments

Authors:

Hannah E. Frank, Nima Sarani, Jacqueline F. Hayes, Ruben G. Martinez, Jessyca Goldstein, Laura Evans, Gary Phillips, R. Phillip Dellinger, David Portelli, Christa Schorr, Kathleen M. Terry, Lori Harmon, Sean Townsend & Mitchell M. Levy

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: May 2026

Read the full text in the subscription access journal Annals of Emergency Medicine

✪ Finding the balance between rigour and relevance: implementing adaptations to the implementation of a pragmatic randomised controlled trial of a two-way texting intervention for voluntary medical male circumcision in South Africa

Authors:

Geoffrey Setswe, Sarah Day, Felex Ndebele, Jacqueline Pienaar, Vuyolwethu Ncube, & Caryl Feldacker

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal BMJ Open

Abstract:

Objectives

To document adaptations that were made to the implementation of the two-way texting (2wT) randomised controlled trial (RCT) for voluntary medical male circumcision (VMMC) in South Africa and to provide a nuanced discussion on the differences between adaptations and fidelity in this context.

Design

We conducted a qualitative study using the Framework for Reporting Adaptations and Modifications in Evidence-based Implementation Strategies (FRAME-IS) to examine 2wT adaptations. We reported adaptations to the 2wT intervention using two steps. First, we categorised adaptations in a shared study-specific Google Docs that documented participant engagement with the 2wT system, tracked daily RCT implementation notes, reported software bugs and noted reminder emails about adaptations for the research team. Second, we conducted a qualitative assessment of the influence of adaptations on project outcomes via 10 periodic reflection meetings with VMMC implementers. Reflection documentation included notes from field observations, meeting minutes and informal partner check-ins to complete adaptation documentation. Using the FRAME-IS as a codebook, adaptations were categorised.

Settings

The RCT was conducted in rural and urban VMMC clinics in the North West and Gauteng districts of South Africa.

Participants

Implementation scientists and VMMC implementers who implemented the 2wT pragmatic randomised controlled trial (pRCT) were participants for the adaptation study.

Primary and secondary outcome measures

The primary outcome measure was the adaptations that were made during the implementation of the 2wT pRCT. The secondary outcome measures were fidelity and rigour of implementing adaptations to the 2wT pRCT.

Results

Between June 2021 and February 2022, 13 adaptations were identified in three phases during the implementation of the 2wT pRCT. The first phase of adaptations aimed to augment study recruitment, including conducting weekend VMMC recruitment camps, using mobile outreach services in the rural site, adding two urban sites to increase recruitment, using weekly WhatsApp calls for updates with all implementing teams, using virtual meetings to implement the 2wT strategy remotely during COVID-19 restrictions and allocating one clinician to work outside of normal working hours. The second phase of adaptations further enhanced enrolments, including adding two local language translations in the usability survey for 2wT men and contributing a portion towards the salary of the implementing staff by the research partner. The third phase included the exclusion of two rural clinics as recruitment sites due to inconsistent mobile phone networks, adding another layer of data quality checks to ensure data quality, training non-clinical counsellors to help with enrolling clients, retraining of staff in the rural site with high staff turnover and using both primary and alternative phone numbers for enrolment to reduce loss to follow-up.

Conclusions

This study made adaptations to the 2wT pRCT without compromising the fidelity of the study. The 2wT pRCT balances rigour (fidelity) and relevance (adaptation). Adaptations should not be confined by rigour but should also not go unchallenged or unverified. We conclude that fidelity can be maintained with adaptations that are implemented to close the gap between research in the laboratory and practice.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Towards development of guidelines for harnessing implementation science for suicide prevention: an international Delphi expert consensus study

Authors:

Sadhvi Krishnamoorthy, Gregory Armstrong, Victoria Ross, Lennart Reifels, Hayley Purdon, Jillian Francis, Jacinta Hawgood, Sharna Mathieu, Alexandr Kasal, Allison Crawford, Allison M. Gustavson, András Székely, Anna Baran, Annette Erlangsen, Ashley Nemiro, Chez Curnow, Daniel Reidenberg, Daria Biechowska, Ella Arensman, Emmanuel Nii-Boye Quarshie, Fiona Shand, Caroline Mae Ramirez, Isabel Zbukvic, Jorgen Gullestrup, Katherine McGill, Kylie King, Lakshmi Vijayakumar, Lauren White, Loraine Barnaby, Mark Sinyor, Marlena Sokół-Szawłowska, Maryke Van Zyl, Merike Sisask, Michael Phillips, Mohsen Rezaeian, Naohiro Yonemoto, Nathaniel Pollock, Nikhil Jain, Paul Siu Fai Yip, Ping Qin, Piotr Toczyski, Rakhi Dandona, Ricardo Gusmão, Samah Jabr, Sarah Spafford, Tae-Yeon Hwang, Thomas Niederkrotenthaler, Ulrich Hegerl, Vita Poštuvan, Yutaka Motohashi, Kairi Kõlves

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal BMJ Public Health

Abstract:

Objectives

Suicide research and prevention are complex. Many practical, methodological and ethical challenges must be overcome to implement effective suicide prevention interventions. Implementation science can offer insights into what works, why and in what context. Yet, there are limited real-world examples of the application of implementation science in suicide prevention. This study aimed to identify approaches to employ principles of implementation science to tackle important challenges in suicide prevention.

Methods

A questionnaire about promoting implementation science for suicide prevention was developed through thematic analysis of stakeholder narratives. Statements were categorised into six domains: research priorities, practical considerations, approach to intervention design and delivery, lived experience engagement, dissemination and the way forward. The questionnaire (n=52 statements—round 1; n=44 statements—round 2; n=9 statements—round 3) was administered electronically to a panel (n=62—round 1, n=48—round 2; n=45—round 3) of international experts (suicide researchers, leaders, project team members, lived experience advocates). Statements were rated on a Likert scale based on an understanding of importance and priority of each item. Statements endorsed by at least 85% of the panel would be included in the final guidelines.

Results

Eighty-two of the 90 statements were endorsed. Recommendations included broadening research inquiries to understand overall programme impact; accounting for resources in the translation of evidence into practice; embedding implementation science in intervention delivery and design; meaningfully engaging lived experience; considering channels for dissemination of implementation-related findings and focusing on next steps needed to routinely harness the strengths of implementation science in suicide prevention research, practice and training.

Conclusion

An interdisciplinary panel of suicide prevention experts reached a consensus on optimal strategies for using implementation science to enhance the effectiveness of policies and programmes aimed at reducing suicide.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Lessons learnt from the 2021 Pacific Northwest heat dome: a qualitative study of western Washington’s healthcare community response

Authors:

Matias Korfmacher, Cat Hartwell, Kelly Hill, Nathaniel Matthews-Trigg, Jeremy Hess, Amruta Nori-Sarma, & Gregory Wellenius

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal BMJ Open

Abstract:

Objective

The 2021 Pacific Northwest heat dome was Washington state’s deadliest recorded weather event and presented unprecedented response challenges to the state’s health sector. Understanding the impacts of this extreme heat event (EHE) on the sector as well as the barriers to and facilitators of implementing effective heat response is critical to preparing for future events, which are happening more frequently in the region due to climate change.

Design

Guided by an implementation science framework, we convened listening sessions and focus groups of the health sector in western Washington to reflect on regional response efforts.

Setting

Health sector organisations in 15 counties in western Washington State, USA: Clallam, Grays Harbor, Island, Jefferson, King, Kitsap, Lewis, Mason, Pacific, Pierce, San Juan, Skagit, Snohomish, Thurston and Whatcom.

Participants

A convenience sample of 109 listening group participants was recruited through the professional networks of the Northwest Healthcare Response Network, a regional healthcare coalition. 27 of the health sector professionals were recruited using purposive sampling to participate in seven focus groups organised by organisation type.

Results

The co-presence of the COVID-19 pandemic, limited staff capacity, resource acquisition challenges and inadequate regional collaboration emerged as key barriers, while advanced planning, indoor cooling capabilities, adapting strategies to local needs, robust internal relationships and strong external partnerships were reported to facilitate effective response. Establishing centralised coordination ahead of heat events, making improvements to the cooling capabilities of the built environment, developing plans and policies for EHEs that have co-benefits for other events, adopting evidence-informed response strategies, institutionalising the knowledge and relationships developed through prior events and improving evaluative processes (such as developing real-time monitoring capacity) will enable more effective response to future EHEs.

Conclusions

Western Washington’s health sector implemented EHE response activities that enabled essential service continuity, despite limited resources, unfamiliarity with EHEs and other systemic challenges. The recency of the heat dome presents an opportunity to incorporate lessons learnt into practice, policies, plans and built environment; these are necessary improvements ahead of future large-scale events the region may experience in the coming decades.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Factors influencing community demand for assisted partner services for HIV in western Kenya: a multilevel qualitative analysis

Authors:

Mercy Owuor, Beatrice Wamuti, David A Katz, Wenjia Liu, Harison Lagat, Edward Kariithi, Brienna Naughton, Hanley Kingston, Mary Mugambi, Rose Bosire, Sarah Masyuko, Carey Farquhar, and Bryan J Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2025

Read the full text in the open access journal BMJ Open

Abstract:

Objectives

This study explores factors affecting community-level demand for assisted partner services (APS) and HIV testing services (HTS) in western Kenya.

Design

This is a multilevel qualitative analysis conducted as part of the APS Scale-up Study, a hybrid type 2 implementation-effectiveness study of APS integrated within routine HTS. For this analysis, in-depth phone interviews assessed demand for APS and factors influencing decisions to participate in APS.

Setting

Participants were recruited from eight healthcare facilities and (for APS stakeholders) from affiliated healthcare institutions in western Kenya (Kisumu and Homabay). Interviews were conducted by phone in 2019 and 2020.

Participants

67 participants were interviewed: 14 APS providers, 16 female index clients, 17 male sexual partners and 20 community members. Participants were recruited using criteria-based purposive sampling to represent different types of facilities and to include indexes who named different numbers of partners and stakeholders representing all Kenyan healthcare system levels.

Results

Collectively, participants perceived that demand and uptake of APS could be impacted by multiple stigmas related to HIV, sexual behaviours and identities; long clinical wait times; certain gender norms and expectations; and fear of relationship dissolution, loss of financial support and intimate partner violence. However, different stakeholder groups generally focused on different factors; women focused more on gender dynamics and family roles; male sexual partners on stigma and structural barriers; HTS providers focused on HIV testing accessibility; and community-level stakeholders focused on low community awareness of APS.

Conclusions

Stigma reduction, awareness about APS, creation of male entry points at the facility level and provision of social support mechanisms have the potential to increase demand for APS.

Data availability statement

Data are available upon reasonable request. The datasets generated and/or analysed during the current study are not publicly available because some interview transcripts may contain sensitive individual information; however, they can be made available from the corresponding author on reasonable request.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A framework for designing hybrid effectiveness-implementation trials for digital health interventions

Authors:

Theresa E. Matson, Eric D.A. Hermes, Aaron R. Lyon, Andrew Quanbeck, Stephen M. Schueller, Sarah M. Wilson, and Joseph E. Glass

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2025

Read the full text open access in the journal Annals of Epidemiology

Abstract:

This article proposes methods for designing randomized controlled trials studying the implementation and effectiveness of digital interventions, meaning websites or applications ("apps") that patients use in healthcare. Deploying digital interventions for behavioral health differs from implementing traditional interventions such as medications or human-delivered therapy. Prior trial design guidance has ignored the existence of international governmental evidence standards, has paid insufficient attention to implementation reporting guidelines, and has not described methods for empirically testing the approach for organizing the delivery of digital interventions.

This framework for designing hybrid effectiveness-implementation trials of digital behavioral health interventions helps researchers articulate research questions that matter to decision-makers and meaningfully contribute to implementation. The framework outlines three phases: 1) frame effectiveness and implementation questions in terms of the digital intervention components, types of clinical support for the digital intervention, and specific strategies for implementing the digital intervention; 2) define and delineate actors, activities, action targets, dose, temporality, and outcomes to maximize inference and reproducibility; and 3) specify trial design features used for hybrid classification.

We illustrate the utility of this framework with two effectiveness-implementation studies of digital interventions for substance use. This framework can help researchers decide on appropriate methodology and help decision-makers apply findings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Outcome preferences in fidelity-adaptation scenarios across evidence-based parenting programs: A discrete choice experiment

Authors:

Kristoffer Pettersson, Philip Millroth, Fabrizia Giannotta, Pernilla Liedgren, Aaron R. Lyon, Henna Hasson, and Ulrica von Thiele Schwarz

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

Implementing evidence-based parenting programs often involves navigating fidelity-adaptation decisions. While research has explored various aspects of this dilemma, little is known about how practitioners’ outcome preferences influence their decisions in real-world scenarios.

Methods

This study employed a discrete choice experiment (DCE) to investigate the relative importance of five outcomes (Relationship Quality, Satisfaction, Workload Strain, Value Conflict, and Reach) in fidelity-adaptation decisions among 209 practitioners delivering evidence-based parenting programs in Sweden. The DCE presented 25 choice sets across five contextual scenarios, analyzed using Bayesian hierarchical logistic regression.

Results

All five outcomes significantly influenced practitioners’ choices, with Relationship Quality emerging as the most impactful (log-odds: 4.56, 95% CI [4.16, 4.91]). Satisfaction and minimizing Value Conflict showed similar importance (log odds: 2.45 and -2.40, respectively), while Workload Strain and Reach had slightly less impact (log odds: -2.10 and 1.96, respectively).

Conclusions

This study offers a novel perspective on the role of outcome preference in navigating fidelity-adaptation decisions. The strong preference for improving parent-child relationships aligns with core parenting program goals, while consideration of other outcomes reflects practitioners’ holistic approach to implementation. These findings can inform the design of interventions and implementation strategies that balance effectiveness with real-world constraints, potentially enhancing parenting programs’ adoption, sustainability, and impact.

Contributions to the literature
  • This study pioneers the application of discrete choice experiments in exploring fidelity-adaptation decisions.
  • Quantifying practitioners’ outcome preferences provides empirical evidence of complex trade-offs in implementing evidence-based parenting programs.
  • The study’s results provide actionable insights for program developers, policymakers, and implementation scientists on designing interventions that resonate with practitioners’ priorities while maintaining program effectiveness.
  • This research bridges theoretical frameworks and real-world decision-making, advancing our understanding of how various factors influence intervention delivery in practice.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Health Care Professional Adherence to Breast Cancer Management Guidelines in Nigeria

Authors:

Anya Romanoff, Olalekan Olasehinde, Kathleen Lynch, Sharif Folorunso, Oluwatosin Omoyiola, Betiku Omolade, Adeleye Omisore, Chukwuma Eze Okereke, Olayide Agodirin, Abubakar Bala Muhammad, Nuhu Ali, Omorodion Irowa, Nneka Sunday Nweke, Uchechukwu Emmanuel Nwokwu, Adewale Aderounmu, Funmilola Wuraola, Hannah L Kalvin, Rivka Kahn, Grace Fitzgerald, Cristina Olcese, Alexia Iasonos, Victoria L Mango, Jamie S Ostroff, Rachel Vreeman, Benjamin O Anderson, T Peter Kingha, and Olusegun Isaac Alatise

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2025

Read the full text in the open access journal JAMA Network Open

Abstract:

Importance

In Nigeria, 80% of breast cancer is diagnosed at an advanced stage, when clinical management is complex and necessitates multidisciplinary collaboration. The Nigerian Federal Ministry of Health promotes multidisciplinary tumor board (MDT) discussions and endorses the National Comprehensive Cancer Network Harmonized Guidelines for Sub-Saharan Africa (Harmonized Guidelines) to standardize breast cancer care, but the extent of their clinical utilization is not well understood.

Objective

To identify barriers to and facilitators of the standardization of breast cancer care in Nigeria as reflected by awareness and consultation of resource-adapted guidelines.

Design, Setting, and Participants

For this survey study, health care professionals (HCPs) involved in breast cancer care in Nigeria were recruited electronically through medical societies and snowball sampling from November 1, 2023, to January 31, 2024.

Exposure

Breast cancer care guidelines.

Main Outcomes and Measures

Current breast cancer guideline awareness, adherence among specialties, and multidisciplinary management in Nigeria were evaluated. A multinational, multidisciplinary team developed and distributed an HCP questionnaire. Cochran-Armitage trend tests and logistic regression assessed associations with guideline awareness and use.

Results

A total of 277 HCPs (median [IQR] age, 42 [38-48] years; 211 of 275 [77%] male), including 124 surgeons (45%), 59 radiologists (21%), 49 clinical oncologists (18%), and 45 pathologists (16%), responded to the survey. Of 274 HCPs, 253 (92%) believed that breast cancer guidelines contribute to better patient outcomes, and 100 of 195 (51%) routinely consulted guidelines. Of 273 HCPs, 103 (38%) had regular engagement in breast cancer MDT discussions. Only 93 of 277 HCPs (34%) were aware of resource-adapted Harmonized Guidelines; both guideline awareness and consultation increased with the frequency of MDT participation. Completing a cancer-related fellowship (OR, 14.56; 95% CI, 6.24-40.00; P < .001), clinical oncology specialization (OR vs surgery, 0.20 [95% CI, 0.09-0.42]; OR vs pathology, 0.05 [95% CI, 0.02-0.14]; OR vs radiology, 0.02 [95% CI, 0.01-0.06]; P < .001), devoting more time to breast health care delivery (OR, 1.04; 95% CI, 1.02-1.05; P < .001), and regular MDT engagement (OR for weekly vs none, 5.13; 95% CI, 1.69-17.35; P = .04) were associated with consulting guidelines regularly on univariable analysis. To improve guideline adherence, 230 of 277 HCPs (83%) reported needing regular MDT discussions.

Conclusions and Relevance

In this survey of HCPs across Nigeria, half reported routinely consulting guidelines and only one-third were aware of the Harmonized Guidelines, which are resource adapted and endorsed by the Nigerian Federal Ministry of Health. Approximately one-third of HCPs reported engaging in regular breast cancer MDT discussions; guideline awareness and consultation increased as frequency of MDT participation increased. Opportunities for disseminating knowledge, such as MDT discussions and fellowship training, are essential to standardize breast cancer care delivery in Nigeria.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Feasibility of Using Patient Navigation to Improve Identification of Hereditary Cancer Syndromes in Newly Diagnosed Colorectal Cancer Patients

Authors:

Emma Sears, Jacky Dahlquist, Sarah Stayman, Cynthia Ko, Eric Q. Konnick, Allison Cole, Ying Zhang, Marlana Kohn, Vida Henderson, and Sarah Knerr

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access journal Genetics in Medicine

✪ A Team Coaching Intervention for Dementia Care: Acceptability and Feasibility Study in Care Communities

Authors:

Jessica Welsch, Boeun Kim, Lorna Prophater, Basia Belza, & Sam Fazio

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2024

Read the full text open access in the Journal of the American Medical Directors Association

Abstract:

Objectives

In 2018, the Alzheimer's Association published the Dementia Care Practice Recommendations (DCPR) to provide guidance on quality care for professionals. This study aimed to examine the feasibility and acceptability of a consultative coaching program to increase adoption of the DCPR.

Design

A single-group pre-post design was employed. A 6-month team coaching intervention was implemented to make organization-wide and measurable changes in the areas of (1) policies and procedures, (2) education and training, or (3) care practices to increase person-centered care practices.

Setting and Participants

A total of 36 care communities in Washington and Montana states were enrolled in this program.

Methods

Focus groups were conducted with participants to explore the acceptability and feasibility of the program. A 35-item employees satisfaction survey was administered both before and after the program.

Results

The findings offer preliminary evidence that implementing a coaching program is desired by care community staff and has a positive impact on staff job satisfaction and the use of person-centered care. The coaching model was received by staff as a supportive and affirming program.

Conclusions and Implications

The team coaching intervention, designed to improve person-centered care and employee satisfaction, is acceptable. However, its efficacy needs to be tested with a larger sample using a randomized controlled design.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**