Skip to content

✪ Applying the Cognitive Walkthrough for Implementation Strategies methodology to inform the redesign of a selection-quality implementation toolkit for use in schools

Authors:

Kelsey S. Dickson, Olivia G. Michael, Amy Drahota, Aksheya Sridhar, Jessica E. Tschida, & Jill Locke

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2024

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Implementation strategies are key to enhancing the translation of new innovations but there is a need to systematically design and tailor strategies to match the targeted implementation context and address determinants. There are increasing methods to inform the development and tailoring of implementation strategies to maximize their usability, feasibility, and appropriateness in new settings such as the Cognitive Walkthrough for Implementation Strategies (CWIS) approach. The aim of the current project is to apply the CWIS approach to inform the redesign of a multifaceted selection-quality implementation toolkit entitled Adoption of Curricular supports Toolkit: Systematic Measurement of Appropriateness and Readiness for Translation in Schools (ACT SMARTS) for use in middle and high schools.

Methods

We systematically applied CWIS as the second part of a community-partnered iterative redesign of ACT SMARTS for schools to evaluate the usability and inform further toolkit redesign areas. We conducted three CWIS user testing sessions with key end users of school district administrators (n = 3), school principals (n = 6), and educators (n = 6).

Results

Our CWIS application revealed that end users found ACT SMARTS acceptable and relevant but anticipate usability issues engaging in the ACT SMARTS process. Results informed the identification of eleven usability issues and corresponding redesign solutions to enhance the usability of ACT SMARTS for use in middle and high schools.

Conclusions

Results indicated the utility of CWIS in assessing implementation strategy usability in service of informing strategy modification as part of our broader redesign to improve alignment with end user, end recipient, and setting needs. Recommendations regarding the use of this participatory approach are discussed.

Contributions to the literature

  • The current case study adds to the nascent literature applying the Cognitive Walkthrough for Implementation Strategies (CWIS) method as part of a larger implementation project, including one of the first independent applications outside of the CWIS method developers.
  • The current case study illustrates the impact and utility of the CWIS method for designing and tailoring implementation strategies.
  • This case study provides further guidance and recommendations for the application of CWIS to future implementation projects.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Operational and organizational variation in determinants of policy implementation success: the case of policies that earmark taxes for behavioral health services

Authors:

Jonathan Purtle, Nicole A. Stadnick, Amanda I. Mauri, Sarah C. Walker, Eric J. Bruns, & Gregory A. Aarons

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal Implementation Science

Abstract:

Background

Research on determinants of health policy implementation is limited, and conceptualizations of evidence and implementation success are evolving in the field. This study aimed to identify determinants of perceived policy implementation success and assess whether these determinants vary according to: (1) how policy implementation success is operationally defined [i.e., broadly vs. narrowly related to evidence-based practice (EBP) reach] and (2) the role of a person’s organization in policy implementation. The study focuses on policies that earmark taxes for behavioral health services.

Methods

Web-based surveys of professionals involved with earmarked tax policy implementation were conducted between 2022 and 2023 (N = 272). The primary dependent variable was a 9-item score that broadly assessed perceptions of the tax policy positively impacting multiple dimensions of outcomes. The secondary dependent variable was a single item that narrowly assessed perceptions of the tax policy increasing EBP reach. Independent variables were scores mapped to determinants in the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework. Multiple linear regression estimated associations between measures of determinants and policy implementation success.

Results

Perceptions of tax attributes (innovation determinant), tax EBP implementation climate (inner-context determinant), and inter-agency collaboration in tax policy implementation (outer-context and bridging factor determinant) were significantly associated with perceptions of policy implementation success. However, the magnitude of associations varied according to how success was operationalized and by respondent organization type. For example, the magnitude of the association between tax attributes and implementation success was 42% smaller among respondents at direct service organizations than non-direct service organizations when implementation success was operationalized broadly in terms of generating positive impacts (β = 0.37 vs. β = 0.64), and 61% smaller when success was operationalized narrowly in terms of EBP reach (β = 0.23 vs. β = 0.59). Conversely, when success was operationalized narrowly as EBP reach, the magnitude of the association between EBP implementation climate and implementation success was large and significant among respondents at direct service organizations while it was not significant among respondents from non-direct service organizations (β = 0.48 vs. β=-0.06).

Conclusion

Determinants of perceived policy implementation success may vary according to how policy implementation success is defined and the role of a person’s organization in policy implementation. This has implications for implementation science and selecting policy implementation strategies.

Contributions to the literature

  • The current study contributes to limited knowledge focused on determinants of policy implementation and scholarship about broadening definitions of evidence and implementation success in the field of implementation science.
  • Attributes of earmarked tax policies, tax policy EBP implementation climate, and frequency of inter-agency collaboration in tax policy implementation are significant determinants of tax policy implementation success and could be targeted by policy implementation strategies.
  • Determinants of policy implementation success vary according to how policy implementation success is operationally defined (broadly vs. narrowly related to EBP reach) and the role of a person’s organization in policy implementation the process.
  • Linking policy implementation determinants to the EPIS framework advances understanding of how implementation science frameworks can advance the study of policy implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Barriers and facilitators to implementing enteral resuscitation for major burn injuries: Reflections from Nepalese care providers

Authors:

Raslina Shrestha, Kajal Mehta, Aldina Mesic, Dinasha Dahanayake, Manish Yadav, Shankar Rai, Kiran Nakarmi, Pariwesh Bista, Tam Pham, & Barclay T Stewart

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: October 2024

Read the full text in the subscription access journal Burns

✪ Acceptability of six-monthly PrEP dispensing supported with interim HIV self-testing to simplify PrEP delivery in Kenya: findings from qualitative research

Authors:

Nicholas Thuo, Ashley R. Bardon, Peter Mogere, Catherine Kiptinness, Edinah Casmir, Njeri Wairimu, Emmah Owidi, Phelix Okello, Nelly R. Mugo, Jared M. Baeten, Kenneth Ngure & Katrina F. Ortblad

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

In Africa, dispensing oral HIV pre-exposure prophylaxis (PrEP) within already strained public health facilities has led to prolonged waiting periods and suboptimal experiences for clients. We sought to explore the acceptability of dispensing PrEP semiannually with interim HIV self-testing (HIVST) versus quarterly PrEP dispensing with clinic-based HIV testing to optimize clinic-delivered PrEP services.

Methods

We conducted a qualitative study within a non-inferiority individual-level randomized controlled trial testing the effect of six-monthly PrEP dispensing with HIVST compared to the standard-of-care three-monthly PrEP dispensing on PrEP clinical outcomes in Kenya (ClinicalTrials.gov: NCT03593629). Eligible participants were ≥ 18 years, refilling PrEP for the first time, and either in an HIV serodifferent relationship (men and women) or singly enrolled (women only). A subset of participants in the intervention group completed serial in-depth interviews (IDIs) at enrollment, six months, and 12 months. We utilized stratified purposive sampling to ensure representation across participant groups. We analyzed our qualitative data thematically using a combination of inductive and deductive approaches, the latter guided by the Theoretical Framework of Acceptability (TFA).

Results

Between May 2018 and June 2021, we conducted 120 serial IDIs with 55 participants; 64% (35/55) were in a serodifferent relationship, 64% (35/55) were women, and the median age was 32 years (IQR 27–40). Overall, participants found this novel PrEP delivery model highly acceptable; it was well-liked, private (TFA construct: affective attitude), and less burdensome (TFA construct: burden) compared to standard PrEP delivery. Additionally, participants were confident in their ability to participate in the intervention (TFA construct: self-efficacy). Some participants, however, highlighted model disadvantages, including fewer opportunities for in-person counseling and potentially less accurate HIV testing (TFA construct: opportunity costs). Ultimately, most participants reported that the intervention allowed them to achieve their HIV prevention goals (TFA construct: perceived effectiveness) and that their confidence in at-home HIVST and PrEP continuation increased following each semiannual clinic visit.

Conclusions

Semiannual PrEP clinic visits supported with six-monthly drug dispensing and interim HIVST was acceptable among PrEP users who experienced the intervention in Kenya. More comprehensive pre-intervention counseling and training on HIVST may help alleviate the client concerns presented, which were often resolved over time with intervention experience.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ VA’s EHR transition and health professions trainee programs: Findings and impacts of a multistakeholder learning community

Authors:

Julian Brunner, Ellen A. Ahlness, Ekaterina Anderson, Brianne K. Molloy-Paolillo, Alexandre Braga, Sarah L. Cutrona, Christian D. Helfrich, Deborah Levy, Erin Matteau, Edward Walton, George Sayre, Seppo T. Rinne

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal Learning Health System

Abstract:

Introduction

The Department of Veterans Affairs (VA) is undergoing an unprecedented electronic health record (EHR) transition, switching from its homegrown EHR to a commercial system. The transition affects nearly every clinical employee but is particularly disruptive to health professions trainees (HPTs)—an often-overlooked population in EHR transitions. To better understand and address trainee challenges with the EHR transition, we formed a multistakeholder learning community. In this study, we describe the findings of this learning community and the practices and policies developed in response.

Methods

In the qualitative study designed and executed by our learning community, we conducted 51 interviews with HPTs, program leaders, and preceptors before and multiple times after an EHR transition site's go-live (February 16, 2022 to April 7, 2023). We merged interview transcripts with 125 survey free-text responses from a survey conducted with preceptors 2 months post-go-live and conducted thematic analysis to identify key themes. To complement qualitative findings, we also include a quantitative survey finding, and, where applicable, we note policy and practice responses spurred by our learning community.

Results

Interviews yielded six key themes: (1) High satisfaction with HPT programs, despite negative impacts of the EHR transition; (2) early delays, then substantial improvements, in HPTs' EHR access; (3) persistent challenges with HPTs' EHR training and support, mitigated by local and national efforts; (4) the challenge of learning to use a rapidly evolving EHR during clinical training; (5) reduced visit volume as a continuing barrier to education; and (6) an impression that HPTs' relative lack of exposure to the prior EHR facilitated their proficiency with the new EHR.

Conclusions

Findings highlighted challenges for HPT programs related to the EHR transition, which spurred important changes including the creation of a national VA council to represent the needs of HPTs in the EHR transition, and improvements to HPTs' EHR training and access.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Balancing realist review outputs with the needs of policymakers and practitioners

Authors:

Ferdinand C Mukumbang, Sonja Klingberg, & Bipin Adhikari

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal Health Policy and Planning

Abstract:

A realist review is a theory-driven approach to synthesizing evidence based on the realist philosophy of science. Realist reviews are conducted to provide the policy and practice community with a rich, detailed and practical understanding of complex social interventions that will likely be of much more use to them when planning and implementing programmes. Robust realist reviews must balance philosophical engagement, methodological rigour and relevance to practice. Nevertheless, they have been criticized for being more philosophically inclined and less methodologically robust, with findings that have little implication for practice. Using the philosophy/epistemology➔ methodology➔ theory➔ practice concept flow, we report how we balanced philosophical principles and practical insights in a recently conducted realist review on participatory practices that impact the benefits of non-communicable disease research and interventions in low- and middle-income countries. If realist reviews are not comprehensible enough for these practitioners, their utility and relevance may suffer from being limited to a specialist cohort of academics. We propose that realist review findings and outputs must be framed and communicated to meaningfully engage practitioners without undertaking translational efforts.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ WhatsApp Versus SMS for 2-Way, Text-Based Follow-Up After Voluntary Medical Male Circumcision in South Africa: Exploration of Messaging Platform Choice

Authors:

Isabella Fabens, Calsile Makhele, Nelson Kibiribiri Igaba, Sizwe Hlongwane, Motshana Phohole, Evelyn Waweru, Femi Oni, Madalitso Khwepeya, Maria Sardini, Khumbulani Moyo, Hannock Tweya, Mourice Barasa Wafula, Jacqueline Pienaar, Felex Ndebele, Geoffrey Setswe, Tracy Qi Dong, & Caryl Feldacker

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Telehealth is growing, especially in areas where access to health facilities is difficult. We previously used 2-way texting (2wT) via SMS to improve the quality of postoperative care after voluntary medical male circumcision in South Africa. In this study, we offered males aged 15 years and older WhatsApp or SMS as their message delivery and interaction platform to explore user preferences and behaviors.

Objective

The objectives of this process evaluation embedded within a larger 2wT expansion trial were to (1) explore 2wT client preferences, including client satisfaction, with WhatsApp or SMS; (2) examine response rates (participation) by SMS and WhatsApp; and (3) gather feedback from the 2wT implementation team on the WhatsApp approach.

Methods

Males aged 15 years and older undergoing voluntary medical male circumcision in program sites could choose their follow-up approach, selecting 2wT via SMS or WhatsApp or routine care (in-person postoperative visits). The 2wT system provided 1-way educational messages and an open 2-way communication channel between providers and clients. We analyzed quantitative data from the 2wT database on message delivery platforms (WhatsApp vs SMS), response rates, and user behaviors using chi-square tests, z tests, and t tests. The team conducted short phone calls with WhatsApp and SMS clients about their perceptions of this 2wT platform using a short, structured interview guide. We consider informal reflections from the technical team members on the use of WhatsApp. We applied an implementation science lens using the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to focus results on practice and policy improvement.

Results

Over a 2-month period—from August to October, 2023—337 males enrolled in 2wT and were offered WhatsApp or SMS and were included in the analysis. For 2wT reach, 177 (53%) participants chose WhatsApp as their platform (P=.38). Mean client age was 30 years, and 253 (75%) participants chose English for automated messages. From quality assurance calls, almost all respondents (87/89, 98%) were happy with the way they were followed up. For effectiveness, on average for the days on which responses were requested, 58 (33%) WhatsApp clients and 44 (28%) SMS clients responded (P=.50). All 2wT team members believed WhatsApp limited the automated message content, language choices, and inclusivity as compared with the SMS-based 2wT approach.

Conclusions

When presented with a choice of 2wT communication platform, clients appear evenly split between SMS and WhatsApp. However, WhatsApp requires a smartphone and data plan, potentially reducing reach at scale. Clients using both platforms responded to 2wT interactive prompts, demonstrating similar effectiveness in engaging clients in follow-up. For telehealth interventions, digital health designers should maintain an SMS-based platform and carefully consider adding WhatsApp as an option for clients, using an implementation science approach to present evidence that guides the best implementation approach for their setting.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Digital communication between mothers and community health workers to support neonatal health (CHV-NEO): study protocol for a randomized controlled trial

Authors:

Keshet Ronen, Lincoln C. Pothan, Violet Apondi, Felix A. Otieno, Daniel Mwakanema, Felix O. Otieno, Lusi Osborn, Julia C. Dettinger, Priyanka Shrestha, Helena Manguerra, Ferdinand Mukumbang, Millicent Masinde, Evelyn Waweru, Mercy Amulele, Christine Were, Beatrice Wasunna, Grace John-Stewart, Bryan Weiner, Arianna Rubin Means, Barbra A. Richardson, Anna B. Hedstrom, Jennifer A. Unger & John Kinuthia

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2024

Read the full text in the open access journal Trials

Abstract:

Background

Provision of essential newborn care at home, rapid identification of illness, and care-seeking by caregivers can prevent neonatal mortality. Mobile technology can connect caregivers with information and healthcare worker advice more rapidly and frequently than healthcare visits. Community health workers (CHWs) are well-suited to deliver such interventions. We developed an interactive short message service (SMS) intervention for neonatal health in Kenya, named CHV-NEO. CHV-NEO sends automated, theory-based, actionable, messages throughout the peripartum period that guide mothers to evaluate maternal and neonatal danger signs and facilitate real-time dialogue with a CHW via SMS. We integrated this intervention into Kenya’s national electronic community health information system (eCHIS), which is currently used at scale to support CHW workflow.

Methods

The effect of CHV-NEO on clinical and implementation outcomes will be evaluated through a non-blinded cluster randomized controlled trial. Twenty sites across Kisumu County in Western Kenya were randomized 1:1 to provide either the national eCHIS with integrated CHV-NEO messaging (intervention) or standard of care using eCHIS without CHV-NEO (control). We will compare neonatal mortality between arms based on abstracted eCHIS data from 7200 pregnant women. Secondary outcomes include self-reported provision of essential newborn care (appropriate cord care, thermal care, and timely initiation of breastfeeding), knowledge of neonatal danger signs, and care-seeking for neonatal illness, compared between arms based on questionnaires with a subgroup of 2000 women attending study visits at enrollment in pregnancy and 6 weeks postpartum. We will also determine CHV-NEO’s effect on CHW workflows and evaluate determinants of intervention acceptability, adoption, and fidelity of use through questionnaires, individual interviews, and messaging data.

Discussion

We hypothesize that the CHV-NEO direct-to-client communication strategy can be successfully integrated within existing CHW workflows and infrastructure, improve the provision of at-home essential newborn care, increase timely referral of neonatal illness to facilities, and reduce neonatal mortality. The intervention’s integration into the national eCHIS tool will facilitate rapid scale-up if it is clinically effective and successfully implemented.

Trial registration

ClinicalTrials.gov, NCT05187897. The CHV-NEO study was registered on January 12, 2022.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**