User-centered design Archives - Page 2 of 3 - Implementation Science at UW

✪ Integrating a mental health intervention into PrEP services for South African young women: a human-centered implementation research approach to intervention development

Abstract:

Introduction

Adolescent girls and young women (AGYW) who may benefit from HIV pre-exposure prophylaxis (PrEP) face high levels of common mental disorders (e.g. depression, anxiety). Common mental disorders can reduce PrEP adherence and increase HIV risk, yet mental health interventions have not been well-integrated into PrEP delivery.

Methods

We conducted a four-phase human-centered design process, from December 2020 to April 2022, to understand mental health challenges among AGYW in Johannesburg, South Africa and barriers to integrated mental health and PrEP services. In the “Discover” phase, we conducted in-depth interviews with AGYW and key informants (KIs) in Johannesburg. We conducted a rapid qualitative analysis, informed by the Consolidated Framework for Implementation Research (CFIR), to identify facilitators and barriers of integrated mental health and PrEP services and mapped barriers to potential implementation strategies. In the “Design” and “Build” phases, we conducted stakeholder workshops to iteratively adapt an evidence-based mental health intervention, the Friendship Bench, and refine implementation strategies for South African PrEP delivery settings. In the “Test” phase, we piloted our adapted Friendship Bench package.

Results

Interviews with 70 Discover phase participants (48 AGYW, 22 KIs) revealed the importance of integrated mental health and PrEP services for South African AGYW. Interviewees described barriers and implementation strategies for mental health and PrEP services around the CFIR domains: intervention characteristics (e.g. challenges with AGYW “opening up”); outer Johannesburg setting (e.g. community stigma); inner clinic setting (e.g. judgmental healthcare providers); characteristics of counsellors (e.g. training gaps); and the implementation process (e.g. need for demand creation). The Design and Build workshops included 13 AGYW and 15 KIs. Implementation barriers related to the quality and accessibility of public-sector clinic services, lay counsellor training, and community education and demand creation activities were prioritized. This led to 12 key Friendship Bench adaptations and the specification of 10 implementation strategies that were acceptable and feasible in initial pilot testing with three AGYW.

Conclusions

Using a human-centered approach, we identified determinants and potential solutions for integrating mental health interventions within PrEP services for South African AGYW. This design process centered stakeholders’ perspectives, enabling rapid development of an adapted Friendship Bench intervention implementation package.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): a modified Delphi study

Abstract:

Background

Intervention adaptation is often necessary to improve the fit between evidence-based practices/programs and implementation contexts. Existing frameworks describe intervention adaptation processes but do not provide detailed steps for prospectively designing adaptations, are designed for researchers, and require substantial time and resources to complete. A pragmatic approach to guide implementers through developing and assessing adaptations in local contexts is needed. The goal of this project was to develop Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI), a method for intervention adaptation that leverages human centered design methods and is tailored to the needs of intervention implementers working in applied settings with limited time and resources.

Method

MODIFI was iteratively developed via a mixed-methods modified Delphi process. Feedback was collected from 43 implementation research and practice experts. Two rounds of data collection gathered quantitative ratings of acceptability and inclusion (Round 1) and feasibility (Round 2), as well as qualitative feedback regarding MODIFI revisions analyzed using conventional content analysis.

Results

In Round 1, most participants rated all proposed components as essential but identified important avenues for revision which were incorporated into MODIFI prior to Round 2. Round 2 emphasized feasibility, where ratings were generally high and fewer substantive revisions were recommended. Round 2 changes largely surrounded operationalization of terms/processes and sequencing of content. Results include a detailed presentation of the final version of the three-step MODIFI method (Step 1: Learn about the users, local context, and intervention; Step 2: Adapt the intervention; Step 3: Evaluate the adaptation) along with a case example of its application.

Discussion

MODIFI is a pragmatic method that was developed to extend the contributions of other research-based adaptation theories, models, and frameworks while integrating methods that are tailored to the needs of intervention implementers. Guiding teams to tailor evidence-based interventions to their local context may extend for whom, where, and under what conditions an intervention can be effective.

Contributions to the literature

Adaptation of evidence-based practices, programs, and treatments is often needed to ensure successful implementation. However, existing theories/models/frameworks do not outline concrete adaptation steps that are feasible for real-world settings.
We created a resource-efficient method (MODIFI) for developing and assessing intervention adaptations in local settings. This method was iteratively developed through a mixed-methods modified Delphi process, which resulted in consensus among experts in implementation science and practice.
MODIFI leverages human centered design techniques and is tailored to the needs of intervention implementers in applied settings, filling a crucial gap in the research to practice pipeline.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Development of a method for Making Optimal Decisions for Intervention Flexibility during Implementation (MODIFI): a modified Delphi study

Abstract:

Background

Method

Results

Discussion

Contributions to the literature

Adaptation of evidence-based practices, programs, and treatments is often needed to ensure successful implementation. However, existing theories/models/frameworks do not outline concrete adaptation steps that are feasible for real-world settings.
We created a resource-efficient method (MODIFI) for developing and assessing intervention adaptations in local settings. This method was iteratively developed through a mixed-methods modified Delphi process, which resulted in consensus among experts in implementation science and practice.
MODIFI leverages human centered design techniques and is tailored to the needs of intervention implementers in applied settings, filling a crucial gap in the research to practice pipeline.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ “A problem shared is a problem solved:” integrating human-centered design and implementation science to optimize lay counselor supervision in Western Kenya

Abstract:

Implementation science and human-centered design (HCD) offer useful frameworks and methods for considering and designing for individuals' needs and preferences when implementing new interventions or technologies in global health. When used in tandem, the two approaches may blend creative and partnered research methods with a focus on the factors necessary to design, implement, and sustain interventions. However, research is needed that describes the process of blending these two approaches and explores the experiences of community partners. This study builds from a stepped-wedge cluster-randomized trial in Western Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy (TF-CBT). Mobile phones emerged as a tool to supervise lay counselors from afar; however, their use was characterized by unique challenges. Informed by human-centered design and implementation science, we first engaged lay counselors (n = 24) and supervisors (n = 3) in individual semi-structured interviews then hosted an in-person participatory workshop to “co-design” solutions to optimize the use of mobile phone supervision. Lay counselors participated in focus group discussions regarding their experiences in the workshop. Focus group transcripts were analyzed using thematic analysis. We describe our approach as well as focus group discussion results. Counselors felt the workshop was a valuable experience to learn new strategies from their colleagues, and they enjoyed the “collaborative spirit” that emerged as they worked together. Counselors felt that varying small and large group discussions fostered participation by creating opportunities for more people to engage and share their thoughts. Counselors suggested the approach be improved by providing more tangible materials (e.g., hand-outs) and more closely following a schedule of activities. It is important to also center stakeholders’ experiences as partners in the research process. Though counselors largely expressed positive sentiments, they also shared valuable suggestions for how to improve participatory research practices in the future.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Helping Educational Leaders Mobilize Evidence (HELM): The iterative redesign of the Leadership and Organizational Change for Implementation (LOCI) intervention for use in schools

Abstract:

Background

Few “intervention agnostic” strategies have been developed that can be applied to the broad array of evidence-based practices (EBPs) in schools. This paper describes two studies that reflect the initial iterative redesign phases of an effective leadership-focused implementation strategy—Leadership and Organizational Change for Implementation (LOCI)—to ensure its acceptability, feasibility, contextual appropriateness, and usability when used in elementary schools. Our redesigned strategy—Helping Educational Leaders Mobilize Evidence (HELM)—is designed to improve principals’ use of strategic implementation leadership to support the adoption and high-fidelity delivery of a universal EBP to improve student outcomes.

Method

In Study 1, focus groups were conducted (n = 6) with 54 district administrators, principals, and teachers. Stakeholders provided input on the appropriateness of original LOCI components to maximize relevance and utility in schools. Transcripts were coded using conventional content analysis. Key themes referencing low appropriateness were summarized to inform LOCI adaptations. We then held a National Expert Summit (Study 2) with 15 research and practice experts. Participants provided feedback via a nominal group process (NGP; n = 6 groups) and hackathon (n = 4 groups). The research team rated each NGP suggestion for how actionable, impactful/effective, and feasible it was. We also coded hackathon notes for novel ideas or alignment with LOCI components.

Results

Study 1 suggestions included modifications to LOCI content and delivery. Study 2's NGP results revealed most recommendations to be actionable, impactful/effective, and feasible. Hackathon results surfaced two novel ideas (distributed leadership teams and leaders’ knowledge to support educators EBP use) and several areas of alignment with LOCI components.

Conclusion

Use of these iterative methods informed the redesign of LOCI and the development of HELM. Because it was collaboratively constructed, HELM has the potential to be an effective implementation strategy to support the use of universal EBP in schools.

Plain Language Summary

Our research team designed a strategy (HELM) for school principals to improve the support they provide to staff to implement practices proven to work in research for improving student outcomes. We designed HELM by conducting focus groups with school district administrators, principals, and teachers. Participants were asked for their feedback on how to adapt an existing leadership strategy (LOCI) to the school context. After collecting this feedback, we held a meeting with 15 research and practice experts. During this meeting, the group of experts reviewed the focus group feedback and decided how to incorporate it into the design of the HELM strategy. We believe that collecting this feedback and involving research and practice experts in interpreting and integrating participant feedback into the HELM strategy will make HELM a more effective strategy for supporting school principals’ in implementing supports in their schools.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Leveraging human-centered design and causal pathway diagramming toward enhanced specification and development of innovative implementation strategies: a case example of an outreach tool to address racial inequities in breast cancer screening

Abstract:

Background

Implementation strategies are strategies to improve uptake of evidence-based practices or interventions and are essential to implementation science. Developing or tailoring implementation strategies may benefit from integrating approaches from other disciplines; yet current guidance on how to effectively incorporate methods from other disciplines to develop and refine innovative implementation strategies is limited. We describe an approach that combines community-engaged methods, human-centered design (HCD) methods, and causal pathway diagramming (CPD)—an implementation science tool to map an implementation strategy as it is intended to work—to develop innovative implementation strategies.

Methods

We use a case example of developing a conversational agent or chatbot to address racial inequities in breast cancer screening via mammography. With an interdisciplinary team including community members and operational leaders, we conducted a rapid evidence review and elicited qualitative data through interviews and focus groups using HCD methods to identify and prioritize key determinants (facilitators and barriers) of the evidence-based intervention (breast cancer screening) and the implementation strategy (chatbot). We developed a CPD using key determinants and proposed strategy mechanisms and proximal outcomes based in conceptual frameworks.

Results

We identified key determinants for breast cancer screening and for the chatbot implementation strategy. Mistrust was a key barrier to both completing breast cancer screening and using the chatbot. We focused design for the initial chatbot interaction to engender trust and developed a CPD to guide chatbot development. We used the persuasive health message framework and conceptual frameworks about trust from marketing and artificial intelligence disciplines. We developed a CPD for the initial interaction with the chatbot with engagement as a mechanism to use and trust as a proximal outcome leading to further engagement with the chatbot.

Conclusions

The use of interdisciplinary methods is core to implementation science. HCD is a particularly synergistic discipline with multiple existing applications of HCD to implementation research. We present an extension of this work and an example of the potential value in an integrated community-engaged approach of HCD and implementation science researchers and methods to combine strengths of both disciplines and develop human-centered implementation strategies rooted in causal perspective and healthcare equity.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Centering School Leaders’ Expertise: Usability Evaluation of a Leadership-Focused Implementation Strategy to Support Tier 1 Programs in Schools

Abstract:

Although there are a growing number of implementation strategies to increase the adoption, fidelity, and sustainment of evidence-based practices (EBP), they are often complex and bulky, which can interfere with their widespread application. To address these challenges, the Helping Educational Leaders Mobilize Evidence (HELM) strategy was created as an adaptation of the evidence-based Leadership and Organizational Change for Implementation (LOCI) implementation strategy to enhance elementary school principals’ use of strategic implementation leadership to support the adoption and delivery of Tier 1 (i.e., universal social, emotional, and behavioral) EBP. In service of its iterative development, a human-centered design methodology was employed to increase the successful uptake and use of HELM. The Cognitive Walkthrough for Implementation Strategies (CWIS), a novel mixed-methods approach to evaluate implementation strategy usability, was applied to identify and test HELM strategy tasks of critical importance. A sample of 15 elementary school principals participated in group cognitive walkthrough testing as either school principal recipients or HELM coaches. Both user types rated the strategy as acceptable (principal M = 77.8, SD = 15.5; coach M = 87.5, SD = 7.9). Five usability issues were identified using a highly structured common usability issue framework and provided direction for the generation of redesign solutions to be incorporated in a subsequent version of the HELM strategy. The evaluation of the strategy’s usability improved its alignment with user needs, expectations, and contextual constraints, rendering a more usable strategy and broadly applicable information surrounding the development of psychosocial implementation strategies in real-world settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes, Katherine Ritchey

Abstract:

Introduction

Falls in nursing homes are a major cause for decreases in residents’ quality of life and overall health. This study aims to reduce resident falls by implementing the LOCK Falls Programme, an evidence-based quality improvement intervention. The LOCK Falls Programme involves the entire front-line care team in (1) focusing on evidence of positive change, (2) collecting data through systematic observation and (3) facilitating communication and coordination of care through the practice of front-line staff huddles.

Methods and analysis

The study protocol describes a mixed-methods, 4-year hybrid (type 2) effectiveness-implementation study in State Veterans Homes in the USA. The study uses a pragmatic stepped-wedge randomised trial design and employs relational coordination theory and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to guide implementation and evaluation. A total of eight State Veterans Homes will participate and data will be collected over an 18-month period. Administrative data inclusive of all clinical assessments and Minimum Data Set assessments for Veterans with a State Veterans Home admission or stay during the study period will be collected (8480 residents total). The primary outcome is a resident having any fall. The primary analysis will be a partial intention-to-treat analysis using the rate of participants experiencing any fall. A staff survey (n=1200) and qualitative interviews with residents (n=80) and staff (n=400) will also be conducted. This research seeks to systematically address known barriers to nursing home quality improvement efforts associated with reducing falls.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Acceptability and Utility of a Digital Group Intervention to Prevent Perinatal Depression in Youths via Interactive Maternal Group for Information and Emotional Support (IMAGINE): Pilot Cohort Study

Abstract:

Background

Perinatal depression (depression during pregnancy or the first year postpartum) affects 10%-25% of perinatal individuals, with a higher risk among youths aged <25 years. The Mothers and Babies Course (MB) is an evidence-based intervention for the prevention of perinatal depression, grounded in cognitive behavioral therapy, attachment theory, and psychoeducation.

Objective

We developed a digital adaptation of MB (Interactive Maternal Group for Information and Emotional Support [IMAGINE]) and evaluated it in a pre-post mixed methods pilot among young perinatal people in the United States

Methods

IMAGINE was a structured digital group of up to 7 participants, with scheduled MB content and open discussion for 12 weeks, facilitated by a social worker. Scheduled content included asynchronous SMS text messages, graphics, prerecorded videos, mood polls, and optional weekly synchronous video calls. Eligible participants were pregnant or ≤80 days postpartum, aged 16 to 24 years, had access to a smartphone, spoke English, and had a Patient Health Questionnaire score <10. Participants were recruited throughout the United States from August 2020 to January 2021 through paid social media ads, in-person outreach at clinics, and respondent-driven sampling. Participants completed quantitative questionnaires at enrollment and 3 months, and qualitative interviews at 3 months. We determined uptake, acceptability (by Acceptability of Intervention Measure score), and utility (by use of cognitive behavioral therapy skills). We compared depression symptoms (by Patient Health Questionnaire score), social support (by abbreviated Social Support Behavior score), and perceived stress (by Perceived Stress Score) between enrollment and follow-up by paired 2-tailed t test.

Results

Among 68 individuals who contacted this study, 22 were screened, 13 were eligible, and 10 enrolled, for an uptake of 76.9%. Furthermore, 4 (40%) participants were pregnant at enrollment. Participants had a median age of 17.9 (IQR 17.4-21.7) years, 6 (67%) identified as Black, 5 (56%) Latinx, and 6 (67%) using Medicaid health insurance. Further, 9 (90%) participants completed follow-up. Among these, the mean acceptability score was 4.3 out of 5 (SD 0.6) and all participants said they would recommend IMAGINE to a friend. Participants reported using a median of 7 of 11 skills (IQR 5-7 skills) at least half the days. We found no significant changes in depression symptoms, perceived stress, or social support. Qualitatively, participants reported one-to-one support from the facilitator, connection with other parents, and regular mood reflection were especially helpful aspects of the intervention. Additionally, participants reported that the intervention normalized their mental health challenges, improved their ability to manage their mood, and increased their openness to mental health care.

Conclusions

This pilot study provides promising evidence of the acceptability and utility of IMAGINE among perinatal youths. Our study’s small sample size did not detect changes in clinical outcomes; our findings suggest IMAGINE warrants larger-scale evaluation.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ An implementation strategy package (video education, HIV self-testing, and co-location) improves PrEP implementation for pregnant women in antenatal care clinics in western Kenya

Abstract:

Background

Pre-exposure prophylaxis (PrEP) is recommended by the World Health Organization and the Kenyan Ministry of Health for HIV prevention in pregnancy and postpartum for women at risk for HIV. Integration of PrEP into antenatal care is promising, but delivery gaps exist in the face of healthcare provider shortages in resource-limited settings.

Methods

Between May and November 2021, we conducted a difference-in-differences study (3 months pre-intervention data collection and 3 months post-intervention data collection) analyzing four intervention facilities, where the strategies were implemented, and four comparison facilities, where no strategies were implemented. We tested a combination of three implementation strategies—video-based PrEP information in the waiting bay, HIV self-testing, and dispensing of PrEP in the antenatal care rooms—to improve PrEP delivery. We compared absolute changes in the proportion of antenatal attendees screened for PrEP (PrEP penetration), the proportion receiving all PrEP-specific steps in a visit (HIV testing, risk screening, and PrEP counseling) (PrEP fidelity), and client PrEP knowledge, client satisfaction, and waiting time and service time (a priori outcomes); post hoc, we compared the proportion offered PrEP (PrEP offer) and completing HIV testing. We measured provider perceptions of the acceptability and appropriateness of the implementation strategies.

Results

We observed significant improvements in PrEP penetration, PrEP offer, satisfaction, and knowledge (p < 0.05) and improvements in fidelity that trended towards significance (p = 0.057). PrEP penetration increased 5 percentage points (p = 0.008), PrEP fidelity increased 8 percentage points (p = 0.057), and PrEP offer increased 4 percentage points (p = 0.003) in intervention vs. comparison facilities. Client PrEP knowledge increased by 1.7 out of 6 total points (p < 0.001) and client satisfaction increased by 0.7 out of 24 total points (p = 0.003) in intervention vs. comparison facilities. We observed no changes in service time (0.09-min decrease; p = 0.435) and a small increase in waiting time (0.33-min increase; p = 0.005). HIV testing among those eligible did not change (1.5 percentage point decrease, p = 0.800). Providers felt the implementation strategies were acceptable and appropriate (median acceptability: 20/20; median appropriateness: 19.5/20). However, absolute levels of each step of the PrEP cascade remained suboptimal

Conclusions

An implementation strategy package with video information, HIV self-testing, and co-location of medication dispensing enhanced PrEP delivery across several implementation outcomes and client satisfaction, while not substantially increasing wait time or decreasing provider-client contact time.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text open access in the Journal of the International AIDS Society

Abstract:

Introduction

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Method

Results

Discussion

Contributions to the literature

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Method

Results

Discussion

Contributions to the literature

Authors:

✪ Open Access

Read the full text in the open access journal Social Science and Medicine - Mental Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Method

Results

Conclusion

Plain Language Summary

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the journal School Mental Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Methods and analysis

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Reproductive Health

Abstract:

Background

Methods

Results

Conclusions