Skip to content
Implementation Science at UW

Keywords: Rapid Ethnography

✪ Methods for community-engaged data collection and analysis in implementation research

Authors:

Lawrence A. Palinkas, Benjamin Springgate, Leopoldo J. Cabassa, Michelle Shin, Samantha Garcia, Benjamin F. Crabtree & Jennifer Tsui

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2025

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Community engagement is widely recognized as critical to successful and equitable implementation of evidence-based practices, programs, and policies. However, there are no clear guidelines for community involvement in data collection and analysis in implementation research.

Methods

We describe three specific methods for engaging community members in data collection and analysis: concept mapping, rapid ethnographic assessment, and Photovoice. Common elements are identified from a case study of each method: 1) selection and adaptation of evidence-based strategies for improving adolescent HPV vaccine initiation rates in disadvantaged communities, 2) strategies for implementing medication for opioid use disorders among low-income Medicaid enrollees during natural disasters, and 3) interventions to improve the physical health of adults with severe mental illness living in supportive housing.

Results

In all three cases, community members assisted in participant recruitment, provided data, and validated preliminary findings created by researchers. In the Photovoice case study, community members participated in both data collection and analysis, while in the concept mapping, community members also participated in the initial phase of organizing and prioritizing evidence-based strategies during the data analysis.

Conclusions

Community involvement in implementation research data collection and analysis contributes to greater engagement and empowerment of community members and validation of study findings. Use of methods that exhibit both scientific rigor and community relevance of implementation research also contributes to greater community investment in successful implementation outcomes. Nevertheless, the case studies point to the importance and efficiency of the division of labor embedded in community-engaged implementation research. Building capacity for community members to assume greater roles in obtaining and organizing data for preliminary analysis prior to interpretation is recommended.

Contributions to the literature

  • Guidelines exist for conducting community engaged research but provide no clear instructions for community involvement in data collection and analysis.
  • This paper examines the potential of community engaged data collection and analysis in implementation research through case studies of concept mapping, rapid ethnographic methods, and Photovoice.
  • Community involvement in implementation research data collection and analysis contributes to greater engagement and empowerment of community members, validation of study findings, and commitment to successful implementation outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Team Coaching Intervention for Dementia Care: Acceptability and Feasibility Study in Care Communities

Authors:

Jessica Welsch, Boeun Kim, Lorna Prophater, Basia Belza, & Sam Fazio

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2024

Read the full text open access in the Journal of the American Medical Directors Association

Abstract:

Objectives

In 2018, the Alzheimer's Association published the Dementia Care Practice Recommendations (DCPR) to provide guidance on quality care for professionals. This study aimed to examine the feasibility and acceptability of a consultative coaching program to increase adoption of the DCPR.

Design

A single-group pre-post design was employed. A 6-month team coaching intervention was implemented to make organization-wide and measurable changes in the areas of (1) policies and procedures, (2) education and training, or (3) care practices to increase person-centered care practices.

Setting and Participants

A total of 36 care communities in Washington and Montana states were enrolled in this program.

Methods

Focus groups were conducted with participants to explore the acceptability and feasibility of the program. A 35-item employees satisfaction survey was administered both before and after the program.

Results

The findings offer preliminary evidence that implementing a coaching program is desired by care community staff and has a positive impact on staff job satisfaction and the use of person-centered care. The coaching model was received by staff as a supportive and affirming program.

Conclusions and Implications

The team coaching intervention, designed to improve person-centered care and employee satisfaction, is acceptable. However, its efficacy needs to be tested with a larger sample using a randomized controlled design.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Integrating a mental health intervention into PrEP services for South African young women: a human-centered implementation research approach to intervention development

Authors:

Jennifer Velloza, Nomhle Ndimande-Khoza, Lisa Mills, Tessa Concepcion, Sanele Gumede, Hlukelo Chauke, Ruth Verhey, Dixon Chibanda, Sybil Hosek, Bryan J. Weiner, Connie Celum, Sinead Delany-Moretlwe

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2024

Read the full text open access in the Journal of the International AIDS Society

Abstract:

Introduction

Adolescent girls and young women (AGYW) who may benefit from HIV pre-exposure prophylaxis (PrEP) face high levels of common mental disorders (e.g. depression, anxiety). Common mental disorders can reduce PrEP adherence and increase HIV risk, yet mental health interventions have not been well-integrated into PrEP delivery.

Methods

We conducted a four-phase human-centered design process, from December 2020 to April 2022, to understand mental health challenges among AGYW in Johannesburg, South Africa and barriers to integrated mental health and PrEP services. In the “Discover” phase, we conducted in-depth interviews with AGYW and key informants (KIs) in Johannesburg. We conducted a rapid qualitative analysis, informed by the Consolidated Framework for Implementation Research (CFIR), to identify facilitators and barriers of integrated mental health and PrEP services and mapped barriers to potential implementation strategies. In the “Design” and “Build” phases, we conducted stakeholder workshops to iteratively adapt an evidence-based mental health intervention, the Friendship Bench, and refine implementation strategies for South African PrEP delivery settings. In the “Test” phase, we piloted our adapted Friendship Bench package.

Results

Interviews with 70 Discover phase participants (48 AGYW, 22 KIs) revealed the importance of integrated mental health and PrEP services for South African AGYW. Interviewees described barriers and implementation strategies for mental health and PrEP services around the CFIR domains: intervention characteristics (e.g. challenges with AGYW “opening up”); outer Johannesburg setting (e.g. community stigma); inner clinic setting (e.g. judgmental healthcare providers); characteristics of counsellors (e.g. training gaps); and the implementation process (e.g. need for demand creation). The Design and Build workshops included 13 AGYW and 15 KIs. Implementation barriers related to the quality and accessibility of public-sector clinic services, lay counsellor training, and community education and demand creation activities were prioritized. This led to 12 key Friendship Bench adaptations and the specification of 10 implementation strategies that were acceptable and feasible in initial pilot testing with three AGYW.

Conclusions

Using a human-centered approach, we identified determinants and potential solutions for integrating mental health interventions within PrEP services for South African AGYW. This design process centered stakeholders’ perspectives, enabling rapid development of an adapted Friendship Bench intervention implementation package.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE)

Authors:

Ruben G. Martinez, Bryan J. Weiner, Rosemary D. Meza, Shannon Dorsey, Lorella G. Palazzo, Abigail Matson, Carolyn Bain, Kayne D. Mettert, Michael D. Pullmann & Cara C. Lewis

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2024

Read the full text in the open access journal Implementation Science Communications

Abstract:

Introduction

For youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations’ challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings.

Methods

Pragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3).

Discussion

Optimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care

Authors:

Emily R. Haines, Alex Dopp, Aaron R. Lyon, Holly O. Witteman, Miriam Bender, Gratianne Vaisson, Danielle Hitch, & Sarah Birken

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2021

Read the full text in the open access journal Implementation Science Communications
BACK TO THE ARCHIVE

Abstract:

Background

Attempting to implement evidence-based practices in contexts for which they are not well suited may compromise their fidelity and effectiveness or burden users (e.g., patients, providers, healthcare organizations) with elaborate strategies intended to force implementation. To improve the fit between evidence-based practices and contexts, implementation science experts have called for methods for adapting evidence-based practices and contexts and tailoring implementation strategies; yet, methods for considering the dynamic interplay among evidence-based practices, contexts, and implementation strategies remain lacking. We argue that harmonizing the three can be facilitated by user-centered design, an iterative and highly stakeholder-engaged set of principles and methods.

Methods

This paper presents a case example in which we used a three-phase user-centered design process to design and plan to implement a care coordination intervention for young adults with cancer. Specifically, we used usability testing to redesign and augment an existing patient-reported outcome measure that served as the basis for our intervention to optimize its usability and usefulness, ethnographic contextual inquiry to prepare the context (i.e., a comprehensive cancer center) to promote receptivity to implementation, and iterative prototyping workshops with a multidisciplinary design team to design the care coordination intervention and anticipate implementation strategies needed to enhance contextual fit.

Results

Our user-centered design process resulted in the Young Adult Needs Assessment and Service Bridge (NA-SB), including a patient-reported outcome measure and a collection of referral pathways that are triggered by the needs young adults report, as well as implementation guidance. By ensuring NA-SB directly responded to features of users and context, we designed NA-SB for implementation, potentially minimizing the strategies needed to address misalignment that may have otherwise existed. Furthermore, we designed NA-SB for scale-up; by engaging users from other cancer programs across the country to identify points of contextual variation which would require flexibility in delivery, we created a tool intended to accommodate diverse contexts.

Conclusions

User-centered design can help maximize usability and usefulness when designing evidence-based practices, preparing contexts, and informing implementation strategies—in effect, harmonizing evidence-based practices, contexts, and implementation strategies to promote implementation and effectiveness.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**