Skip to content

✪ Are we being equitable enough? Lessons learned from sites lost in an implementation trial

Authors:

Elizabeth J Austin, Jessica Chen, Lori Ferro, Andrew J Saxon, John C Fortney, Geoffrey M Curran, Anna D Ratzliff, & Emily C Williams

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2024

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

There is a growing interest in practice-based implementation research, yet too often research prioritizes and is most successful in academic settings. During a national implementation trial to evaluate the effectiveness of Collaborative Care for co-occurring opioid use and mental health disorders, we lost three of our 11 participating implementation sites, all representing community sites.

Method

To better understand needed supports for implementation trial participation, we conducted exit interviews (n = 5) with key staff at these community sites. Interview transcripts were double-coded and analyzed using Rapid Assessment Process. Qualitative themes were iteratively reviewed by the study team.

Results

Three themes emerged characterizing challenges for community sites, including that: (1) research threatens sites’ most precious resource—staff; (2) staff lack comfort with and skills for research; and (3) research participation in its current form does not offer a clear return on investment.

Conclusions

Learnings from this work illuminate some of the barriers community sites face when trying to participate in multisite implementation research. An undercurrent of participant perspectives was the belief that community sites like theirs are just not set up to successfully participate in clinical trial research, including population-based implementation trials. Future implementation trials should consider strategies that disrupt traditional approaches, increasing the equitable inclusion of diverse practice settings in implementation research.

Plain Language Summary

There is a growing interest in research that reflects community settings. Yet too often, research is most successful in academic settings. During a national implementation trial to evaluate the effectiveness of Collaborative Care for co-occurring opioid use and mental health disorders, we lost three of our 11 participating implementation sites, all representing community sites. To better understand their perspectives, we conducted exit interviews (n = 5) with staff at these community sites. Interview transcripts were double-coded and analyzed using thematic analysis. Analysis identified three themes: (1) research threatens sites’ most precious resource—staff; (2) staff lack comfort with and skills for research, and (3) research participation in its current form does not offer a clear return on investment. Community sites face many barriers to participating in implementation research trials. Future trials should consider ways to disrupt traditional approaches and increase the equitable inclusion of community settings in implementation research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Team-focused implementation strategies to improve implementation of mental health screening and referral in rural Children’s Advocacy Centers: study protocol for a pilot cluster randomized hybrid type 2 trial

Authors:

Elizabeth A. McGuier, Gregory A. Aarons, Jaely D. Wright, John C. Fortney, Byron J. Powell, Scott D. Rothenberger, Laurie R. Weingart, Elizabeth Miller & David J. Kolko

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Children’s Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs’ capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings.

Methods

We will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers’ understanding of their child’s mental health needs and caregivers’ intentions to initiate mental health services (effectiveness aim).

Conclusions

Targeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Improving the Usability of Written Exposure Therapy for Therapists in the Department of Veterans Affairs Telemental Health: Formative Study Using Qualitative and User-Centered Design Methods

Authors:

Megan Moldestad, Valentina V Petrova, Katie Tirtanadi, Sonali R Mishra, Suparna Rajan, George Sayre, John C Fortney & Heather Schacht Reisinger

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

User modifications are common in evidence-based psychosocial interventions (EBPIs) for mental health disorders. Often, EBPIs fit poorly into clinical workflows, require extensive resources, or pose considerable burden to patients and therapists. Implementation science is increasingly researching ways to improve the usability of EBPIs before implementation. A user-centered design can be used to support implementation methods to prioritize user needs and solutions to improve EBPI usability.

Objective

Trauma-focused EBPIs are a first-line treatment for patients with posttraumatic stress disorder (PTSD) in the Department of Veterans Affairs. Written exposure therapy (WET) is a brief, trauma-focused EBPI wherein patients handwrite about trauma associated with their PTSD. Initially developed for in-person delivery, WET is increasingly being delivered remotely, and outcomes appear to be equivalent to in-person delivery. However, there are logistical issues in delivering WET via video. In this evaluation, we explored usability issues related to WET telehealth delivery via videoconferencing software and designed a solution for therapist-facing challenges to systematize WET telehealth delivery.

Methods

In the Discover phase, both groups had challenges delivering WET and other PTSD therapies via telehealth because of technology issues with videoconferencing software, environmental distractions, and workflow disruptions. Narrative transfer (ie, patients sending handwritten trauma accounts to therapists) was the first target for design solution development as it was deemed most critical to WET delivery. In the Design and Build phase, we identified design constraints and brainstormed solution ideas. This led to the development of 3 solution workflows that were presented to a subgroup of therapist users through cognitive walkthroughs. Meetings with this subgroup allowed workflow refinement to improve narrative transfers. Finally, to facilitate using these workflows, we developed PDF manuals that are being refined in subsequent phases of the implementation project (not mentioned in this paper).

Results

In the Discover phase, both groups had challenges delivering WET and other PTSD therapies via telehealth because of technology issues with videoconferencing software, environmental distractions, and workflow disruptions. Narrative transfer (ie, patients sending handwritten trauma accounts to therapists) was the first target for design solution development as it was deemed most critical to WET delivery. In the Design and Build phase, we identified design constraints and brainstormed solution ideas. This led to the development of 3 solution workflows that were presented to a subgroup of therapist users through cognitive walkthroughs. Meetings with this subgroup allowed workflow refinement to improve narrative transfers. Finally, to facilitate using these workflows, we developed PDF manuals that are being refined in subsequent phases of the implementation project (not mentioned in this paper).

Conclusion

The Discover, Design and Build, and Test framework can be a useful tool for understanding user needs in complex EBPI interventions and designing solutions to user-identified usability issues. Building on this work, an iterative evaluation of the 3 solution workflows and accompanying manuals with therapists and patients is underway as part of a nationwide WET implementation in telehealth settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Provider Perspectives on Implementing Shared Decision Making for PTSD Treatment in VA Primary Care

Authors:

Jessica A. Chen, Theresa E. Matson, Keren Lehavot, Patrick J. Raue, Jessica P. Young, Molly C. Silvestrini, John C. Fortney, & Emily C. Williams

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2021

Read the full text in the subscription access journal Administration and Policy in Mental Health and Mental Health Services Research

✪ Using implementation facilitation to implement primary care mental health integration via clinical video telehealth in rural clinics: protocol for a hybrid type 2 cluster randomized stepped-wedge design

Authors:

Richard R. Owen, Eva N. Woodward, Karen L. Drummond, Tisha L. Deen, Karen Anderson Oliver, Nancy J. Petersen, Scott S. Meit, John C. Fortney, & JoAnn E. Kirchner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2019

Read the full text in the open access journal Implementation Science

Abstract:

Background

Integrating mental health providers into primary care clinics improves access to and outcomes of mental health care. In the Veterans Health Administration (VA) Primary Care Mental Health Integration (PCMHI) program, mental health providers are co-located in primary care clinics, but the implementation of this model is challenging outside large VA medical centers, especially for rural clinics without full mental health staffing. Long wait times for mental health care, little collaboration between mental health and primary care providers, and sub-optimal outcomes for rural veterans could result. Telehealth could be used to provide PCMHI to rural clinics; however, the clinical effectiveness of the tele-PCMHI model has not been tested. Based on evidence that implementation facilitation is an effective implementation strategy to increase uptake of PCMHI when delivered on-site at larger VA clinics, it is hypothesized that this strategy may also be effective with regard to ensuring adequate uptake of the tele-PCMHI model at rural VA clinics.

Methods

This study is a hybrid type 2 pragmatic effectiveness-implementation trial of tele-PCMHI in six sites over 24 months. Tele-PCMHI, which will be delivered by clinical staff available in routine care settings, will be compared to usual care. Fidelity to the care model will be monitored but not controlled. We will use the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to evaluate the patient-level clinical effectiveness of tele-PCMHI in rural VA clinics and also to evaluate the fidelity to and outcomes of the implementation strategy, implementation facilitation. The proposed study will employ a stepped-wedge design in which study sites sequentially begin implementation in three steps at 6-month intervals. Each step will include (1) a 6-month period of implementation planning, followed by (2) a 6-month period of active implementation, and (3) a final period of stepped-down implementation facilitation.

Discussion

This study will evaluate the effectiveness of PCMHI in a novel setting and via a novel method (clinical video telehealth). We will test the feasibility of using implementation facilitation as an implementation strategy to deploy tele-PCMHI in rural VA clinics.

Trial registration

ClinicalTrials.gov registration number NCT02713217. Registered on 18 March 2016.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**