Skip to content

Implementation of Alcohol-Related Care in 3 Veterans Health Administration Hepatology Clinics: A Mixed-Methods Summative Evaluation

Authors:

Emily C. Williams, Madeline C. Frost, Olivia V. Fletcher, Carol E. Achtmeyer, Jessica A. Chen, Rachel L. Bachrach, E. Jennifer Edelman, Bryan J. Weiner, George N. Ioannou, and Judith I. Tsui

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: August 2026

Read the full text subscription access in Substance Use & Addiction Journal

✪ Getting to Implementation: applying data-driven implementation strategies to improve guideline concordant surveillance for hepatocellular carcinoma

Authors:

Vera Yakovchenko, Chaeryon Kang, Brittney Neely, Carolyn Lamorte, Heather McCurdy, Dawn Scott, Anna Nobbe, Gwen Robins, Nsikak R. Ekanem, Monica Merante, Sandra Gibson, Patrick Spoutz, Linda Chia, Rachel I. Gonzalez, Matthew J. Chinman, David Ross, Maggie Chartier, Lauren A. Beste, Jasmohan S. Bajaj, Tamar Taddei, Timothy R. Morgan & Shari S. Rogal

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

While guidelines recommend twice-yearly liver cancer (hepatocellular carcinoma, HCC) surveillance for people with cirrhosis, adherence to these guidelines remains variable. We aimed to empirically identify and apply successful implementation strategies through Getting to Implementation (GTI), a manualized facilitation approach.

Method

A hybrid type III, stepped-wedge, cluster-randomized trial was conducted at 12 underperforming Veterans Health Administration (VA) sites between October 2020 and October 2022. GTI included a stepwise approach to guide sites to detail their current state, set implementation goals, identify implementation barriers, select implementation strategies, make a work plan, conduct an evaluation, and sustain their work. Outcomes were defined using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework.

Results

Facilitators supported site teams with an average of 20±6 facilitation hours over a 12-month period. Ten of 12 sites (83%) adopted GTI and applied a median of five strategies (e.g., dashboard use, small tests of change, direct patient outreach). Reach, the primary outcome, increased from mean 29.1% to mean 38.8% at-risk Veterans receiving HCC surveillance from pre- to post-intervention, and further increasing to 41.3% in the sustainment period. In both unadjusted and adjusted models, the odds of HCC surveillance were significantly higher during intervention (adjusted odds ratio, aOR=1.67, 95% CI:1.59, 1.75) and during sustainment (aOR=1.69, 95% CI:1.60, 1.78) compared with baseline, and with difference between active and sustainment periods, indicating sustained improvement after active facilitation ended.

Conclusions

GTI sustainably improved HCC surveillance, suggesting that applying data-driven implementation strategies within a manualized facilitation approach can improve care.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Tailored strategies to increase the use of an evidence-based psychotherapy for posttraumatic stress disorder: A stepped-wedge randomized trial in military clinics

Authors:

Craig S Rosen, Alan L Peterson, David S Riggs, Christopher K Haddock, Chunki Fong, Stacey Young-McCaughan, Jeffrey Cook, Katherine Anne Comtois, Elisa V Borah, C Adrian Davis, Katherine A Dondanville, Erin P Finley, Sara A Jahnke, Melissa Mistretta, Andrea Neitzer, Shannon Wiltsey-Stirman, Erin R Frick, Olivia Hayes, Spencer Clayton, Allison M Conforte, Araceli Flores, Jeremy Jinkerson , Zachary K Jones, Hana J Kim, Margaret Letendre, Jared S Link, Debra Nofziger, Erik N Ringdahl, John W Waggoner, Craig Woodworth, Emily Ho, Carmen P McLean & TACTICS Research Group

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: October 2025

Read the full text in the subscription access journal Journal of Anxiety Disorders

✪ Comparing the effectiveness of implementation strategies to improve liver and colon cancer screening for Veterans: protocol for a large cluster-randomized implementation study

Authors:

Shari S. Rogal, Vera Yakovchenko, Timothy R. Morgan, Jason A. Dominitz, Heather McCurdy, Anna Nobbe, Nsikak R. Ekanem, Chaeryon Kang, Rachel I. Gonzalez, Angela Park, Jennifer Anwar, Brittney Neely, Sandra Gibson, Carolyn Lamorte, Jasmohan S. Bajaj, Heather M. Patton, Yiwen Yao & Andrew J. Gawron

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2025

Read the full text in the open access journal Implementation Science

Abstract:

Background

Screening for gastrointestinal (GI) cancers, specifically colorectal cancer (CRC) and hepatocellular carcinoma (HCC), is often inadequately and inequitably implemented, leading to preventable morbidity and mortality. This protocol paper describes a study designed to compare the effectiveness of external facilitation with patient navigation across hospitals in the Veterans Health Administration (VA).

Methods

Two hybrid type 3, cluster-randomized trials will compare the effectiveness of patient navigation versus external facilitation for supporting HCC and CRC screening completion. Twenty-four sites will be included in the HCC trial and 32 in the CRC trial, cluster-randomizing Veterans by their site of primary care. The primary outcome of reach of cancer screening completion will be measured after intervention and during sustainment. Multi-level implementation determinants (i.e., barriers and facilitators), preconditions, and moderators will be evaluated pre- and post-intervention, using Consolidated Framework for Implementation Research (CFIR)-mapped surveys and interviews of Veteran participants and provider participants.

Discussion

Comparing findings in the two trials will allow researchers to understand how implementation barriers and strategies operate differently for a one-time screening in a relatively healthy population (CRC) vs. repeated screening in a more medically complex population (HCC).

Trial registration

This project was registered at ClinicalTrials.Gov (NCT06458998) on 6/13/24.

Contributions to the literature
  • This comparative effectiveness trial will compare two evidence-based implementation strategies to improve cancer screening reach.
  • Comparing a patient-facing to a clinician-facing approach will offer novel insights into what works and for whom.
  • This trial will assess mechanisms and heterogeneity of treatment effects to inform the science of implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Evaluating spoke facilitation costs of implementing TelePain in the Veterans Health Administration

Authors:

Alexandra L. Rose, Shaina Coogan, Jess Indresano, Steven B. Zeliadt & Jessica A. Chen

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

The high prevalence and significant morbidity and mortality associated with chronic pain among veterans has made expansion of pain services within the Veterans Health Administration (VHA) a key priority. TelePain, in which services are provided via telehealth from central “hub” sites to patients at decentralized “spoke” sites, is one such model with positive implementation findings to date. However, the staff effort and cost of implementation have yet to be examined when considering TelePain or similar virtual hub-and spoke models of specialty pain care, information that is critical for expansion of services.

Methods

Using an established time-based activity tracker designed for implementation facilitation, study staff tracked minutes spent on implementation activities at 11 spoke sites. Annual salaries were extracted to calculate an average cost per minute for each personnel type. Costs per personnel minute were combined with activity data to calculate costs of implementation activities at spoke sites. Implementation reach outcomes for the first 36 months of implementation were extracted from the electronic health record. Service utilization data was combined with cost data to calculate cost per patient reached and per clinical encounter achieved at each site.

Results

Total facilitation costs (range: $1,746-$7,978) and unique patients reached (range: 2–46) varied considerably across spoke sites and greater staff implementation efforts (measured in time or cost) were not associated with greater numbers of patients reached. Therefore, costs per patient reached also varied widely (range: $120–2,569) across spoke sites. Key challenges included high rurality and small clinic size; insufficient engagement of frontline providers; lack of referral options for high acuity patients; and lack of existing programming within which to situate pain services.

Conclusions

At spoke sites where patients were consistently referred and reached, costs were relatively modest, particularly compared to the high cost of untreated chronic pain, suggesting the potential impact of this model at scale. However, in spoke sites where referrals and encounters were low during initial implementation, cost per patient was high. Findings highlight the need for better methods for tailoring of facilitation interventions to spoke site’s individual needs to maximize impact.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Formative evaluation of the implementation of digital therapeutics for opioids and other substance use disorders in primary care (DIGITS trial)

Authors:

Lorella Palazzo, Caitlin N Dorsey, Jess Mogk, Tara Beatty, Deborah King, Kelsey Stefanik-Guizlo, Dustin Key, Tessa E Matson, Mary Shea, Ryan M Caldeiro, Angela Garza McWethy, Edwin S Wong, Abisola E Idu, and Joseph E Glass

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2024

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Substance use disorders (SUDs) result in individual and societal burden. However, most individuals with SUD receive no treatment. Implementing SUD interventions in primary care could address this population's treatment needs. In the USA, reSET® and reSET-O® were the first prescription digital therapeutics (PDTs) for SUDs and opioid use disorder (OUD), respectively. The Digital Treatments for Substance Use Disorder (DIGITS) study tested the effectiveness of practice facilitation and health coaching strategies to support reSET and reSET-O implementation into primary care. A formative evaluation was conducted to monitor implementation, inform adaptations, and learn what promotes PDT sustainment.

Method

The Dynamic Sustainability Framework and the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies guided the evaluation. Using rapid qualitative methods, we collected and analyzed observational fieldnotes, key informant interviews, and document sources (e.g., meeting minutes) for synthesis and dissemination to clinical partners and the study team via formative reports. We analyzed the reports to generate evaluation results.

Results

Twenty-four primary care clinics participated. Evaluation data included 98 observational fieldnotes, 16 interviews, and 253 document sources. We produced nine formative reports. The study encountered barriers and facilitators in each DSF domain (ecological system, practice setting, and intervention). In the ecological system, the PDT vendor enabled the study, but the COVID-19 pandemic, laws, regulations, and contracting delayed implementation. In the practice setting, staff shortages and low clinic capacity were implementation challenges, while electronic health record capabilities were both barriers and facilitators. At the intervention level, non-routine workflows, clinician burden, and low patient engagement were barriers despite clinicians’ efforts.

Conclusions

Digital therapeutics are promising SUD and OUD treatments, but integration into primary care requires conducive laws and regulations, organizational capacity, and patient and clinician engagement. Formative evaluation identified important lessons for future PDT implementation.

Plain Language Summary

Evaluation of the integration of digital treatments for opioid and other substance use disorders in primary care

Most people with substance use disorders (SUDs) receive no treatment. In the USA, two smartphone app-based digital treatments for SUD and opioid use disorders (OUDs) became available by prescription. The Digital Treatments for Substance Use Disorder (DIGITS) study, a randomized implementation trial, tested how best to integrate these digital treatments for SUD and OUD into primary care. Throughout the study, we conducted a formative evaluation to observe progress, recommend implementation improvements, and understand how digital treatments could be offered to patients after the study ended. For this evaluation, we collected qualitative data through observing study meetings and interviewing primary care leaders, clinicians, and clinical and study staff. The data were regularly summarized and reported to our clinical partners and the study team. We used two implementation frameworks to interpret the data: the Dynamic Sustainability Framework and the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies. The evaluation revealed factors that helped and hindered implementation. Obstacles from outside the health care system included the COVID-19 pandemic, laws, regulations, and delays in setting up contractual agreements, whereas a partnership with the digital treatment vendor proved helpful. Clinics had difficulties with clinician burden, staff shortages, lack of time and available appointments, and performing new and unfamiliar tasks. The electronic health record system both supported and impended implementation. Last, few patients accepted the offered digital treatment, or used it persistently. Formative evaluation results suggest that digital treatments for SUD and OUD in primary care are promising, however their successful use requires supportive laws and regulations, health system resources, and increased patient and clinician engagement.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation of collaborative care for depression in VA HIV clinics: Translating Initiatives for Depression into Effective Solutions (HITIDES): protocol for a cluster-randomized type 3 hybrid effectiveness-implementation trial

Authors:

Jacob T. Painter, Jeffrey Pyne, Geoffrey Curran, Rebecca A. Raciborski, Shane Russell, John Fortney, Allen L. Gifford, Michael Ohl & Eva N. Woodward

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2024

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Depression is the most diagnosed mental health condition among people living with HIV. Collaborative care is an effective intervention for depression, typically delivered in primary care settings. The HIV Translating Initiatives for Depression into Effective Solutions (HITIDES) clinical intervention involves a depression care team housed off-site that supports depression care delivery by HIV care providers. In a randomized controlled trial, HITIDES significantly improved depression symptoms for veterans living with HIV and delivered cost savings. However, no HIV clinics in the Veterans Health Administration (VHA) have implemented HITIDES; as such, it is unclear what implementation strategies are necessary to launch and sustain this intervention.

Methods

This hybrid type-3 effectiveness-implementation trial examines the implementation and effectiveness of HITIDES in 8 VHA HIV clinics randomly assigned to one of two implementation arms. Each arm uses a different implementation strategy package. Arm 1 includes an intervention operations guide; an on-site clinical champion who, with the help of a peer community of practice, will work with local clinicians and leadership to implement HITIDES at their site; and patient engagement in implementation tools. Arm 2 includes all strategies from Arm 1 with assistance from an external facilitator. The primary implementation outcomes is reach; secondary outcomes include adoption, implementation dose, depressive symptoms, and suicidal ideation. We will conduct a budget impact analysis of the implementation strategy packages. We hypothesize that Arm 2 will be associated with greater reach and adoption and that Arm 1 will be less costly.

Discussion

Preliminary work identified implementation strategies acceptable to veterans living with HIV and HIV care providers; however, the effectiveness and cost of these strategies are unknown. While the depression care team can deliver services consistently with high quality, the ability of the depression care team to engage with HIV care providers at sites is unknown. Findings from this study will be used to inform selection of implementation strategies for a broad rollout to enhance depression and suicide care for people living with HIV.

Trial registration

ClinicalTrials.gov ID: NCT05901272, Registered 10 May 2023, https://clinicaltrials.gov/study/NCT05901272

Contributions to the literature

  • It is well-recognized that those with HIV infections need greater access to mental healthcare for depression. But it is not known how best to support deployment of evidence-based mental healthcare to them.
  • This paper describes an implementation trial to roll out depression care in HIV clinics.
  • With the fragmentation of care among so many subspecialties, understanding how to roll out mental health support across specialty medical settings is crucial.
  • Results will be relevant to mental health and suicide support not only for those with HIV but across many sectors of care for adults receiving care in specialty medical settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Integrating causal pathway diagrams into practice facilitation to address colorectal cancer screening disparities in primary care

Authors:

Brooke Ike, Ashley Johnson, Rosemary Meza, & Allison Cole

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2024

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Colorectal cancer (CRC) is the second leading cause of cancer death and the second most common cancer diagnosis among the Hispanic population in the United States. However, CRC screening prevalence remains lower among Hispanic adults than among non-Hispanic white adults. To reduce CRC screening disparities, efforts to implement CRC screening evidence-based interventions in primary care organizations (PCOs) must consider their potential effect on existing screening disparities. More research is needed to understand how to leverage existing implementation science methodologies to improve health disparities. The Coaching to Improve Colorectal Cancer Screening Equity (CoachIQ) pilot study explores whether integrating two implementation science tools, Causal Pathway Diagrams and practice facilitation, is a feasible and effective way to address CRC screening disparities among Hispanic patients.

Methods

We used a quasi-experimental, mixed methods design to evaluate feasibility and assess initial signals of effectiveness of the CoachIQ approach. Three PCOs received coaching from CoachIQ practice facilitators over a 12-month period. Three non-equivalent comparison group PCOs received coaching during the same period as participants in a state quality improvement program. We conducted descriptive analyses of screening rates and coaching activities.

Results

The CoachIQ practice facilitators discussed equity, facilitated prioritization of QI activities, and reviewed CRC screening disparities during a higher proportion of coaching encounters than the comparison group practice facilitator. While the mean overall CRC screening rate in the comparison PCOs increased from 34 to 41%, the mean CRC screening rate for Hispanic patients did not increase from 30%. In contrast, the mean overall CRC screening rate at the CoachIQ PCOs increased from 41 to 44%, and the mean CRC screening rate for Hispanic patients increased from 35 to 39%.

Conclusions

The CoachIQ program merges two implementation science methodologies, practice facilitation and causal pathway diagrams, to help PCOs focus quality improvement efforts on improving CRC screening while also reducing screening disparities. Results from this pilot study demonstrate key differences between CoachIQ facilitation and standard facilitation, and point to the potential of the CoachIQ approach to decrease disparities in CRC screening.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Are we being equitable enough? Lessons learned from sites lost in an implementation trial

Authors:

Elizabeth J Austin, Jessica Chen, Lori Ferro, Andrew J Saxon, John C Fortney, Geoffrey M Curran, Anna D Ratzliff, & Emily C Williams

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2024

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

There is a growing interest in practice-based implementation research, yet too often research prioritizes and is most successful in academic settings. During a national implementation trial to evaluate the effectiveness of Collaborative Care for co-occurring opioid use and mental health disorders, we lost three of our 11 participating implementation sites, all representing community sites.

Method

To better understand needed supports for implementation trial participation, we conducted exit interviews (n = 5) with key staff at these community sites. Interview transcripts were double-coded and analyzed using Rapid Assessment Process. Qualitative themes were iteratively reviewed by the study team.

Results

Three themes emerged characterizing challenges for community sites, including that: (1) research threatens sites’ most precious resource—staff; (2) staff lack comfort with and skills for research; and (3) research participation in its current form does not offer a clear return on investment.

Conclusions

Learnings from this work illuminate some of the barriers community sites face when trying to participate in multisite implementation research. An undercurrent of participant perspectives was the belief that community sites like theirs are just not set up to successfully participate in clinical trial research, including population-based implementation trials. Future implementation trials should consider strategies that disrupt traditional approaches, increasing the equitable inclusion of diverse practice settings in implementation research.

Plain Language Summary

There is a growing interest in research that reflects community settings. Yet too often, research is most successful in academic settings. During a national implementation trial to evaluate the effectiveness of Collaborative Care for co-occurring opioid use and mental health disorders, we lost three of our 11 participating implementation sites, all representing community sites. To better understand their perspectives, we conducted exit interviews (n = 5) with staff at these community sites. Interview transcripts were double-coded and analyzed using thematic analysis. Analysis identified three themes: (1) research threatens sites’ most precious resource—staff; (2) staff lack comfort with and skills for research, and (3) research participation in its current form does not offer a clear return on investment. Community sites face many barriers to participating in implementation research trials. Future trials should consider ways to disrupt traditional approaches and increase the equitable inclusion of community settings in implementation research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**