Skip to content
Implementation Science at UW

Keywords: Research Design

✪ Application of the Expert Recommendations for Implementing Change (ERIC) compilation of strategies to health intervention implementation in low- and middle-income countries: a systematic review

Authors:

Kathryn L. Lovero, Christopher G. Kemp, Bradley H. Wagenaar, Ali Giusto, M. Claire Greene, Byron J. Powell & Enola K. Proctor

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2023

Read the full text in the open access journal Implementation Science

Abstract:

Background

The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research.

Methods

We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies.

Results

The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1–46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness.

Conclusions

While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Stakeholder perspectives on a telemedicine referral and coordination model to expand medication treatment for opioid use disorder in rural primary care clinics

Authors:

Allison J Ober, Alex R Dopp, Sarah E Clingan, Megan E Curtis, Chunqing Lin, Stacy Calhoun, Sherry Larkins, Megan Black, Maria Hanano, Katie P Osterhage, Laura-Mae Baldwin, Andrew J Saxon, Emily G Hichborn, Lisa A Marsch, Larissa J Mooney, and Yih-Ing Hser

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published:October 2023

Read the full text in the open access journal Journal of Substance Use and Addiction Treatment

Abstract:

Introduction

Opioid overdose deaths are increasing rapidly in the United States. Medications for opioid use disorder (MOUD) are effective and can be delivered in primary care, but uptake has been limited in rural communities. Referral to and coordination with an external telemedicine (TM) vendor by rural primary care clinics for MOUD (TM-MOUD) may increase MOUD access for rural patients, but we know little about perspectives on this model among key stakeholders. As part of a TM-MOUD feasibility study, we explored TM-MOUD acceptability and feasibility among personnel and patients from seven rural primary care clinics and a TM-MOUD vendor.

Methods

We conducted virtual interviews or focus groups with clinic administrators (n = 7 interviews), clinic primary care and behavioral health providers (8 groups, n = 30), other clinic staff (9 groups, n = 37), patients receiving MOUD (n = 16 interviews), TM-MOUD vendor staff (n = 4 interviews), and vendor-affiliated behavioral health and prescribing providers (n = 17 interviews). We asked about experiences with and acceptability of MOUD (primarily buprenorphine) and telemedicine (TM) and a TM-MOUD referral and coordination model. We conducted content analysis to identify themes and participants quantitatively rated acceptability of TM-MOUD elements on a 4-item scale.

Results

Perceived benefits of vendor-based TM-MOUD included reduced logistical barriers, more privacy and less stigma, and access to services not available locally (e.g., counseling, pain management). Barriers included lack of internet or poor connectivity in patients' homes, limited communication and trust between TM-MOUD and clinic providers, and questions about the value to the clinic of TM-MOUD referral to external vendor. Acceptability ratings for TM-MOUD were generally high; they were lowest among frontline staff.

Conclusions

Rural primary care clinic personnel, TM-MOUD vendor personnel, and patients generally perceived referral from primary care to a TM-MOUD vendor to hold potential for increasing access to MOUD in rural communities. Increasing TM-MOUD uptake requires buy-in and understanding among staff of the TM-MOUD workflow, TM services offered, requirements for patients, advantages over clinic-based or TM services from clinic providers, and identification of appropriate patients. Poverty, along with patient hesitation to initiate treatment, creates substantial barriers to MOUD treatment generally; insufficient internet availability creates a substantial barrier to TM-MOUD.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Formative Evaluation of a Comprehensive Self-Management Intervention for Irritable Bowel Syndrome, Comorbid Anxiety, and Depression: Mixed Methods Study

Authors:

Kendra Kamp, Pei-Lin Yang, Emily Friedman, Alejandra Lopez, Sarah Iribarren, Pamela Barney, Sean Munson, Margaret Heitkemper, & Rona Levy

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2023

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Irritable bowel syndrome (IBS) is a disorder of the gut-brain interaction that is associated with abdominal pain, altered bowel patterns, and reduced quality of life. Up to 50% of patients with IBS also report anxiety or depressive symptoms. Although effective self-management interventions exist for individuals with IBS, few have been effectively implemented, and most do not consider the unique needs of patients with comorbid IBS and anxiety or depression.

Objective

This study aimed to determine the anticipated acceptability, appropriateness, feasibility, and usability of a comprehensive self-management intervention using an implementation science and human-centered design approach among individuals with comorbid IBS and anxiety or depression and health care providers.

Methods

A convergent mixed methods design was used to elicit feedback on the comprehensive self-management intervention outline and content to identify refinement needs before testing. Patients with IBS and moderate to severe anxiety or depression and health care providers were purposefully sampled from primary care and gastroenterology settings. Participants completed semistructured interviews and surveys on anticipated acceptability, appropriateness, feasibility, and usability.

Results

Patient participants (n=12) were on average 36.8 (SD 12.2) years of age, and 42% (5/12) were currently receiving psychological therapy. Health care providers (n=14) were from primary care (n=7) and gastroenterology (n=7) settings. The mean usability scores (out of 100) were 52.5 (SD 14.5) for patients and 45.6 (SD 11.6) for providers. For patients and providers, qualitative data expanded the quantitative findings for acceptability and appropriateness. Acceptability findings were the comprehensive nature of the intervention and discussion of the gut-brain interaction. For appropriateness, participants reported that the intervention provided structure, accountability, and support. Feasibility was confirmed for patients, but there was a divergence of findings between quantitative and qualitative measures for providers. Patients focused on intervention feasibility, while providers focused on implementation feasibility in the clinic. Identified usability issues to address before implementation included the intervention delivery format, length, and lack of integration into health care settings that, if not addressed, may limit the reach of the intervention

Conclusions

Patients and health care providers found the intervention acceptable and appropriate. Several feasibility and usability issues were identified, including intervention delivery methods, length of intervention, and the best methods to implement in the clinic setting. The next steps are to refine the intervention to address the identified issues and test in a pilot study whether addressing usability issues leads to the anticipated improvements in implementation and uptake.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Promoting alcohol treatment engagement post-hospitalization with brief intervention, medications and CBT4CBT: protocol for a randomized clinical trial in a diverse patient population

Authors:

E. Jennifer Edelman, Oscar F. Rojas-Perez, Charla Nich, Joanne Corvino, Tami Frankforter, Derrick Gordon, Ayana Jordan, Manuel Paris, Jr, Melissa B. Weimer, Brian T. Yates, Emily C. Williams & Brian D. Kiluk

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2023

Read the full text open access in the journal Addiction Science and Clinical Practice

Abstract:

Background

Alcohol use disorder (AUD) commonly causes hospitalization, particularly for individuals disproportionately impacted by structural racism and other forms of marginalization. The optimal approach for engaging hospitalized patients with AUD in treatment post-hospital discharge is unknown. We describe the rationale, aims, and protocol for Project ENHANCE (ENhancing Hospital-initiated Alcohol TreatmeNt to InCrease Engagement), a clinical trial testing increasingly intensive approaches using a hybrid type 1 effectiveness-implementation approach.

Methods

We are randomizing English and/or Spanish-speaking individuals with untreated AUD (n = 450) from a large, urban, academic hospital in New Haven, CT to: (1) Brief Negotiation Interview (with referral and telephone booster) alone (BNI), (2) BNI plus facilitated initiation of medications for alcohol use disorder (BNI + MAUD), or (3) BNI + MAUD + initiation of computer-based training for cognitive behavioral therapy (CBT4CBT, BNI + MAUD + CBT4CBT). Interventions are delivered by Health Promotion Advocates. The primary outcome is AUD treatment engagement 34 days post-hospital discharge. Secondary outcomes include AUD treatment engagement 90 days post-discharge and changes in self-reported alcohol use and phosphatidylethanol. Exploratory outcomes include health care utilization. We will explore whether the effectiveness of the interventions on AUD treatment engagement and alcohol use outcomes differ across and within racialized and ethnic groups, consistent with disproportionate impacts of AUD. Lastly, we will conduct an implementation-focused process evaluation, including individual-level collection and statistical comparisons between the three conditions of costs to providers and to patients, cost-effectiveness indices (effectiveness/cost ratios), and cost–benefit indices (benefit/cost ratios, net benefit [benefits minus costs). Graphs of individual- and group-level effectiveness x cost, and benefits x costs, will portray relationships between costs and effectiveness and between costs and benefits for the three conditions, in a manner that community representatives also should be able to understand and use.

Conclusions

Project ENHANCE is expected to generate novel findings to inform future hospital-based efforts to promote AUD treatment engagement among diverse patient populations, including those most impacted by AUD.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ ‘I understood the texting process well’ – Participant perspectives on usability and acceptability of SMS-based telehealth follow-up after voluntary medical male circumcision in South Africa

Authors:

Jacqueline Pienaar, Sarah Day, Geoffrey Setswe, Beatrice Wasunna, Vuyolwethu Ncube, Felex Ndebele, Femi Oni, Evelyn Waweru, Calsile Khumalo, Hannock Tweya, Kenneth Sherr, Yanfang Su, and Caryl Feldacker

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Digital Health

Abstract:

Background

Voluntary medical male circumcision (MC) is a biomedical HIV prevention method that requires post-operative follow-up for healing confirmation. Recent research found that a two-way texting (2wT) app providing SMS-based telehealth for MC patients was safe and reduced provider workload. We evaluated 2wT usability among MC clients in South Africa assigned the 2wT intervention within a larger randomized controlled trial (RCT) of 2wT safety and workload.

Methods

This quantitative usability study is within an RCT where 547 men used 2wT to interact with an MC provider via SMS. The sub-study involved the first 100 men assigned to 2wT who completed a usability survey 14 days after surgery. Acceptability was assessed through 2wT response rates of the 547 men. Regression models analyzed associations between age, wage, location, potential adverse events (AEs), and 2wT responses.

Results

Men assigned to 2wT found it safe, comfortable, and convenient, reporting time and cost savings. High response rates (88%) to daily messages indicated acceptability. Age, wage, and location didn't affect text responses or potential AEs.

Conclusion

2wT for post-MC follow-up was highly usable and acceptable, suggesting its viability as an alternative to in-person visits. It enhanced confidence in wound self-management. This SMS-based telehealth can enhance MC care quality and be adapted to similar contexts for independent healing support, particularly for men.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Authors:

Cady Berkel, Dillon C. Knox, Nikolaos Flemotomos, Victor R. Martinez, David C. Atkins, Shrikanth S. Narayanan, Lizeth Alonso Rodriguez, Carlos G. Gallo, and Justin D. Smith

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods

In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results

Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83–1.02 to 0.62–0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81–27.3 to 0.62–19.50, resulting in an approximate average improvement of 18%.

Conclusions

These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Disruptions to and Innovations in HPV Vaccination Strategies within Safety-Net Healthcare Settings Resulting from the COVID-19 Pandemic

Authors:

Samantha Garcia, Michelle Shin, Kylie Sloan, Emily Dang, Carlos Orellana Garcia, Lourdes Baezconde-Garbanati, Lawrence A. Palinkas, Benjamin F. Crabtree, and Jennifer Tsui

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published:August 2023

Read the full text in the open access journal Healthcare

Abstract:

Abstract

The COVID-19 pandemic disrupted healthcare delivery within safety-net settings. Barriers to and facilitators of human papillomavirus (HPV) vaccination during the pandemic can inform future HPV vaccine strategies for underserved communities. Qualitative interviews (n = 52) between December 2020 and January 2022 in Los Angeles and New Jersey were conducted with providers, clinic leaders, clinic staff, advocates, payers, and policy-level representatives involved in the HPV vaccine process. Using the updated Consolidated Framework for Implementation Research we identified (1) outer setting barriers (i.e., vaccine hesitancy driven by social media, political views during the pandemic) and facilitators (e.g., partnerships); (2) inner setting clinic facilitators (i.e., motivation-driven clinic metrics, patient outreach, vaccine outreach events); (3) individual characteristics such as patient barriers (i.e., less likely to utilize clinic services during the pandemic and therefore, additional outreach to address missed vaccine doses are needed); (4) innovations in HPV vaccination strategies (i.e., clinic workflow changes to minimize exposure to COVID-19, leveraging new community partnerships (e.g., with local schools)); and (5) implementation strategies (i.e., multisectoral commitment to HPV goals). Pandemic setbacks forced safety-net settings to develop new vaccine approaches and partnerships that may translate to new implementation strategies for HPV vaccination within local contexts and communities.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**