Skip to content

✪ Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care

Authors:

Emily R. Haines, Alex Dopp, Aaron R. Lyon, Holly O. Witteman, Miriam Bender, Gratianne Vaisson, Danielle Hitch, & Sarah Birken

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2021

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Attempting to implement evidence-based practices in contexts for which they are not well suited may compromise their fidelity and effectiveness or burden users (e.g., patients, providers, healthcare organizations) with elaborate strategies intended to force implementation. To improve the fit between evidence-based practices and contexts, implementation science experts have called for methods for adapting evidence-based practices and contexts and tailoring implementation strategies; yet, methods for considering the dynamic interplay among evidence-based practices, contexts, and implementation strategies remain lacking. We argue that harmonizing the three can be facilitated by user-centered design, an iterative and highly stakeholder-engaged set of principles and methods.

Methods

This paper presents a case example in which we used a three-phase user-centered design process to design and plan to implement a care coordination intervention for young adults with cancer. Specifically, we used usability testing to redesign and augment an existing patient-reported outcome measure that served as the basis for our intervention to optimize its usability and usefulness, ethnographic contextual inquiry to prepare the context (i.e., a comprehensive cancer center) to promote receptivity to implementation, and iterative prototyping workshops with a multidisciplinary design team to design the care coordination intervention and anticipate implementation strategies needed to enhance contextual fit.

Results

Our user-centered design process resulted in the Young Adult Needs Assessment and Service Bridge (NA-SB), including a patient-reported outcome measure and a collection of referral pathways that are triggered by the needs young adults report, as well as implementation guidance. By ensuring NA-SB directly responded to features of users and context, we designed NA-SB for implementation, potentially minimizing the strategies needed to address misalignment that may have otherwise existed. Furthermore, we designed NA-SB for scale-up; by engaging users from other cancer programs across the country to identify points of contextual variation which would require flexibility in delivery, we created a tool intended to accommodate diverse contexts.

Conclusions

User-centered design can help maximize usability and usefulness when designing evidence-based practices, preparing contexts, and informing implementation strategies—in effect, harmonizing evidence-based practices, contexts, and implementation strategies to promote implementation and effectiveness.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Is telemedicine the answer to rural expansion of medication treatment for opioid use disorder? Early experiences in the feasibility study phase of a National Drug Abuse Treatment Clinical Trials Network Trial

Authors:

Yih-Ing Hser, Allison J. Ober, Alex R. Dopp, Chunqing Lin, Katie P. Osterhage, Sarah E. Clingan, Larissa J. Mooney, Megan E. Curtis, Lisa A. Marsch, Bethany McLeman, Emily Hichborn, Laurie S. Lester, Laura-Mae Baldwin, Yanping Liu, Petra Jacobs, & Andrew J. Saxon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2021

Read the full text in the open access journal Addiction Science & Clinical Practice

Abstract:

Telemedicine (TM) enabled by digital health technologies to provide medical services has been considered a key solution to increasing health care access in rural communities. With the immediate need for remote care due to the COVID-19 pandemic, many health care systems have rapidly incorporated digital technologies to support the delivery of remote care options, including medication treatment for individuals with opioid use disorder (OUD). In responding to the opioid crisis and the COVID-19 pandemic, public health officials and scientific communities strongly support and advocate for greater use of TM-based medication treatment for opioid use disorder (MOUD) to improve access to care and have suggested that broad use of TM during the pandemic should be sustained.

Nevertheless, research on the implementation and effectiveness of TM-based MOUD has been limited. To address this knowledge gap, the National Drug Abuse Treatment Clinical Trials Network (CTN) funded (via the NIH HEAL Initiative) a study on Rural Expansion of Medication Treatment for Opioid Use Disorder (Rural MOUD; CTN-0102) to investigate the implementation and effectiveness of adding TM-based MOUD to rural primary care for expanding access to MOUD. In preparation for this large-scale, randomized controlled trial incorporating TM in rural primary care, a feasibility study is being conducted to develop and pilot test implementation procedures.

In this commentary, we share some of our experiences, which include several challenges, during the initial two-month period of the feasibility study phase. While these challenges could be due, at least in part, to adjusting to the COVID-19 pandemic and new workflows to accommodate the study, they are notable and could have a substantial impact on the larger, planned pragmatic trial and on TM-based MOUD more broadly. Challenges include low rates of identification of risk for OUD from screening, low rates of referral to TM, digital device and internet access issues, workflow and capacity barriers, and insurance coverage. These challenges also highlight the lack of empirical guidance for best TM practice and quality remote care models.

With TM expanding rapidly, understanding implementation and demonstrating what TM approaches are effective are critical for ensuring the best care for persons with OUD.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Prevention of cervical cancer through two HPV-based screen-and-treat implementation models in Malawi: Protocol for a cluster randomized feasibility trial

Authors:

Jennifer H. Tang, Jennifer S. Smith, Shannon McGue, Luis Gadama, Victor Mwapasa, Effie Chipeta, Jobiba Chinkhumba, Erik Schouten, Bagrey Ngwira, Ruanne Barnabas, Mitch Matoga, Maganizo Chagomerana & Lameck Chinula

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2021

Read the full text in the open access journal Pilot and Feasibility Studies

Abstract:

Background

Cervical cancer is the leading cause of cancer incidence and mortality among Malawian women, despite being a largely preventable disease. Implementing a cervical cancer screening and preventive treatment (CCSPT) program that utilizes rapid human papillomavirus (HPV) testing on self-collected cervicovaginal samples for screening and thermal ablation for treatment may achieve greater coverage than current programs that use visual inspection with acetic acid (VIA) for screening and cryotherapy for treatment. Furthermore, self-sampling creates the opportunity for community-based screening to increase uptake in populations with low screening rates. Malawi’s public health system utilizes regularly scheduled outreach and village-based clinics to provide routine health services like family planning. Cancer screening is not yet included in these community services. Incorporating self-sampled HPV testing into national policy could address cervical cancer screening barriers in Malawi, though at present the effectiveness, acceptability, appropriateness, feasibility, and cost-effectiveness still need to be demonstrated.

Methods

We designed a cluster randomized feasibility trial to determine the effectiveness, acceptability, appropriateness, feasibility, and budget impact of two models for integrating a HPV-based CCSPT program into family planning (FP) services in Malawi: model 1 involves only clinic-based self-sampled HPV testing, whereas model 2 includes both clinic-based and community-based self-sampled HPV testing. Our algorithm involves self-collection of samples for HPV GeneXpert® testing, visual inspection with acetic acid for HPV-positive women to determine ablative treatment eligibility, and same-day thermal ablation for treatment-eligible women. Interventions will be implemented at 14 selected facilities. Our primary outcome will be the uptake of cervical cancer screening and family planning services during the 18 months of implementation, which will be measured through an Endline Household Survey. We will also conduct mixed methods assessments to understand the acceptability, appropriateness, and feasibility of the interventions, and a cost analysis to assess budget impact.

Discussion

Our trial will provide in-depth information on the implementation of clinic-only and clinic-and-community models for integrating self-sampled HPV testing CCSPT with FP services in Malawi. Findings will provide valuable insight for policymakers and implementers in Malawi and other resource-limited settings with high cervical cancer burden.

Trial registration

ClinicalTrials.gov identifier: NCT04286243. Registered on February 26, 2020.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Acceptability and Feasibility of Pharmacy-Based Delivery of Pre-Exposure Prophylaxis in Kenya: A Qualitative Study of Client and Provider Perspectives

Authors:

Stephanie D. Roche, Njeri Wairimu, Peter Mogere, Kevin Kamolloh, Josephine Odoyo, Zachary A. Kwena, Elizabeth A. Bukusi, Kenneth Ngure, Jared M. Baeten, & Katrina F. Ortblad

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2021

Read the full text in the open access journal AIDS and Behavior

Abstract:

As countries scale up pre-exposure prophylaxis (PrEP) for HIV prevention, diverse PrEP delivery models are needed to expand access to populations at HIV risk that are unwilling or unable to access clinic-based PrEP care. To identify factors that may influence implementation of retail pharmacy-based PrEP delivery in Kenya, we conducted in-depth interviews with 40 pharmacy clients, 16 pharmacy providers, 16 PrEP clients, and 10 PrEP providers from two provinces. Most participants expressed strong support for expanding PrEP to retail pharmacies, though conditioned their acceptance on assurances that care would be private, respectful, safe, and affordable. Participant-reported determinants of feasibility centered primarily on ensuring that the intervention is compatible with retail pharmacy operations (e.g., staffing levels, documentation requirements). Future research is needed to develop and test tailored packages of implementation strategies that are most effective at integrating PrEP delivery into routine pharmacy practice in Kenya and other high HIV prevalence settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Health behaviour outcomes of a family based intervention for paediatric obesity in primary care: A randomized type II hybrid effectiveness-implementation trial

Authors:

Justin D. Smith, Cady Berkel, Allison J. Carroll, Emily Fu, Kevin J. Grimm, Anne M. Mauricio, Jenna Rudo-Stern, Emily Winslow, Thomas J. Dishion, Neil Jordan, David C. Atkins, Shrikanth S. Narayanan, Carlos Gallo, Meg M. Bruening, Charlton Wilson, Farah Lokey, & Kristen Samaddar

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2021

Read the full text in the subscription access journal Pediatric Obesity

✪ Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties

Authors:

Cameo Stanick, Heather Halko, Kayne Mettert, Caitlin Dorsey, Joanna Moullin, Bryan Weiner, Byron Powell, and Cara C. Lewis

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2021

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Identification of psychometrically strong implementation measures could (1) advance researchers’ understanding of how individual characteristics impact implementation processes and outcomes, and (2) promote the success of real-world implementation efforts. The current study advances the work that our team published in 2015 by providing an updated and enhanced systematic review that identifies and evaluates the psychometric properties of implementation measures that assess individual characteristics.

Methods

A full description of our systematic review methodology, which included three phases, is described in a previously published protocol paper. Phase I focused on data collection and involved search string generation, title and abstract screening, full-text review, construct assignment, and measure forward searches. During Phase II, we completed data extraction (i.e., coding psychometric information). Phase III involved data analysis, where two trained specialists independently rated each measurement tool using our psychometric rating criteria.

Results

Our team identified 124 measures of individual characteristics used in mental or behavioral health research, and 123 of those measures were deemed suitable for rating using Psychometric and Pragmatic Evidence Rating Scale. We identified measures of knowledge and beliefs about the intervention (n = 76), self-efficacy (n = 24), individual stage of change (n = 2), individual identification with organization (n = 7), and other personal attributes (n = 15). While psychometric information was unavailable and/or unreported for many measures, information about internal consistency and norms were the most commonly identified psychometric data across all individual characteristics’ constructs. Ratings for all psychometric properties predominantly ranged from “poor” to “good.”

Conclusion

The majority of research that develops, uses, or examines implementation measures that evaluate individual characteristics does not include the psychometric properties of those measures. The development and use of psychometric reporting standards could advance the use of valid and reliable tools within implementation research and practice, thereby enhancing the successful implementation and sustainment of evidence-based practice in community care.

Plain Language Summary

Measurement is the foundation for advancing practice in health care and other industries. In the field of implementation science, the state of measurement is only recently being targeted as an area for improvement, given that high-quality measures need to be identified and utilized in implementation work to avoid developing another research to practice gap. For the current study, we utilized the Consolidated Framework for Implementation Research to identify measures related to individual characteristics’ constructs, such as knowledge and beliefs about the intervention, self-efficacy, individual identification with the organization, individual stage of change, and other personal attributes. Our review showed that many measures exist for certain constructs (e.g., measures related to assessing providers’ attitudes and perceptions about evidence-based practice interventions), while others have very few (e.g., an individual’s stage of change). Also, we rated measures for their psychometric strength utilizing an anchored rating system and found that most measures assessing individual characteristics are in need of more research to establish their evidence of quality. It was also clear from our results that frequency of use/citations does not equate to high quality, psychometric strength. Ultimately, the state of the literature has demonstrated that assessing individual characteristics of implementation stakeholders is an area of strong interest in implementation work. It will be important for future research to focus on clearly delineating the psychometric properties of existing measures for saturated constructs, while for the others the emphasis should be on developing new, high-quality measures and make these available to stakeholders.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Implementing Implementation Research: Teaching Implementation Research to HIV Researchers

Authors:

Sheree R. Schwartz, J. D. Smith, Christopher Hoffmann, Bhakti Hansoti, Sharmistha Mishra, Arianna Rubin Means, Vivian Go, Kenneth Sherr, Denis Nash, Patrick Sullivan & Stefan Baral

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2021

Read the full text in the subscription access journal Current HIV/AIDS Reports

Implementation and Scale-Up of Integrated Depression Care in South Africa: An Observational Implementation Research Protocol

Authors:

Inge Petersen, Christopher G. Kemp, Deepa Rao, Bradley H. Wagenaar, Kenneth Sherr, Merridy Grant, Max Bachmann, Ruanne V. Barnabas, Ntokozo Mntambo, Sithabisile Gigaba, André Van Rensburg, Zamasomi Luvuno, Ishmael Amarreh, Lara Fairall, Nikiwe N. Hongo, & Arvin Bhana

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2021

Read the full text in the subscription access journal Psychiatric Services