Skip to content

✪ Co-developed implementation guidelines to maximize acceptability, feasibility, and usability of mobile phone supervision in Kenya

Authors:

Noah S. Triplett, Anne Mbwayo, Sharon Kiche, Lucy Liu, Jacinto Silva, Rashed AlRasheed, Clara Johnson, Cyrilla Amanya, Sean Munson, Bryan J. Weiner, Pamela Y. Collins & Shannon Dorsey

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Cambridge Prisms: Global Mental Health

Abstract:

Opportunities exist to leverage mobile phones to replace or supplement in-person supervision of lay counselors. However, contextual variables, such as network connectivity and provider preferences, must be considered. Using an iterative and mixed methods approach, we co-developed implementation guidelines to support the implementation of mobile phone supervision with lay counselors and supervisors delivering a culturally adapted trauma-focused cognitive behavioral therapy in Western Kenya. Guidelines were shared and discussed with lay counselors in educational outreach visits led by supervisors. We evaluated the impact of guidelines and outreach on the acceptability, feasibility, and usability of mobile phone supervision. Guidelines were associated with significant improvements in acceptability and usability of mobile phone supervision. There was no evidence of a significant difference in feasibility. Qualitative interviews with lay counselors and supervisors contextualized how guidelines impacted acceptability and feasibility – by setting expectations for mobile phone supervision, emphasizing importance, increasing comfort, and sharing strategies to improve mobile phone supervision. Introducing and discussing co-developed implementation guidelines significantly improved the acceptability and usability of mobile phone supervision. This approach may provide a flexible and scalable model to address challenges with implementing evidence-based practices and implementation strategies in lower-resourced areas.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation fidelity to HIV assisted partner services (aPS) during scale-up in western Kenya: a convergent mixed methods study

Authors:

Beatrice Wamuti, Mercy Owuor, Wenjia Liu, David Katz, Harison Lagat, George Otieno, Edward Kariithi, Paul Macharia, Sarah Masyuko, Mary Mugambi, Carey Farquhar & Bryan Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

HIV assisted partner services (aPS) is an intervention to improve HIV status awareness among sex and drug-injecting partners of people newly diagnosed with HIV (index clients). Implementation fidelity—the degree to which an intervention is conducted as intended – is critical to effectiveness, but there are limited data about aPS fidelity when delivered by HIV testing service (HTS) providers. We explored factors affecting implementation fidelity to aPS in two high-HIV prevalence counties in western Kenya.

Methods

We used convergent mixed methods adapting the conceptual framework for implementation fidelity within the aPS scale-up project. This was an implementation study examining scale-up of APS within HTS programs in Kisumu and Homa Bay counties that recruited male sex partners (MSPs) of female index clients. We defined implementation fidelity as the extent to which HTS providers followed the protocol for phone and in-person participant tracing at six expected tracing attempts. Quantitative data were collected from tracing reports in 31 facilities between November 2018 and December 2020, and in-depth interviews (IDIs) were conducted with HTS providers. Descriptive statistics were used to describe tracing attempts. IDIs were analyzed using thematic content analysis.

Results

Overall, 3017 MSPs were mentioned of whom 98% (2969/3017) were traced, with most tracing attempts being successful (2831/2969, 95%). Fourteen HTS providers participated in the IDIs—mostly females (10/14, 71%) with a median age of 35 years (range 25–52), who all had post-secondary education (14/14, 100%). The proportion of tracing attempts occurring by phone ranged from 47 to 66%, with the highest proportion occurring on the first attempt and lowest on the sixth attempt. Contextual factors either enhanced or impeded implementation fidelity to aPS. Positive provider attitudes towards aPS and conducive work environment factors promoted implementation fidelity, while negative MSP responses and challenging tracing conditions impeded it.

Conclusion

Interactions at the individual (provider), interpersonal (client—provider), and health systems (facility) levels affected implementation fidelity to aPS. As policymakers prioritize strategies to reduce new HIV infections, our findings highlight the importance of conducting fidelity assessments to better anticipate and mitigate the impact of contextual factors during the scale-up of interventions.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Content validity of an item bank to assess intervention characteristic determinants of implementing evidence-based practices

Authors:

Salene MW Jones, Aditya Shrey & Bryan J Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Barriers and facilitators, collectively called determinants, of evidence-based practice implementation are key to identifying the best strategies for promoting implementation. Assessing determinants before implementation can help tailor strategies to those that would be most effective. Current measures of determinants are not comparable across implementation settings and implementation scientists and practitioners often have to create their own measures. This study was the first step in creating determinants item banks that are usable across settings and focused on intervention characteristics. We aimed to establish the content validity of the item bank.

Method

This study used a concurrent mixed methods approach. Items for assessing intervention characteristic determinants were first identified through systematic reviews. Implementation scientists then completed a survey where they provided both quantitative and qualitative feedback on the items. Finally, three experts with both clinical and implementation experience provided feedback on redundancy and representativeness.

Results

The systematic reviews identified over 1,959 items so subsequent steps were limited to focus on intervention characteristic determinants (271 items) such as adaptability of the practice. Based on feedback from thirty implementation scientists, the items were reduced to 92 but an additional 53 were added, most due to qualitative feedback. Items were also rewritten based on qualitative results. Three experts reviewed the remaining 145 items. Based on their feedback, the number of items was reduced to 109.

Conclusions

Creating a determinants item bank was feasible and the final items had content validity. The next steps include testing reliability and validity in a larger sample of clinicians implementing evidence-based practices.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

“Another tool in the toolkit”—Perceptions, suggestions, and concerns of emergency service providers about the implementation of a supervised consumption site

Authors:

David Perlmutter, Courteney Wettemann, Callan Elswick Fockele, Tessa Frohe, Will Williams, Nathan Holland, Thea Oliphant-Wells, Hendrika Meischke, & Jenna van Draanen

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: May 2023

Read the full text in the subscription access journal The International Journal on Drug Policy

✪ Real-world impact of integrating HIV assisted partner services into 31 facilities in Kenya: a single-arm, hybrid type 2 implementation-effectiveness study

Authors:

Monisha Sharma, Brienna Naughton, Harison Lagat, George Otieno, David A Katz, Beatrice M Wamuti, Sarah Masyuko, Rose Bosire, Mary Mugambi, Unmesha Roy Paladhi, Bryan J Weiner, Edward Kariithi & Carey Farquhar

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal The Lancet Global Health

Abstract:

Background

Assisted partner services (APS), or exposure notification and HIV testing for sexual partners of individuals diagnosed with HIV (index clients), have been shown to be safe and effective in clinical trials. We assessed the real-world effectiveness of APS when integrated into HIV clinics in western Kenya.

Methods

In this single-arm, hybrid type 2 implementation science study, we facilitated APS implementation in 31 health facilities in Kenya by training existing health-care staff. We focused on male partner outcomes to assess the impact of APS in reaching male individuals in sub-Saharan Africa, who have lower rates of HIV testing than female individuals. Female individuals (aged ≥18 years or emancipated minor) who tested positive for HIV at participating facilities in Kenya were offered APS; consenting female participants provided contact information for all male sexual partners in the past 3 years. Male partners were notified of their potential HIV exposure and offered a choice of community-based or facility-based HIV testing services (HTS). Female index clients and male partners with HIV were followed up at 6 weeks, 6 months, and 12 months after enrolment, to assess linkage to antiretroviral treatment. Viral load was assessed at 12 months.

Findings

Between May 1, 2018, and March 31, 2020, 32 722 female individuals received HTS; 1910 (6%) tested positive for HIV, of whom 1724 (90%) received APS. Female index clients named 5137 male partners (median 3 per index [IQR 2–4]), of whom 4422 (86%) were reached with exposure notification and HTS. 524 (12%) of the male partners tested were newly diagnosed with HIV and 1292 (29%) reported a previous HIV diagnosis. At 12 months follow-up, 1512 (88%) female index clients and 1621 (89%) male partners with HIV were taking ART, with few adverse events: 25 (2%) female index clients and seven (<1%) male partners reported intimate partner violence, and 60 (3%) female index clients and ten (<1%) male partners reported relationship dissolution.

Interpretation

Evidence from this real-world APS scale-up project shows that APS is a safe, acceptable, and effective strategy to identify males with HIV and retain them in care.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Rapid ethnography and participatory techniques increase onchocerciasis mass drug administration treatment coverage in Benin: a difference-in-differences analysis

Authors:

Arianna Rubin Means, N’koué Emmanuel Sambiéni, Euripide Avokpaho, Abdoulaye Benon Monra, Fifamè Aubierge Eudoxie Kpatinvoh, Kevin Bardosh & Moudachirou Ibikounlé

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Onchocerciasis, a neglected tropical disease (NTD) that causes blindness, is controlled via mass drug administration (MDA) where entire endemic communities are targeted with preventative chemotherapeutic treatment. However, in many settings, MDA coverage remains low. The purpose of this project was to determine if engaging communities in the development of implementation strategies improves MDA coverage.

Methods

This study took place in an intervention and a control commune in Benin, West Africa. We conducted rapid ethnography in each commune to learn about community member perceptions of onchocerciasis, MDA, and opportunities to increase MDA coverage. Findings were shared with key stakeholders and a structured nominal group technique was used to derive implementation strategies most likely to increase treatment coverage. The implementation strategies were delivered prior to and during onchocerciasis MDA. We conducted a coverage survey within 2 weeks of MDA to determine treatment coverage in each commune. A difference-in-differences design was used to determine if the implementation package effectively increased coverage. A dissemination meeting was held with the NTD program and partners to share findings and determine the perceived acceptability, appropriateness, and feasibility of implementing rapid ethnography as part of routine program improvement.

Results

During rapid ethnography, key barriers to MDA participation included trust in community drug distributors, poor penetration of MDA programs in rural or geographically isolated areas, and low demand for MDA among specific sub-populations driven by religious or socio-cultural beliefs. Stakeholders developed a five-component implementation strategy package, including making drug distributor trainings dynamic, redesigning distributor job aids, tailoring community sensitization messages, formalizing supervision, and preparing local champions. After implementing the strategy package, MDA coverage increased by 13% (95% CI: 11.0–15.9%) in the intervention commune relative to the control commune. Ministry of Health and implementing partners found the approach to be largely acceptable and appropriate; however, there was mixed feedback regarding the feasibility of future implementation of rapid ethnography.

Conclusions

Implementation research conducted in Benin, and indeed throughout sub-Saharan Africa, is often implemented in a top-down manner, with both implementation determinants and strategies derived in the global North. This project demonstrates the importance of participatory action research involving community members and implementers to optimize program delivery.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Integrating pragmatic and implementation science randomized clinical trial approaches: a PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) analysis

Authors:

Douglas Zatzick, Lawrence Palinkas, David A. Chambers, Lauren Whiteside, Kathleen Moloney, Allison Engstrom, Laura Prater, Joan Russo, Jin Wang, Khadija Abu, Matt Iles-Shih & Eileen Bulger

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Trials

Abstract:

Background

Over the past two decades, pragmatic and implementation science clinical trial research methods have advanced substantially. Pragmatic and implementation studies have natural areas of overlap, particularly relating to the goal of using clinical trial data to leverage health care system policy changes. Few investigations have addressed pragmatic and implementation science randomized trial methods development while also considering policy impact.

Methods

The investigation used the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) and PRECIS-2-Provider Strategies (PRECIS-2-PS) tools to evaluate the design of two multisite randomized clinical trials that targeted patient-level effectiveness outcomes, provider-level practice changes and health care system policy. Seven raters received PRECIS-2 training and applied the tools in the coding of the two trials. Descriptive statistics were produced for both trials, and PRECIS-2 wheel diagrams were constructed. Interrater agreement was assessed with the Intraclass Correlation (ICC) and Kappa statistics. The Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) qualitative approach was applied to understanding integrative themes derived from the PRECIS-2 ratings and an end-of-study policy summit.

Results

The ICCs for the composite ratings across the patient and provider-focused PRECIS-2 domains ranged from 0.77 to 0.87, and the Kappa values ranged from 0.25 to 0.37, reflecting overall fair-to-good interrater agreement for both trials. All four PRECIS-2 wheels were rated more pragmatic than explanatory, with composite mean and median scores ≥ 4. Across trials, the primary intent-to-treat analysis domain was consistently rated most pragmatic (mean = 5.0, SD = 0), while the follow-up/data collection domain was rated most explanatory (mean range = 3.14–3.43, SD range = 0.49–0.69). RAPICE field notes identified themes related to potential PRECIS-2 training improvements, as well as policy themes related to using trial data to inform US trauma care system practice change; the policy themes were not captured by the PRECIS-2 ratings.

Conclusions

The investigation documents that the PRECIS-2 and PRECIS-2-PS can be simultaneously used to feasibly and reliably characterize clinical trials with patient and provider-level targets. The integration of pragmatic and implementation science clinical trial research methods can be furthered by using common metrics such as the PRECIS-2 and PRECIS-2-PS. Future study could focus on clinical trial policy research methods development.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Adaptation of the collaborative care model to integrate behavioral health care into a low-barrier HIV clinic

Authors:

Julia C. Dombrowski, Scott Halliday, Judith I. Tsui, Deepa Rao, Kenneth Sherr, Meena S. Ramchandani, Ramona Emerson, Mark Fleming, Teagan Wood & Lydia Chwastiak

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

The collaborative care management (CoCM) model is an evidence-based intervention for integrating behavioral health care into nonpsychiatric settings. CoCM has been extensively studied in primary care clinics, but implementation in nonconventional clinics, such as those tailored to provide care for high-need, complex patients, has not been well described.

Method

We adapted CoCM for a low-barrier HIV clinic that provides walk-in medical care for a patient population with high levels of mental illness, substance use, and housing instability. The Exploration, Preparation, Implementation, and Sustainment model guided implementation activities and support through the phases of implementing CoCM. The Framework for Reporting Adaptations and Modifications to Evidence-Based Interventions guided our documentation of adaptations to process-of-care elements and structural elements of CoCM. We used a multicomponent strategy to implement the adapted CoCM model. In this article, we describe our experience through the first 6 months of implementation.

Results

The key contextual factors necessitating adaptation of the CoCM model were the clinic team structure, lack of scheduled appointments, high complexity of the patient population, and time constraints with competing priorities for patient care, all of which required substantial flexibility in the model. The process-of-care elements were adapted to improve the fit of the intervention with the context, but the core structural elements of CoCM were maintained.

Conclusions

The CoCM model can be adapted for a setting that requires more flexibility than the usual primary care clinic while maintaining the core elements of the intervention.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Twenty years of capacity building across the cancer prevention and control research network

Authors:

Mary Wangen, Cam Escoffery, Maria E. Fernandez, Daniela B. Friedman, Peggy Hannon, Linda K. Ko, Annette E. Maxwell, Courtney Petagna, Betsy Risendal, Catherine Rohweder & Jennifer Leeman

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Cancer Causes and Control

Abstract:

Purpose

To improve population health, community members need capacity (i.e., knowledge, skills, and tools) to select and implement evidence-based interventions (EBIs) to fit the needs of their local settings. Since 2002, the Centers for Disease Control and Prevention has funded the national Cancer Prevention and Control Research Network (CPCRN) to accelerate the implementation of cancer prevention and control EBIs in communities. The CPCRN has developed multiple strategies to build community members’ capacity to implement EBIs. This paper describes the history of CPCRN’s experience developing and lessons learned through the use of five capacity-building strategies: (1) mini-grant programs, (2) training, (3) online tools, (4) evidence academies, and (5) evaluation support for partners’ capacity-building initiatives.

Methods

We conducted a narrative review of peer-reviewed publications and grey literature reports on CPCRN capacity-building activities. Guided by the Interactive Systems Framework, we developed histories, case studies, and lessons learned for each strategy. Lessons were organized into themes.

Results

Three themes emerged: the importance of (1) community-engagement prior to and during implementation of capacity-building strategies, (2) establishing and sustaining partnerships, and (3) co-learning at the levels of centers, networks, and beyond.

Conclusion

CPCRN activities have increased the ability of community organizations to compete for external funds to support implementation, increased the use of evidence in real-world settings, and promoted the broad-scale implementation of cancer control interventions across more than eight states. Lessons from this narrative review highlight the value of long-term thematic networks and provide useful guidance to other research networks and future capacity-building efforts.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Adapting Evidence-Based Falls Prevention Programs for Remote Delivery — Implementation Insights through the RE-AIM Evaluation Framework to Promote Health Equity

Authors:

Marlana J. Kohn, Kelly A. Chadwick, & Lesley E. Steinman

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Prevention Science

Abstract:

COVID-19 disproportionally impacted the health and well-being of older adults—many of whom live with chronic conditions—due to their higher risk of dying and being hospitalized. It also created several secondary pandemics, including increased falls risk, sedentary behavior, social isolation, and physical inactivity due to limitations in mobility from lock-down policies. With falls as the leading cause of preventable death and hospitalizations, it became vital for in-person evidence-based falls prevention programs (EBFPPs) to pivot to remote delivery. In Spring 2020, many EBFPP administrators began re-designing programs for remote delivery to accommodate physical distancing guidelines necessitated by the pandemic. Transition to remote delivery was essential for older adults and persons with disabilities to access EBFPPs for staying healthy, falls and injury free, out of hospitals, and also keeping them socially engaged. We collaborated with the Administration on Community Living (ACL), the National Council on Aging (NCOA), and the National Falls Prevention Resource Center (NFPRC), for an in-depth implementation evaluation of remotely delivered EBFPPs. We examined the process of adapting and implementing four EBFPPs for remote delivery, best practices for implementing the programs remotely within the RE-AIM evaluation framework. This enhances NFPRC’s ongoing work supporting dissemination, implementation, and sustainability of EBFPPs. We purposively sampled organizations for maximum variation in organization and provider type, geographic location, and reach of underserved older populations (Black, Indigenous, or other People of Color (BIPOC), rural, disabilities).

This qualitative evaluation includes provider-level data from semi-structured interviews (N = 22) with program administrators, staff, and leaders. The interview guide included what, why, and how adaptations were made to EBFPP interventions and implementation strategies using Wiltsey-Stirman (2019) adaptations framework (FRAME), reach, and implementation outcomes (acceptability, feasibility, fidelity, and costs; Proctor et al., 2011), focusing on equity to learn for whom these programs were working and opportunities to address inequities. Findings demonstrate remote EBFPPs made planned and fidelity-consistent adaptations to remote delivery in partnership with researchers and community organizations, focusing on participant safety both in program content and delivery. Supports using and accessing technology were needed for delivery sites and leaders to facilitate engagement, and improved over time. While remote EBFPP delivery has increased access to EBFPPs for some populations from the perspective of program administrator, leaders, and staff (e.g., caregivers, rural-dwellers, persons with physical disabilities), the digital divide remains a barrier in access to and comfort using technology. Remote-delivered EBFPPs were acceptable and feasible to delivery organizations and leaders, were able to be delivered with fidelity using adaptations from program developers, but were more resource intensive and costly to implement compared to in-person. This work has important implications beyond the pandemic. Remote delivery has expanded access to groups traditionally underserved by in-person programming, particularly disability communities. This work will help answer important questions about reach, accessibility, feasibility, and cost of program delivery for older adults and people with disabilities at risk for falls, those living with chronic conditions, and communities most vulnerable to disparities in access to health care, health promotion programming, and health outcomes. It will also provide critical information to funders about elements required to adapt EBFPPs proven effective in in-person settings for remote delivery with fidelity to achieve comparable outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**