Original Research Archives - Page 5 of 7 - Implementation Science at UW

✪ Implementation determinants and strategies in integration of PrEP into maternal and child health and family planning services: experiences of frontline healthcare workers in Kenya

Abstract:

Background

Delivery of PrEP to adolescent girls and young women (AGYW) and to pregnant women through maternal and child health (MCH) and family planning (FP) clinics is scaling up in Kenya. Evaluation of implementation challenges and strategies is critical to optimize delivery.

Methods

We conducted focus group discussions (FGDs) with healthcare workers (HCWs) in MCH and FP clinics offering PrEP in a large implementation project in Kisumu, Kenya. Discussion guides were based on the Consolidated Framework for Implementation Research (CFIR). FGDs were audio recorded and transcribed. Directed content analysis was used to identify implementation challenges and strategies to overcome them.

Results

Fifty HCWs from 26 facilities participated in 8 FGDs. HCWs believed PrEP integration was appropriate because it met the needs of AGYW and pregnant women by providing a female-controlled prevention strategy and aligned with policy priorities of elimination of vertical HIV transmission. They were universally accepting of PrEP provision, especially through MCH clinics, noting the relative advantage of this approach because it: (1) enabled high coverage, (2) harmonized PrEP and MCH visits, and (3) minimized stigma compared to PrEP offered through HIV care clinics. However, HCWs noted implementation challenges affecting feasibility and adoption including: (1) increased workload and documentation burden amid workforce shortages, (2) insufficient health care worker knowledge (3) multiple implementing partners with competing priorities (4) drug and documentation form stockouts. HCWs employed various implementation strategies to overcome challenges, including task shifting from nurses to HIV testing providers, patient flow modifications (e.g., fast-tracking PrEP clients to reduce wait times), PrEP demand generation and myth clarification during health talks, provider education, dedicated PrEP delivery rooms, and coordination with adolescent-friendly services. Additional suggested strategies to improve PrEP integration included community education to increase broader PrEP awareness and enable shorter counseling sessions, and task-shifting data entry and client risk assessments.

Conclusions

HCWs were enthusiastic about the appropriateness and acceptability of integrating PrEP services into MCH and FP clinics but noted challenges to adoption and feasibility. Strategies to address challenges focused on improving provider time and space constraints, and increasing provider and client knowledge.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Toward a more comprehensive understanding of organizational influences on implementation: the organization theory for implementation science framework

Abstract:

Introduction

Implementation is influenced by factors beyond individual clinical settings. Nevertheless, implementation research often focuses on factors related to individual providers and practices, potentially due to limitations of available frameworks. Extant frameworks do not adequately capture the myriad organizational influences on implementation. Organization theories capture diverse organizational influences but remain underused in implementation science. To advance their use among implementation scientists, we distilled 70 constructs from nine organization theories identified in our previous work into theoretical domains in the Organization Theory for Implementation Science (OTIS) framework.

Methods

The process of distilling organization theory constructs into domains involved concept mapping and iterative consensus-building. First, we recruited organization and implementation scientists to participate in an online concept mapping exercise in which they sorted organization theory constructs into domains representing similar theoretical concepts. Multidimensional scaling and hierarchical cluster analyses were used to produce visual representations (clusters) of the relationships among constructs in concept maps. Second, to interpret concept maps, we engaged members of the Cancer Prevention and Control Research Network (CPCRN) OTIS workgroup in consensus-building discussions.

Results

Twenty-four experts participated in concept mapping. Based on resulting construct groupings' coherence, OTIS workgroup members selected the 10-cluster solution (from options of 7–13 clusters) and then reorganized clusters in consensus-building discussions to increase coherence. This process yielded six final OTIS domains: organizational characteristics (e.g., size; age); governance and operations (e.g., organizational and social subsystems); tasks and processes (e.g., technology cycles; excess capacity); knowledge and learning (e.g., tacit knowledge; sense making); characteristics of a population of organizations (e.g., isomorphism; selection pressure); and interorganizational relationships (e.g., dominance; interdependence).

Discussion

Organizational influences on implementation are poorly understood, in part due to the limitations of extant frameworks. To improve understanding of organizational influences on implementation, we distilled 70 constructs from nine organization theories into six domains. Applications of the OTIS framework will enhance understanding of organizational influences on implementation, promote theory-driven strategies for organizational change, improve understanding of mechanisms underlying relationships between OTIS constructs and implementation, and allow for framework refinement. Next steps include testing the OTIS framework in implementation research and adapting it for use among policymakers and practitioners.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Abstract:

Background

Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods

In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results

Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83–1.02 to 0.62–0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81–27.3 to 0.62–19.50, resulting in an approximate average improvement of 18%.

Conclusions

These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Organizational contexts, implementation processes, and capacity outcomes of multicultural, multilingual Home-Based Programs in public initiatives: A Mixed-Methods study

Abstract:

Aims

The study aim was to examine the impact of a home-based programme intervention on organizational contexts, implementation processes and organizational capacity outcomes from multicultural, multilingual participants working at community-based organizations.

Design

This was a sequential exploratory, mixed-methods longitudinal study using community-based participatory research principles.

Sample

Twenty participants from nine multicultural, multilingual community-based organizations were in this public health initiative's intervention to develop community-designed, home-based programmes.

Methods

Capacity building providers delivered the intervention selected by the funders. Workshop outcomes were descriptively measured in April/May 2019. In April/May and November 2019, participants completed surveys about organizational contexts, implementation processes and organizational capacity outcomes, which were analysed with t-tests using the organization as the unit of analysis. Qualitative data were analysed using content analysis.

Results

Seven programmes were new and two were modified. As workshop outcomes, 59% of participants reported increased overall implementation knowledge and 74% reported capacity building providers as the most helpful resource. After 6 to 7 months, no statistically significant changes were noted in organizational contexts, implementation processes or organizational capacity outcomes. Participants benefited from capacity building because they had programmes developed, formed partnerships with capacity building providers, gained implementation knowledge, and engaged in networking.

Conclusion

Participants reported excellent individual and organizational strengths. Many Initiative factors contributed to no statistical changes. Namely, there was no opportunity for baseline data; limited community-based organization engagement in the intervention model selection, timeline and processes; the Initiative's timeline did not fit participants' timeline; insufficient time to develop culturally and linguistically appropriate programmes; late literature review abstracts; lack of adequate, planful and paid capacity building time; and a contract requirement to have the programme due when it was not implementable. These Initiative design factors, as reported by participants, limited the Initiative's home-based programme development.

Impact

This study highlights the strengths of participants, community-based organizations and capacity building providers. Model selection, timeline and budget were identified as key factors for equitable implementation in multicultural, multilingual organizations.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Econometric evaluation of implementing a behavioral health integration intervention in primary care settings

Abstract:

Integrated behavioral health (IBH) is an approach to patient care that brings medical and behavioral health providers (BHPs) together to address both behavioral and medical needs within primary care settings. A large, pragmatic, national study aimed to test the effectiveness and measure the implementation costs of an intervention to improve IBH integration within primary care practices (IBH-PC). Assess the time and cost to practices of implementing a comprehensive practice-level intervention designed from the perspective of clinic owners to move behavioral service integration from co-location toward full integration as part of the IBH-PC study. IBH-PC program implementation costs were estimated in a representative sample of 8 practices using standard micro-econometric evaluation of activities outlined in the implementation workbook, including program implementation tasks, remote quality improvement coaching services, educational curricula, and learning community activities, over a 24-month period. The total median cost of implementing the IBH-PC program across all stages was $20,726 (range: $12,381 - $60,427). The median cost of the Planning Stage was $10,258 (range: $4,625 - $14,840), while the median cost of the Implementation Stage was $9,208 (range: $6,017 – 49,993). There were no statistically significant differences in practice or patient characteristics between the 8 selected practices and the larger IBH-PC practice sample (N=34). This study aimed to quantify the relative costs associated with integrating behavioral health into primary care. Although the cost assessment approach did not include all costs (fixed, variable, operational, and opportunity costs), the study aimed to develop a replicable and pragmatic measurement process with flexibility to adapt to emerging developments in each practice environment, providing a reasonable ballpark estimate of costs associated with implementation to help guide future executive decisions.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Assessing drivers of implementing “Scaling-up the Systems Analysis and Improvement Approach” for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves

Authors:

Celso Inguane, Sarah Gimbel, Caroline Soi, Esperança Tavede, Filipe Murgorgo, Xavier Isidoro, Yaesh Sidat, Regina Nassiaca, Joana Coutinho, Maria Cruz, Mery Agostinho, Fernando Amaral, Aneth Dinis, Kristjana Ásbjörnsdóttir, Jonny Crocker, Nélia Manaca, Isaias Ramiro, James Pfeiffer, Maria de Fátima Cuembelo, & Kenneth Sherr

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: July 2023

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA’s effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases.

Methods

We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi).

Results

We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA’s compatibility with organizational structures, processes, and priorities of Mozambique’s health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds.

Conclusions

The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities.

Trial registration

ClinicalTrials.gov, NCT03425136. Registered on 02/06/2018.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation studio: implementation support program to build the capacity of rural community health educators serving immigrant communities to implement evidence-based cancer prevention and control interventions

Abstract:

Purpose

Rural community-based organizations (CBOs) serving immigrant communities are critical settings for implementing evidence-based interventions (EBIs). The Implementation Studio is a training and consultation program focused on facilitating the selection, adaptation, and implementation of cancer prevention and control EBIs. This paper describes implementation and evaluation of the Implementation Studio on CBO’s capacity to implement EBIs and their clients’ knowledge of colorectal cancer (CRC) screening and intention to screen.

Methods

Thirteen community health educators (CHEs) from two CBOs participated in the Implementation Studio. Both CBOs selected CRC EBIs during the Studio. The evaluation included two steps. The first step assessed the CHEs’ capacity to select, adapt, and implement an EBI. The second step assessed the effect of the CHEs-delivered EBIs on clients’ knowledge of CRC and intention to screen (n = 44).

Results

All CHEs were Hispanic and women. Pre/post-evaluation of the Studio showed an increase on CHEs knowledge about EBIs (pre: 23% to post: 75%; p < 0.001). CHEs’ ability to select, adapt, and implement EBIs also increased, respectively: select EBI (pre: 21% to post: 92%; p < 0.001), adapt EBI (pre: 21% to post: 92%; p < 0.001), and implement EBI (pre: 29% to post: 75%; p = 0.003). Pre/post-evaluation of the CHE-delivered EBI showed an increase on CRC screening knowledge (p < 0.5) and intention to screen for CRC by their clients.

Conclusion

Implementation Studio can address unique needs of low resource rural CBOs. An implementation support program with training and consultation has potential to build the capacity of rural CBOs serving immigrant communities to implementation of cancer prevention and control EBIs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ The special sauce of the Cancer Prevention and Control Research Network: 20 years of lessons learned in developing the evidence base, building community capacity, and translating research into practice

Abstract:

Purpose

The Cancer Prevention and Control Research Network (CPCRN) is a national network focused on accelerating the translation of cancer prevention and control research evidence into practice through collaborative, multicenter projects in partnership with diverse communities. From 2003 to 2022, the CPCRN included 613 members.

Methods

We: (1) characterize the extent and nature of collaborations through a bibliometric analysis of 20 years of Network publications; and (2) describe key features and functions of the CPCRN as related to organizational structure, productivity, impact, and focus on health equity, partnership development, and capacity building through analysis of 22 in-depth interviews and review of Network documentation.

Results

Searching Scopus for multicenter publications among the CPCRN members from their time of Network engagement yielded 1,074 collaborative publications involving two or more members. Both the overall number and content breadth of multicenter publications increased over time as the Network matured. Since 2004, members submitted 123 multicenter grant applications, of which 72 were funded (59%), totaling more than $77 million secured. Thematic analysis of interviews revealed that the CPCRN’s success—in terms of publication and grant productivity, as well as the breadth and depth of partnerships, subject matter expertise, and content area foci—is attributable to: (1) its people–the inclusion of members representing diverse content-area interests, multidisciplinary perspectives, and geographic contexts; (2) dedicated centralized structures and processes to enable and evaluate collaboration; and (3) focused attention to strategically adapting to change.

Conclusion

CPCRN’s history highlights organizational, strategic, and practical lessons learned over two decades to optimize Network collaboration for enhanced collective impact in cancer prevention and control. These insights may be useful to others seeking to leverage collaborative networks to address public health problems.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

“Another tool in the toolkit”—Perceptions, suggestions, and concerns of emergency service providers about the implementation of a supervised consumption site

✪ Adapting Evidence-Based Falls Prevention Programs for Remote Delivery — Implementation Insights through the RE-AIM Evaluation Framework to Promote Health Equity

Abstract:

COVID-19 disproportionally impacted the health and well-being of older adults—many of whom live with chronic conditions—due to their higher risk of dying and being hospitalized. It also created several secondary pandemics, including increased falls risk, sedentary behavior, social isolation, and physical inactivity due to limitations in mobility from lock-down policies. With falls as the leading cause of preventable death and hospitalizations, it became vital for in-person evidence-based falls prevention programs (EBFPPs) to pivot to remote delivery. In Spring 2020, many EBFPP administrators began re-designing programs for remote delivery to accommodate physical distancing guidelines necessitated by the pandemic. Transition to remote delivery was essential for older adults and persons with disabilities to access EBFPPs for staying healthy, falls and injury free, out of hospitals, and also keeping them socially engaged. We collaborated with the Administration on Community Living (ACL), the National Council on Aging (NCOA), and the National Falls Prevention Resource Center (NFPRC), for an in-depth implementation evaluation of remotely delivered EBFPPs. We examined the process of adapting and implementing four EBFPPs for remote delivery, best practices for implementing the programs remotely within the RE-AIM evaluation framework. This enhances NFPRC’s ongoing work supporting dissemination, implementation, and sustainability of EBFPPs. We purposively sampled organizations for maximum variation in organization and provider type, geographic location, and reach of underserved older populations (Black, Indigenous, or other People of Color (BIPOC), rural, disabilities).

This qualitative evaluation includes provider-level data from semi-structured interviews (N = 22) with program administrators, staff, and leaders. The interview guide included what, why, and how adaptations were made to EBFPP interventions and implementation strategies using Wiltsey-Stirman (2019) adaptations framework (FRAME), reach, and implementation outcomes (acceptability, feasibility, fidelity, and costs; Proctor et al., 2011), focusing on equity to learn for whom these programs were working and opportunities to address inequities. Findings demonstrate remote EBFPPs made planned and fidelity-consistent adaptations to remote delivery in partnership with researchers and community organizations, focusing on participant safety both in program content and delivery. Supports using and accessing technology were needed for delivery sites and leaders to facilitate engagement, and improved over time. While remote EBFPP delivery has increased access to EBFPPs for some populations from the perspective of program administrator, leaders, and staff (e.g., caregivers, rural-dwellers, persons with physical disabilities), the digital divide remains a barrier in access to and comfort using technology. Remote-delivered EBFPPs were acceptable and feasible to delivery organizations and leaders, were able to be delivered with fidelity using adaptations from program developers, but were more resource intensive and costly to implement compared to in-person. This work has important implications beyond the pandemic. Remote delivery has expanded access to groups traditionally underserved by in-person programming, particularly disability communities. This work will help answer important questions about reach, accessibility, feasibility, and cost of program delivery for older adults and people with disabilities at risk for falls, those living with chronic conditions, and communities most vulnerable to disparities in access to health care, health promotion programming, and health outcomes. It will also provide critical information to funders about elements required to adapt EBFPPs proven effective in in-person settings for remote delivery with fidelity to achieve comparable outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Reproductive Health

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Methods

Results

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access Journal of Advanced Nursing

Abstract:

Aims

Design

Sample

Methods

Results

Conclusion

Impact

Authors:

✪ Open Access

Read the full text in the open access journal Translational Behavioral Medicine

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

Methods

Results

Conclusions

Trial registration

Authors:

✪ Open Access

Read the full text open access in the journal Cancer Causes and Control

Abstract:

Purpose

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Cancer Causes and Control

Abstract:

Purpose

Methods

Results

Conclusion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal The International Journal on Drug Policy

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract: