United States Archives - Page 16 of 29 - Implementation Science at UW

✪ Econometric evaluation of implementing a behavioral health integration intervention in primary care settings

Abstract:

Integrated behavioral health (IBH) is an approach to patient care that brings medical and behavioral health providers (BHPs) together to address both behavioral and medical needs within primary care settings. A large, pragmatic, national study aimed to test the effectiveness and measure the implementation costs of an intervention to improve IBH integration within primary care practices (IBH-PC). Assess the time and cost to practices of implementing a comprehensive practice-level intervention designed from the perspective of clinic owners to move behavioral service integration from co-location toward full integration as part of the IBH-PC study. IBH-PC program implementation costs were estimated in a representative sample of 8 practices using standard micro-econometric evaluation of activities outlined in the implementation workbook, including program implementation tasks, remote quality improvement coaching services, educational curricula, and learning community activities, over a 24-month period. The total median cost of implementing the IBH-PC program across all stages was $20,726 (range: $12,381 - $60,427). The median cost of the Planning Stage was $10,258 (range: $4,625 - $14,840), while the median cost of the Implementation Stage was $9,208 (range: $6,017 – 49,993). There were no statistically significant differences in practice or patient characteristics between the 8 selected practices and the larger IBH-PC practice sample (N=34). This study aimed to quantify the relative costs associated with integrating behavioral health into primary care. Although the cost assessment approach did not include all costs (fixed, variable, operational, and opportunity costs), the study aimed to develop a replicable and pragmatic measurement process with flexibility to adapt to emerging developments in each practice environment, providing a reasonable ballpark estimate of costs associated with implementation to help guide future executive decisions.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Advancing health equity through implementation science: Identifying and examining measures of the outer setting

✪ Learning from national implementation of the Veterans Affairs Clinical Resource Hub (CRH) program for improving access to care: protocol for a six year evaluation

Abstract:

Background

The Veterans Affairs (VA) Clinical Resource Hub (CRH) program aims to improve patient access to care by implementing time-limited, regionally based primary or mental health staffing support to cover local staffing vacancies. VA’s Office of Primary Care (OPC) designed CRH to support more than 1000 geographically disparate VA outpatient sites, many of which are in rural areas, by providing virtual contingency clinical staffing for sites experiencing primary care and mental health staffing deficits. The subsequently funded CRH evaluation, carried out by the VA Primary Care Analytics Team (PCAT), partnered with CRH program leaders and evaluation stakeholders to develop a protocol for a six-year CRH evaluation.
The objectives for developing the CRH evaluation protocol were to prospectively: 1) identify the outcomes CRH aimed to achieve, and the key program elements designed to achieve them; 2) specify evaluation designs and data collection approaches for assessing CRH progress and success; and 3) guide the activities of five geographically dispersed evaluation teams.

Methods

The protocol documents a multi-method CRH program evaluation design with qualitative and quantitative elements. The evaluation’s overall goal is to assess CRH’s return on investment to the VA and Veterans at six years through synthesis of findings on program effectiveness. The evaluation includes both observational and quasi-experimental elements reflecting impacts at the national, regional, outpatient site, and patient levels. The protocol is based on program evaluation theory, implementation science frameworks, literature on contingency staffing, and iterative review and revision by both research and clinical operations partners.

Discussion

Health systems increasingly seek to use data to guide management and decision-making for newly implemented clinical programs and policies. Approaches for planning evaluations to accomplish this goal, however, are not well-established. By publishing the protocol, we aim to increase the validity and usefulness of subsequent evaluation findings. We also aim to provide an example of a program evaluation protocol developed within a learning health systems partnership.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Educators’ experiences and reflections on the implementation of evidence-based practices for autistic students in public schools during the COVID-19 pandemic

Abstract:

Introduction

In 2020, the COVID-19 pandemic forced many schools to close their doors and transition to remote learning, disrupting how autistic students received school-based services and support. While school structure changes were challenging for all students, autistic students were uniquely affected, considering their reliance on predictability and routine; moreover, education settings are where most autistic children receive services. Much has been studied regarding the use of evidence-based practices (EBPs) for autistic students in traditional school settings, yet little is known about how educators use EBPs in remote learning environments in the wake of the COVID-19 pandemic.

Method

In this study, we explore educators’ experiences with EBP implementation at the height of the pandemic and educators’ reflections of its impact on autistic students and their school systems. Qualitative data were collected from 81 educators (general educators, special educators, and paraeducators) in semi-structured interviews regarding EBP use at the onset of the pandemic.

Results

Four themes emerged from interviews: (1) pandemic and remote learning environment challenges to inclusion and EBP use; (2) EBP use adaptations for remote learning environments; (3) pandemic and remote learning environment benefits for EBP use; and (4) considerations for EBP use beyond the pandemic.

Conclusion

These findings elucidate educators’ experiences using EBPs during the COVID-19 pandemic and highlight important areas of consideration for autism-focused EBP implementation as remote instruction continues to be a learning format. More research is needed to understand how to best implement EBPs for autistic students in this emerging instruction context.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation studio: implementation support program to build the capacity of rural community health educators serving immigrant communities to implement evidence-based cancer prevention and control interventions

Abstract:

Purpose

Rural community-based organizations (CBOs) serving immigrant communities are critical settings for implementing evidence-based interventions (EBIs). The Implementation Studio is a training and consultation program focused on facilitating the selection, adaptation, and implementation of cancer prevention and control EBIs. This paper describes implementation and evaluation of the Implementation Studio on CBO’s capacity to implement EBIs and their clients’ knowledge of colorectal cancer (CRC) screening and intention to screen.

Methods

Thirteen community health educators (CHEs) from two CBOs participated in the Implementation Studio. Both CBOs selected CRC EBIs during the Studio. The evaluation included two steps. The first step assessed the CHEs’ capacity to select, adapt, and implement an EBI. The second step assessed the effect of the CHEs-delivered EBIs on clients’ knowledge of CRC and intention to screen (n = 44).

Results

All CHEs were Hispanic and women. Pre/post-evaluation of the Studio showed an increase on CHEs knowledge about EBIs (pre: 23% to post: 75%; p < 0.001). CHEs’ ability to select, adapt, and implement EBIs also increased, respectively: select EBI (pre: 21% to post: 92%; p < 0.001), adapt EBI (pre: 21% to post: 92%; p < 0.001), and implement EBI (pre: 29% to post: 75%; p = 0.003). Pre/post-evaluation of the CHE-delivered EBI showed an increase on CRC screening knowledge (p < 0.5) and intention to screen for CRC by their clients.

Conclusion

Implementation Studio can address unique needs of low resource rural CBOs. An implementation support program with training and consultation has potential to build the capacity of rural CBOs serving immigrant communities to implementation of cancer prevention and control EBIs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Prevention of Opioid Use and Disorder Among Youth Involved in the Legal System: Innovation and Implementation of Four Studies Funded by the NIDA HEAL Initiative

✪ Understanding Clinic and Community Member Experiences with Implementation of Evidence-Based Strategies for HPV Vaccination in Safety-Net Primary Care Settings

Abstract:

HPV vaccination rates remain below target levels among adolescents in the United States, which is particularly concerning in safety-net populations with persistent disparities in HPV-associated cancer burden. Perspectives on evidence-based strategies (EBS) for HPV vaccination among key implementation participants, internal and external to clinics, can provide a better understanding of why these disparities persist. We conducted virtual interviews and focus groups, guided by the Practice Change Model, with clinic members (providers, clinic leaders, and clinic staff) and community members (advocates, parents, policy-level, and payers) in Los Angeles and New Jersey to understand common and divergent perspectives on and experiences with HPV vaccination in safety-net primary care settings. Fifty-eight interviews and seven focus groups were conducted (n = 65 total). Clinic members (clinic leaders n = 7, providers n = 12, and clinic staff n = 6) revealed conflicting HPV vaccine messaging, lack of shared motivation to reduce missed opportunities and improve workflows, and non-operability between clinic electronic health records and state immunization registries created barriers for implementing effective strategies. Community members (advocates n = 8, policy n = 11, payers n = 8, and parents n = 13) described lack of HPV vaccine prioritization among payers, a reliance on advocates to lead national agenda setting and facilitate local implementation, and opportunities to support and engage schools in HPV vaccine messaging and adolescents in HPV vaccine decision-making. Participants indicated the COVID-19 pandemic complicated prioritization of HPV vaccination but also created opportunities for change. These findings highlight design and selection criteria for identifying and implementing EBS (changing the intervention itself, or practice-level resources versus external motivators) that bring internal and external clinic partners together for targeted approaches that account for local needs in improving HPV vaccine uptake within safety-net settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ The special sauce of the Cancer Prevention and Control Research Network: 20 years of lessons learned in developing the evidence base, building community capacity, and translating research into practice

Abstract:

Purpose

The Cancer Prevention and Control Research Network (CPCRN) is a national network focused on accelerating the translation of cancer prevention and control research evidence into practice through collaborative, multicenter projects in partnership with diverse communities. From 2003 to 2022, the CPCRN included 613 members.

Methods

We: (1) characterize the extent and nature of collaborations through a bibliometric analysis of 20 years of Network publications; and (2) describe key features and functions of the CPCRN as related to organizational structure, productivity, impact, and focus on health equity, partnership development, and capacity building through analysis of 22 in-depth interviews and review of Network documentation.

Results

Searching Scopus for multicenter publications among the CPCRN members from their time of Network engagement yielded 1,074 collaborative publications involving two or more members. Both the overall number and content breadth of multicenter publications increased over time as the Network matured. Since 2004, members submitted 123 multicenter grant applications, of which 72 were funded (59%), totaling more than $77 million secured. Thematic analysis of interviews revealed that the CPCRN’s success—in terms of publication and grant productivity, as well as the breadth and depth of partnerships, subject matter expertise, and content area foci—is attributable to: (1) its people–the inclusion of members representing diverse content-area interests, multidisciplinary perspectives, and geographic contexts; (2) dedicated centralized structures and processes to enable and evaluate collaboration; and (3) focused attention to strategically adapting to change.

Conclusion

CPCRN’s history highlights organizational, strategic, and practical lessons learned over two decades to optimize Network collaboration for enhanced collective impact in cancer prevention and control. These insights may be useful to others seeking to leverage collaborative networks to address public health problems.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A 4D Theoretical Framework for Measuring Topic-Specific Influence on Twitter: Development and Usability Study on Dietary Sodium Tweets

Abstract:

Background

Social media has emerged as a prominent approach for health education and promotion. However, it is challenging to understand how to best promote health-related information on social media platforms such as Twitter. Despite commercial tools and prior studies attempting to analyze influence, there is a gap to fill in developing a publicly accessible and consolidated framework to measure influence and analyze dissemination strategies.

Objective

We aimed to develop a theoretical framework to measure topic-specific user influence on Twitter and to examine its usability by analyzing dietary sodium tweets to support public health agencies in improving their dissemination strategies.

Methods

We designed a consolidated framework for measuring influence that can capture topic-specific tweeting behaviors. The core of the framework is a summary indicator of influence decomposable into 4 dimensions: activity, priority, originality, and popularity. These measures can be easily visualized and efficiently computed for any Twitter account without the need for private access. We demonstrated the proposed methods by using a case study on dietary sodium tweets with sampled stakeholders and then compared the framework with a traditional measure of influence.

Results

More than half a million dietary sodium tweets from 2006 to 2022 were retrieved for 16 US domestic and international stakeholders in 4 categories, that is, public agencies, academic institutions, professional associations, and experts. We discovered that World Health Organization, American Heart Association, Food and Agriculture Organization of the United Nations (UN-FAO), and World Action on Salt (WASH) were the top 4 sodium influencers in the sample. Each had different strengths and weaknesses in their dissemination strategies, and 2 stakeholders with similar overall influence, that is, UN-FAO and WASH, could have significantly different tweeting patterns. In addition, we identified exemplars in each dimension of influence. Regarding tweeting activity, a dedicated expert published more sodium tweets than any organization in the sample in the past 16 years. In terms of priority, WASH had more than half of its tweets dedicated to sodium. UN-FAO had both the highest proportion of original sodium tweets and posted the most popular sodium tweets among all sampled stakeholders. Regardless of excellence in 1 dimension, the 4 most influential stakeholders excelled in at least 2 out of 4 dimensions of influence.

Conclusions

Our findings demonstrate that our method not only aligned with a traditional measure of influence but also advanced influence analysis by analyzing the 4 dimensions that contribute to topic-specific influence. This consolidated framework provides quantifiable measures for public health entities to understand their bottleneck of influence and refine their social media campaign strategies. Our framework can be applied to improve the dissemination of other health topics as well as assist policy makers and public campaign experts to maximize population impact.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ ADCC’s Improving Goal Concordant Care Initiative: Implementing Primary Palliative Care Principles

Abstract:

Background

High-quality, timely goals of care communication (GOCC) may improve patient and caregiver outcomes and promote care that is consistent with patient preferences.

Problem

Cancer patients, and their loved ones, appreciate GOCC; however, oncologists often lack formal communication training, institutional support and structures necessary to promote the delivery, documentation, and longitudinal follow-up of GOCC.

Proposed solution

The Alliance of Dedicated Cancer Centers (ADCC), representing 10 U.S. academic cancer hospitals, undertook the Improving Goal Concordant Care Initiative (IGCC). This national, 3-year implementation initiative was designed in Fall 2019 by a workgroup of quality, oncology, and palliative care leaders, as well as patient and family advisory committee members (PFAC). IGCC addresses systemic gaps by requiring four core components for participation: 1) Implementation of a formal communication skills training (CST) program, 2) Structured GOCC documentation in the electronic medical record that is visible to all clinicians, 3) Expectations regarding the timing and patient populations for GOCC, and 4) Implementation of a measurement framework.

Method

Dyads of palliative and oncology leaders committed to attend regularly scheduled, ADCC-led, virtual meetings during the design and implementation phase, incorporating PFAC feedback at every stage. Using the RE-AIM framework, we describe process and outcome evaluation measures defined by implementation and measures workgroups and collected routinely, including: CST completion; trainee evaluation response rate, trainee-reported quality of CST, trainee changes in self-efficacy and distress; percent of high-priority patients participating in GOCC, and patient-reported response to the “Heard and Understood” scale (HU). IGCC's impact will be assessed using claims-based utilization metrics near the end of life (EOLM) and followed longitudinally. Qualitative evaluations near the completion of IGCC will provide insight into perceived barriers, enabling factors, and sustainability.

Outcomes

Implementation of all IGCC components has begun at all sites. ADCC-wide, 35% of MD/DOs have completed CST (range by site: 8%–100%). CST is highly rated; in Quarter 3, 2022, 93%–100%, 90%–100% and 87%–100% of respondents reported above average to excellent CST quality, likelihood to use the skills and likelihood to recommend CST to others, respectively. Clinician self-efficacy and distress ratings are expected in late 2023. All sites have identified patient populations and continue to refine automated triggers and timelines; uptake of GOCC documentation has been slow. Eight of 10 sites have submitted patient-reported HU data. EOLM data are expected for all sites in early 2024.

Lesson learned

Flexibility in implementation with shared definitions, measures, and learnings about approaches optimizes the ability of all centers to collaborate and make progress in improving GOCC. Flexibility adds to the complexity of understanding intervention effectiveness, the critical intervention components and the fidelity necessary to achieve specific outcomes.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Translational Behavioral Medicine

Abstract:

Authors:

✪ Open Access

Read the full text open access in the journal Social Science and Medicine

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Introduction

Method

Results

Conclusion

Authors:

✪ Open Access

Read the full text open access in the journal Cancer Causes and Control

Abstract:

Purpose

Methods

Results

Conclusion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Prevention Science

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Cancer Causes and Control

Abstract:

Purpose

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Journal of Medical Internet Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Journal of Pain and Symptom Management

Abstract:

Background

Problem

Proposed solution

Method

Outcomes

Lesson learned