United States Archives - Page 15 of 29 - Implementation Science at UW

✪ Formative Evaluation of a Comprehensive Self-Management Intervention for Irritable Bowel Syndrome, Comorbid Anxiety, and Depression: Mixed Methods Study

Abstract:

Background

Irritable bowel syndrome (IBS) is a disorder of the gut-brain interaction that is associated with abdominal pain, altered bowel patterns, and reduced quality of life. Up to 50% of patients with IBS also report anxiety or depressive symptoms. Although effective self-management interventions exist for individuals with IBS, few have been effectively implemented, and most do not consider the unique needs of patients with comorbid IBS and anxiety or depression.

Objective

This study aimed to determine the anticipated acceptability, appropriateness, feasibility, and usability of a comprehensive self-management intervention using an implementation science and human-centered design approach among individuals with comorbid IBS and anxiety or depression and health care providers.

Methods

A convergent mixed methods design was used to elicit feedback on the comprehensive self-management intervention outline and content to identify refinement needs before testing. Patients with IBS and moderate to severe anxiety or depression and health care providers were purposefully sampled from primary care and gastroenterology settings. Participants completed semistructured interviews and surveys on anticipated acceptability, appropriateness, feasibility, and usability.

Results

Patient participants (n=12) were on average 36.8 (SD 12.2) years of age, and 42% (5/12) were currently receiving psychological therapy. Health care providers (n=14) were from primary care (n=7) and gastroenterology (n=7) settings. The mean usability scores (out of 100) were 52.5 (SD 14.5) for patients and 45.6 (SD 11.6) for providers. For patients and providers, qualitative data expanded the quantitative findings for acceptability and appropriateness. Acceptability findings were the comprehensive nature of the intervention and discussion of the gut-brain interaction. For appropriateness, participants reported that the intervention provided structure, accountability, and support. Feasibility was confirmed for patients, but there was a divergence of findings between quantitative and qualitative measures for providers. Patients focused on intervention feasibility, while providers focused on implementation feasibility in the clinic. Identified usability issues to address before implementation included the intervention delivery format, length, and lack of integration into health care settings that, if not addressed, may limit the reach of the intervention

Conclusions

Patients and health care providers found the intervention acceptable and appropriate. Several feasibility and usability issues were identified, including intervention delivery methods, length of intervention, and the best methods to implement in the clinic setting. The next steps are to refine the intervention to address the identified issues and test in a pilot study whether addressing usability issues leads to the anticipated improvements in implementation and uptake.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Lung Cancer Screening in People With HIV: A Mixed-Methods Study of Patient and Provider Perspectives

✪ Assessment of implementation methods in sepsis: study protocol for a cluster-randomized hybrid type 2 trial

Abstract:

Background

Sepsis is the leading cause of intensive care unit (ICU) admission and ICU death. In recognition of the burden of sepsis, the Surviving Sepsis Campaign (SSC) and the Institute for Healthcare Improvement developed sepsis “bundles” (goals to accomplish over a specific time period) to facilitate SSC guideline implementation in clinical practice. Using the SSC 3-h bundle as a base, the Centers for Medicare and Medicaid Services developed a 3-h sepsis bundle that has become the national standard for early management of sepsis. Emerging observational data, from an analysis conducted for the AIMS grant application, suggest there may be additional mortality benefit from even earlier implementation of the 3-h bundle, i.e., the 1-h bundle.

Method

The primary aims of this randomized controlled trial are to: (1) examine the effect on clinical outcomes of Emergency Department initiation of the elements of the 3-h bundle within the traditional 3 h versus initiating within 1 h of sepsis recognition and (2) examine the extent to which a rigorous implementation strategy will improve implementation and compliance with both the 1-h bundle and the 3-h bundle. This study will be entirely conducted in the Emergency Department at 18 sites. A secondary aim is to identify clinical sepsis phenotypes and their impact on treatment outcomes.

Discussion

This cluster-randomized trial, employing implementation science methodology, is timely and important to the field. The hybrid effectiveness-implementation design is likely to have an impact on clinical practice in sepsis management by providing a rigorous evaluation of the 1- and 3-h bundles.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Integrating a focus on health equity in implementation science: Case examples from the national cancer institute’s implementation science in cancer control centers (ISC3) network

Abstract:

Background

A Health Equity Task Force (HETF) of members from seven Centers funded by the National Cancer Institute’s (NCI) Implementation Science in Cancer Control Centers (ISC3) network sought to identify case examples of how Centers were applying a focus on health equity in implementation science to inform future research and capacity-building efforts.

Methods

HETF members at each ISC3 collected information on how health equity was conceptualized, operationalized, and addressed in initial research and capacity-building efforts across the seven ISC3 Centers funded in 2019–2020. Each Center completed a questionnaire assessing five health equity domains central to implementation science (e.g., community engagement; implementation science theories, models, and frameworks (TMFs); and engaging underrepresented scholars). Data generated illustrative examples from these five domains.

Results

Centers reported a range of approaches focusing on health equity in implementation research and capacity-building efforts, including (1) engaging diverse community partners/settings in making decisions about research priorities and projects; (2) applying health equity within a single TMF applied across projects or various TMFs used in specific projects; (3) evaluating health equity in operationalizing and measuring health and implementation outcomes; (4) building capacity for health equity-focused implementation science among trainees, early career scholars, and partnering organizations; and (5) leveraging varying levels of institutional resources and efforts to engage, include, and support underrepresented scholars.

Conclusions

Examples of approaches to integrating health equity across the ISC3 network can inform other investigators and centers’ efforts to build capacity and infrastructure to support growth and expansion of health equity-focused implementation science.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Promoting alcohol treatment engagement post-hospitalization with brief intervention, medications and CBT4CBT: protocol for a randomized clinical trial in a diverse patient population

Abstract:

Background

Alcohol use disorder (AUD) commonly causes hospitalization, particularly for individuals disproportionately impacted by structural racism and other forms of marginalization. The optimal approach for engaging hospitalized patients with AUD in treatment post-hospital discharge is unknown. We describe the rationale, aims, and protocol for Project ENHANCE (ENhancing Hospital-initiated Alcohol TreatmeNt to InCrease Engagement), a clinical trial testing increasingly intensive approaches using a hybrid type 1 effectiveness-implementation approach.

Methods

We are randomizing English and/or Spanish-speaking individuals with untreated AUD (n = 450) from a large, urban, academic hospital in New Haven, CT to: (1) Brief Negotiation Interview (with referral and telephone booster) alone (BNI), (2) BNI plus facilitated initiation of medications for alcohol use disorder (BNI + MAUD), or (3) BNI + MAUD + initiation of computer-based training for cognitive behavioral therapy (CBT4CBT, BNI + MAUD + CBT4CBT). Interventions are delivered by Health Promotion Advocates. The primary outcome is AUD treatment engagement 34 days post-hospital discharge. Secondary outcomes include AUD treatment engagement 90 days post-discharge and changes in self-reported alcohol use and phosphatidylethanol. Exploratory outcomes include health care utilization. We will explore whether the effectiveness of the interventions on AUD treatment engagement and alcohol use outcomes differ across and within racialized and ethnic groups, consistent with disproportionate impacts of AUD. Lastly, we will conduct an implementation-focused process evaluation, including individual-level collection and statistical comparisons between the three conditions of costs to providers and to patients, cost-effectiveness indices (effectiveness/cost ratios), and cost–benefit indices (benefit/cost ratios, net benefit [benefits minus costs). Graphs of individual- and group-level effectiveness x cost, and benefits x costs, will portray relationships between costs and effectiveness and between costs and benefits for the three conditions, in a manner that community representatives also should be able to understand and use.

Conclusions

Project ENHANCE is expected to generate novel findings to inform future hospital-based efforts to promote AUD treatment engagement among diverse patient populations, including those most impacted by AUD.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Toward a more comprehensive understanding of organizational influences on implementation: the organization theory for implementation science framework

Abstract:

Introduction

Implementation is influenced by factors beyond individual clinical settings. Nevertheless, implementation research often focuses on factors related to individual providers and practices, potentially due to limitations of available frameworks. Extant frameworks do not adequately capture the myriad organizational influences on implementation. Organization theories capture diverse organizational influences but remain underused in implementation science. To advance their use among implementation scientists, we distilled 70 constructs from nine organization theories identified in our previous work into theoretical domains in the Organization Theory for Implementation Science (OTIS) framework.

Methods

The process of distilling organization theory constructs into domains involved concept mapping and iterative consensus-building. First, we recruited organization and implementation scientists to participate in an online concept mapping exercise in which they sorted organization theory constructs into domains representing similar theoretical concepts. Multidimensional scaling and hierarchical cluster analyses were used to produce visual representations (clusters) of the relationships among constructs in concept maps. Second, to interpret concept maps, we engaged members of the Cancer Prevention and Control Research Network (CPCRN) OTIS workgroup in consensus-building discussions.

Results

Twenty-four experts participated in concept mapping. Based on resulting construct groupings' coherence, OTIS workgroup members selected the 10-cluster solution (from options of 7–13 clusters) and then reorganized clusters in consensus-building discussions to increase coherence. This process yielded six final OTIS domains: organizational characteristics (e.g., size; age); governance and operations (e.g., organizational and social subsystems); tasks and processes (e.g., technology cycles; excess capacity); knowledge and learning (e.g., tacit knowledge; sense making); characteristics of a population of organizations (e.g., isomorphism; selection pressure); and interorganizational relationships (e.g., dominance; interdependence).

Discussion

Organizational influences on implementation are poorly understood, in part due to the limitations of extant frameworks. To improve understanding of organizational influences on implementation, we distilled 70 constructs from nine organization theories into six domains. Applications of the OTIS framework will enhance understanding of organizational influences on implementation, promote theory-driven strategies for organizational change, improve understanding of mechanisms underlying relationships between OTIS constructs and implementation, and allow for framework refinement. Next steps include testing the OTIS framework in implementation research and adapting it for use among policymakers and practitioners.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Participatory logic modeling in a multi-site initiative to advance implementation science

Abstract:

Background

Logic models map the short-term and long-term outcomes that are expected to occur with a program, and thus are an essential tool for evaluation. Funding agencies, especially in the United States (US), have encouraged the use of logic models among their grantees. They also use logic models to clarify expectations for their own funding initiatives. It is increasingly recognized that logic models should be developed through a participatory approach which allows input from those who carry out the program being evaluated. While there are many positive examples of participatory logic modeling, funders have generally not engaged grantees in developing the logic model associated with their own initiatives. This article describes an instance where a US funder of a multi-site initiative fully engaged the funded organizations in developing the initiative logic model. The focus of the case study is Implementation Science Centers in Cancer Control (ISC3), a multi-year initiative funded by the National Cancer Institute.

Methods

The reflective case study was collectively constructed by representatives of the seven centers funded under ISC3. Members of the Cross-Center Evaluation (CCE) Work Group jointly articulated the process through which the logic model was developed and refined. Individual Work Group members contributed descriptions of how their respective centers reviewed and used the logic model. Cross-cutting themes and lessons emerged through CCE Work Group meetings and the writing process.

Results

The initial logic model for ISC3 changed in significant ways as a result of the input of the funded groups. Authentic participation in the development of the logic model led to strong buy-in among the centers, as evidenced by their utilization. The centers shifted both their evaluation design and their programmatic strategy to better accommodate the expectations reflected in the initiative logic model.

Conclusions

The ISC3 case study demonstrates how participatory logic modeling can be mutually beneficial to funders, grantees and evaluators of multi-site initiatives. Funded groups have important insights about what is feasible and what will be required to achieve the initiative’s stated objectives. They can also help identify the contextual factors that either inhibit or facilitate success, which can then be incorporated into both the logic model and the evaluation design. In addition, when grantees co-develop the logic model, they have a better understanding and appreciation of the funder’s expectations and thus are better positioned to meet those expectations.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Abstract:

Background

Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods

In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results

Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83–1.02 to 0.62–0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81–27.3 to 0.62–19.50, resulting in an approximate average improvement of 18%.

Conclusions

These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Disruptions to and Innovations in HPV Vaccination Strategies within Safety-Net Healthcare Settings Resulting from the COVID-19 Pandemic

Abstract:

Abstract

The COVID-19 pandemic disrupted healthcare delivery within safety-net settings. Barriers to and facilitators of human papillomavirus (HPV) vaccination during the pandemic can inform future HPV vaccine strategies for underserved communities. Qualitative interviews (n = 52) between December 2020 and January 2022 in Los Angeles and New Jersey were conducted with providers, clinic leaders, clinic staff, advocates, payers, and policy-level representatives involved in the HPV vaccine process. Using the updated Consolidated Framework for Implementation Research we identified (1) outer setting barriers (i.e., vaccine hesitancy driven by social media, political views during the pandemic) and facilitators (e.g., partnerships); (2) inner setting clinic facilitators (i.e., motivation-driven clinic metrics, patient outreach, vaccine outreach events); (3) individual characteristics such as patient barriers (i.e., less likely to utilize clinic services during the pandemic and therefore, additional outreach to address missed vaccine doses are needed); (4) innovations in HPV vaccination strategies (i.e., clinic workflow changes to minimize exposure to COVID-19, leveraging new community partnerships (e.g., with local schools)); and (5) implementation strategies (i.e., multisectoral commitment to HPV goals). Pandemic setbacks forced safety-net settings to develop new vaccine approaches and partnerships that may translate to new implementation strategies for HPV vaccination within local contexts and communities.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Organizational contexts, implementation processes, and capacity outcomes of multicultural, multilingual Home-Based Programs in public initiatives: A Mixed-Methods study

Abstract:

Aims

The study aim was to examine the impact of a home-based programme intervention on organizational contexts, implementation processes and organizational capacity outcomes from multicultural, multilingual participants working at community-based organizations.

Design

This was a sequential exploratory, mixed-methods longitudinal study using community-based participatory research principles.

Sample

Twenty participants from nine multicultural, multilingual community-based organizations were in this public health initiative's intervention to develop community-designed, home-based programmes.

Methods

Capacity building providers delivered the intervention selected by the funders. Workshop outcomes were descriptively measured in April/May 2019. In April/May and November 2019, participants completed surveys about organizational contexts, implementation processes and organizational capacity outcomes, which were analysed with t-tests using the organization as the unit of analysis. Qualitative data were analysed using content analysis.

Results

Seven programmes were new and two were modified. As workshop outcomes, 59% of participants reported increased overall implementation knowledge and 74% reported capacity building providers as the most helpful resource. After 6 to 7 months, no statistically significant changes were noted in organizational contexts, implementation processes or organizational capacity outcomes. Participants benefited from capacity building because they had programmes developed, formed partnerships with capacity building providers, gained implementation knowledge, and engaged in networking.

Conclusion

Participants reported excellent individual and organizational strengths. Many Initiative factors contributed to no statistical changes. Namely, there was no opportunity for baseline data; limited community-based organization engagement in the intervention model selection, timeline and processes; the Initiative's timeline did not fit participants' timeline; insufficient time to develop culturally and linguistically appropriate programmes; late literature review abstracts; lack of adequate, planful and paid capacity building time; and a contract requirement to have the programme due when it was not implementable. These Initiative design factors, as reported by participants, limited the Initiative's home-based programme development.

Impact

This study highlights the strengths of participants, community-based organizations and capacity building providers. Model selection, timeline and budget were identified as key factors for equitable implementation in multicultural, multilingual organizations.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal American Journal of Preventive Medicine

Authors:

✪ Open Access

Read the full text in the open access journal Trials

Abstract:

Abstract:

Background

Method

Discussion

Authors:

✪ Open Access

Read the full text in the open access Journal of Clinical and Translational Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the journal Addiction Science and Clinical Practice

Abstract:

Background

Methods

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Methods

Results

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Healthcare

Abstract:

Abstract

Authors:

✪ Open Access

Read the full text in the open access Journal of Advanced Nursing

Abstract:

Aims

Design

Sample

Methods

Results

Conclusion

Impact