2021 Archives - Page 6 of 7 - Implementation Science at UW

✪ Incorporating Method Dissatisfaction into Unmet Need for Contraception: Implications for Measurement and Impact

Abstract:

While unmet need for contraception is commonly used to assess programmatic needs, it inadequately captures the complexity of fertility and contraceptive preferences, including women's satisfaction with their contraceptive method. In their 2019 commentary, Sarah Rominski and Rob Stephenson propose reclassifying dissatisfied current users as having an unmet need for contraception. As revising the current definition based on their proposal would require significant investment to update survey and monitoring systems, understanding the potential impact on current estimates of unmet need is critical.

We estimated the impact of this approach in a Kenyan cohort of modern contraceptive users. We found the prevalence of method dissatisfaction ranges from 6.6% (95% confidence interval [CI] 5.6–7.8%) to 18.9% (95% CI 17.1–20.9%); if applied nationally, this results in a large (approximately 25–70%) increase in Kenya's current estimate of unmet need for any contraception. Our findings suggest a large impact on unmet need estimates for equivalent populations.

Overall, we advocate for better measurements of method satisfaction and acceptability, with metrics developed that are robust to socioeconomic gradients and validated in low- and middle-income settings to ensure women's contraceptive needs are captured equitably.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Mapping the organizational readiness to change assessment to the Consolidated Framework for Implementation Research

Abstract:

Background

Implementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.

Methods

Two distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.

Results

ORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.

Conclusions

Mapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Assessing the usability of complex psychosocial interventions: The Intervention Usability Scale

Abstract:

Background

Usability—the extent to which an intervention can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction—may be a key determinant of implementation success. However, few instruments have been developed to measure the design quality of complex health interventions (i.e., those with several interacting components). This study evaluated the structural validity of the Intervention Usability Scale (IUS), an adapted version of the well-established System Usability Scale (SUS) for digital technologies, to measure the usability of a leading complex psychosocial intervention, Motivational Interviewing (MI), for behavioral health service delivery in primary care. Prior SUS studies have found both one- and two-factor solutions, both of which were examined in this study of the IUS.

Method

A survey administered to 136 medical professionals from 11 primary-care sites collected demographic information and IUS ratings for MI, the evidence-based psychosocial intervention that primary-care providers reported using most often for behavioral health service delivery. Factor analyses replicated procedures used in prior research on the SUS.

Results

Analyses indicated that a two-factor solution (with “usable” and “learnable” subscales) best fit the data, accounting for 54.1% of the variance. Inter-item reliabilities for the total score, usable subscale, and learnable subscale were α = .83, α = .84, and α = .67, respectively.

Conclusion

This study provides evidence for a two-factor IUS structure consistent with some prior research, as well as acceptable reliability. Implications for implementation research evaluating the usability of complex health interventions are discussed, including the potential for future comparisons across multiple interventions and provider types, as well as the use of the IUS to evaluate the relationship between usability and implementation outcomes such as feasibility.

Plain language abstract

The ease with which evidence-based psychosocial interventions (EBPIs) can be readily adopted and used by service providers is a key predictor of implementation success, but very little implementation research has attended to intervention usability. No quantitative instruments exist to evaluate the usability of complex health interventions, such as the EBPIs that are commonly used to integrate mental and behavioral health services into primary care. This article describes the evaluation of the first quantitative instrument for assessing the usability of complex health interventions and found that its factor structure replicated some research with the original version of the instrument, a scale developed to assess the usability of digital systems.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

A Theory-Informed Approach to Locally Managed Learning School Systems: Integrating Treatment Integrity and Youth Mental Health Outcome Data to Promote Youth Mental Health

✪ Hypothetical acceptability of hospital-based post-mortem pediatric minimally invasive tissue sampling in Malawi: The role of complex social relationships

Abstract:

Background

Child mortality rates remain unacceptably high in low-resource settings. Cause of death (CoD) is often unknown. Minimally invasive tissue sampling (MITS)–using biopsy needles to obtain post-mortem samples–for histopathological and microbiologic investigation is increasingly being promoted to improve child and adult CoD attribution. “MITS in Malawi” is a sub-study of the Childhood Acute Illness & Nutrition (CHAIN) Network, which aims to identify biological and socioeconomic mortality risk factors among young children hospitalized for acute illness or undernutrition. MITS in Malawi employs standard MITS and a novel post-mortem endoscopic intestinal sampling approach to better understand CoD among children with acute illness and/or malnutrition who die during hospitalization.

Aim

To understand factors that may impact MITS acceptability and inform introduction of the procedure to ascertain CoD among children with acute illness or malnutrition who die during hospitalization in Malawi.

Methods

We conducted eight focus group discussions with key hospital staff and community members (religious leaders and parents of children under 5) to explore attitudes towards MITS and inform consent processes prior to commencing the MITS in Malawi study. We used thematic content analysis drawing on a conceptual framework developed from emergent themes and MITS acceptability literature.

Results

Feelings of power over decision-making within the hospital and household, trust in health systems, and open and respectful health worker communication with parents were important dimensions of MITS acceptability. Other facilitating factors included the potential for MITS to add CoD information to aid sense-making of death and contribute to medical knowledge and new interventions. Potential barriers to acceptability included fears of organ and blood harvesting, disfigurement to the body, and disruption to transportation and burial plans.

Conclusion

Social relationships and power dynamics within healthcare systems and households are a critical component of MITS acceptability, especially given the sensitivity of death and autopsy.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Implementing Goals-of-Care Conversations: Lessons From High- and Low-Performing Sites From a VA National Initiative

Identifying challenges and recommendations for advancing global mental health implementation research: A key informant study of the National Institute of Mental Health Scale-Up Hubs

Authors:

John A.Naslund, Jasmine Kalha, Juliana L. Restivo, Ishmael Amarreh, Tamora Callands, Hongtu Chen, Carlos Gomez-Restrepo, Hesham M. Hamoda, Arjun Kapoor, Sue Levkoff, Jones Masiye, Maria A. Oquendo, Vikram Patel, Inge Petersen, Ozge Sensoy Bahar, Laura Shields-Zeeman, Fred M. Ssewamala, Deepak Tugnawat, José Miguel Uribe-Restrepo, Lakshmi Vijayakumar, Bradley H. Wagenaar, Milton L.Wainberg, Larry Wissow, Haja Ramatulai Wurie, Chifundo Zimba, & Soumitra Pathare

^{University of Washington affiliated authors are displayed in bold.}

Subscription Required for Full Text Access

Published: January 2021

Read the full text in the subscription access journal Asian Journal of Psychiatry

✪ Implementation of a Telemental Health Training Program Across a Mental Health Department

Abstract:

Introduction

Telemental health (TMH) has increased substantially. However, health care systems have found it challenging to implement TMH ubiquitously. A quality improvement project guided by implementation science methodology was used to design and implement a TMH training program.

Materials and Methods

Implementation science methodology (Promoting Access to Research Implementation in Health Services, Reach-Effectiveness-Adoption-Implementation-Maintenance, Implementation/Facilitation) provided the framework to design and implement the training program. A total of 100 interdisciplinary mental health providers from outpatient mental health clinics participated.

Results

Providers reported satisfaction with the training program. Results indicated that the training increased providers' TMH knowledge and competence. The number of providers using TMH and patients who received TMH nearly doubled.

Conclusions

Implementation science methodology was important in creating an organizational framework at this facility to design, evaluate, and implement an innovative TMH training program.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ What’s the “secret sauce”? How implementation variation affects the success of colorectal cancer screening outreach

Abstract:

Background

Mailed fecal immunochemical testing (FIT) programs can improve colorectal cancer (CRC) screening rates, but health systems vary how they implement (i.e., adapt) these programs for their organizations. A health insurance plan implemented a mailed FIT program (named BeneFIT), and participating health systems could adapt the program. This multi-method study explored which program adaptations might have resulted in higher screening rates.

Methods

First, we conducted a descriptive analysis of CRC screening rates by key health system characteristics and program adaptations. Second, we generated an overall model by fitting a weighted regression line to our data. Third, we applied Configurational Comparative Methods (CCMs) to determine how combinations of conditions were linked to higher screening rates. The main outcome measure was CRC screening rates.

Results

Seventeen health systems took part in at least 1 year of BeneFIT. The overall screening completion rate was 20% (4–28%) in year 1 and 25% (12–35%) in year 2 of the program. Health systems that used two or more adaptations had higher screening rates, and no single adaptation clearly led to higher screening rates. In year 1, small systems, with just one clinic, that used phone reminders (n = 2) met the implementation success threshold (≥ 19% screening rate) while systems with > 1 clinic were successful when offering a patient incentive (n = 4), scrubbing mailing lists (n = 4), or allowing mailed FIT returns with no other adaptations (n = 1). In year 2, larger systems with 2–4 clinics were successful with a phone reminder (n = 4) or a patient incentive (n = 3). Of the 10 systems that implemented BeneFIT in both years, seven improved their CRC screening rates in year 2.

Conclusions

Health systems can choose among many adaptations and successfully implement a health plan’s mailed FIT program. Different combinations of adaptations led to success with health system size emerging as an important contextual factor.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Protocol for a hybrid type 2 cluster randomized trial of trauma-focused cognitive behavioral therapy and a pragmatic individual-level implementation strategy

Abstract:

Background

More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services—schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes.

Methods

Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4–6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness.

Discussion

This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS—a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation—to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting.

Trial registration

ClinicalTrials.gov registration number NCT04451161. Registered on June 30, 2020.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Studies in Family Planning

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Method

Results

Conclusion

Plain language abstract

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal School Mental Health

Authors:

✪ Open Access

Read the full text in the open access journal PLOS ONE

Abstract:

Background

Aim

Methods

Results

Conclusion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access Journal of Pain and Symptom Management

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Asian Journal of Psychiatry

Authors:

✪ Open Access

Read the full text in the open access journal Telemedicine Reports

Abstract:

Introduction

Materials and Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration