Open Access Archives - Page 28 of 35 - Implementation Science at UW

✪ What Multilevel Interventions Do We Need to Increase the Colorectal Cancer Screening Rate to 80%?

✪ Measuring characteristics of individuals: An updated systematic review of instruments’ psychometric properties

Abstract:

Background

Identification of psychometrically strong implementation measures could (1) advance researchers’ understanding of how individual characteristics impact implementation processes and outcomes, and (2) promote the success of real-world implementation efforts. The current study advances the work that our team published in 2015 by providing an updated and enhanced systematic review that identifies and evaluates the psychometric properties of implementation measures that assess individual characteristics.

Methods

A full description of our systematic review methodology, which included three phases, is described in a previously published protocol paper. Phase I focused on data collection and involved search string generation, title and abstract screening, full-text review, construct assignment, and measure forward searches. During Phase II, we completed data extraction (i.e., coding psychometric information). Phase III involved data analysis, where two trained specialists independently rated each measurement tool using our psychometric rating criteria.

Results

Our team identified 124 measures of individual characteristics used in mental or behavioral health research, and 123 of those measures were deemed suitable for rating using Psychometric and Pragmatic Evidence Rating Scale. We identified measures of knowledge and beliefs about the intervention (n = 76), self-efficacy (n = 24), individual stage of change (n = 2), individual identification with organization (n = 7), and other personal attributes (n = 15). While psychometric information was unavailable and/or unreported for many measures, information about internal consistency and norms were the most commonly identified psychometric data across all individual characteristics’ constructs. Ratings for all psychometric properties predominantly ranged from “poor” to “good.”

Conclusion

The majority of research that develops, uses, or examines implementation measures that evaluate individual characteristics does not include the psychometric properties of those measures. The development and use of psychometric reporting standards could advance the use of valid and reliable tools within implementation research and practice, thereby enhancing the successful implementation and sustainment of evidence-based practice in community care.

Plain Language Summary

Measurement is the foundation for advancing practice in health care and other industries. In the field of implementation science, the state of measurement is only recently being targeted as an area for improvement, given that high-quality measures need to be identified and utilized in implementation work to avoid developing another research to practice gap. For the current study, we utilized the Consolidated Framework for Implementation Research to identify measures related to individual characteristics’ constructs, such as knowledge and beliefs about the intervention, self-efficacy, individual identification with the organization, individual stage of change, and other personal attributes. Our review showed that many measures exist for certain constructs (e.g., measures related to assessing providers’ attitudes and perceptions about evidence-based practice interventions), while others have very few (e.g., an individual’s stage of change). Also, we rated measures for their psychometric strength utilizing an anchored rating system and found that most measures assessing individual characteristics are in need of more research to establish their evidence of quality. It was also clear from our results that frequency of use/citations does not equate to high quality, psychometric strength. Ultimately, the state of the literature has demonstrated that assessing individual characteristics of implementation stakeholders is an area of strong interest in implementation work. It will be important for future research to focus on clearly delineating the psychometric properties of existing measures for saturated constructs, while for the others the emphasis should be on developing new, high-quality measures and make these available to stakeholders.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Using a Clinical Workflow Analysis to Enhance eHealth Implementation Planning: Tutorial and Case Study

Abstract:

eHealth apps often fail to improve clinical outcomes due to poor integration with clinical workflow—the sequence and personnel needed to undertake a series of tasks for clinical care. Our central thesis is that eHealth interventions will be more effective if the clinical workflow is studied and taken into consideration for intervention implementation. This paper aims to provide an introductory tutorial on when and how to use a clinical workflow analysis to guide the implementation of eHealth interventions. The tutorial includes a step-by-step guide to conducting a clinical workflow analysis in planning for eHealth implementation.

We began with a description of why a clinical workflow analysis is best completed before the implementation of eHealth interventions. Next, we described 4 steps needed to perform the clinical workflow analysis: the identification of discrete workflow components, workflow assessment, triangulation, and the stakeholder proposal of intervention implementation. Finally, we presented a case study of a clinical workflow analysis, which was conducted during patient visits of patients aged 11 or 12 years from 4 diverse pediatric or family medicine clinics to plan the implementation of a tablet-based app for adolescent vaccination.

Investigators planning the implementation of new eHealth interventions in health care settings can use the presented steps to assess clinical workflow, thereby maximizing the match of their intervention with the clinical workflow. Conducting a prospective workflow study allows for evidence-based planning, identifying potential pitfalls, and increasing stakeholder buy-in and engagement. This tutorial should aid investigators in increasing the successful implementation of eHealth interventions.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ National implementation of HPV vaccination programs in low-resource countries: Lessons, challenges, and future prospects

Abstract:

More than 90% of cervical cancer deaths occur in low- and middle-income countries (LMICs), which have limited capacity to mount the comprehensive national screening and precancer treatment programs that could prevent most of these deaths. The development of vaccines against the human papillomavirus (HPV) has dramatically altered the landscape of cervical cancer prevention. As of mid-2020, 56 LMICs (41% of all LMICs) have initiated national HPV vaccination programs. This paper reviews the experience of LMICs that have introduced HPV vaccine into their national programs, key lessons learned, HPV vaccination sustainability and scale-up challenges, and future mitigation measures.

As international guidance evolved and countries accumulated experience, strategies for national introduction shifted with regard to target groups, delivery site and timing, preparation and planning, communications and social mobilization, and ultimately monitoring, supervision and evaluation. Despite the successes that LMICs have been able to achieve in reaching large proportions of eligible girls, there are still considerable challenges countries encounter in overcoming rumors, reaching out-of-school girls, completing the vaccine series, estimating target populations, monitoring program performance, and assuring vaccination sustainability. New opportunities, such as the entry of additional vaccine manufacturers and ongoing studies to evaluate one-dose delivery, could help overcome the outstanding barriers to higher coverage and financial sustainability. Effective use of the experience to date and advances on the horizon could enable all LMICs to move towards the coverage levels that are needed to achieve eventual elimination.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Incorporating Method Dissatisfaction into Unmet Need for Contraception: Implications for Measurement and Impact

Abstract:

While unmet need for contraception is commonly used to assess programmatic needs, it inadequately captures the complexity of fertility and contraceptive preferences, including women's satisfaction with their contraceptive method. In their 2019 commentary, Sarah Rominski and Rob Stephenson propose reclassifying dissatisfied current users as having an unmet need for contraception. As revising the current definition based on their proposal would require significant investment to update survey and monitoring systems, understanding the potential impact on current estimates of unmet need is critical.

We estimated the impact of this approach in a Kenyan cohort of modern contraceptive users. We found the prevalence of method dissatisfaction ranges from 6.6% (95% confidence interval [CI] 5.6–7.8%) to 18.9% (95% CI 17.1–20.9%); if applied nationally, this results in a large (approximately 25–70%) increase in Kenya's current estimate of unmet need for any contraception. Our findings suggest a large impact on unmet need estimates for equivalent populations.

Overall, we advocate for better measurements of method satisfaction and acceptability, with metrics developed that are robust to socioeconomic gradients and validated in low- and middle-income settings to ensure women's contraceptive needs are captured equitably.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Mapping the organizational readiness to change assessment to the Consolidated Framework for Implementation Research

Abstract:

Background

Implementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.

Methods

Two distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.

Results

ORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.

Conclusions

Mapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Hypothetical acceptability of hospital-based post-mortem pediatric minimally invasive tissue sampling in Malawi: The role of complex social relationships

Abstract:

Background

Child mortality rates remain unacceptably high in low-resource settings. Cause of death (CoD) is often unknown. Minimally invasive tissue sampling (MITS)–using biopsy needles to obtain post-mortem samples–for histopathological and microbiologic investigation is increasingly being promoted to improve child and adult CoD attribution. “MITS in Malawi” is a sub-study of the Childhood Acute Illness & Nutrition (CHAIN) Network, which aims to identify biological and socioeconomic mortality risk factors among young children hospitalized for acute illness or undernutrition. MITS in Malawi employs standard MITS and a novel post-mortem endoscopic intestinal sampling approach to better understand CoD among children with acute illness and/or malnutrition who die during hospitalization.

Aim

To understand factors that may impact MITS acceptability and inform introduction of the procedure to ascertain CoD among children with acute illness or malnutrition who die during hospitalization in Malawi.

Methods

We conducted eight focus group discussions with key hospital staff and community members (religious leaders and parents of children under 5) to explore attitudes towards MITS and inform consent processes prior to commencing the MITS in Malawi study. We used thematic content analysis drawing on a conceptual framework developed from emergent themes and MITS acceptability literature.

Results

Feelings of power over decision-making within the hospital and household, trust in health systems, and open and respectful health worker communication with parents were important dimensions of MITS acceptability. Other facilitating factors included the potential for MITS to add CoD information to aid sense-making of death and contribute to medical knowledge and new interventions. Potential barriers to acceptability included fears of organ and blood harvesting, disfigurement to the body, and disruption to transportation and burial plans.

Conclusion

Social relationships and power dynamics within healthcare systems and households are a critical component of MITS acceptability, especially given the sensitivity of death and autopsy.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ What’s the “secret sauce”? How implementation variation affects the success of colorectal cancer screening outreach

Abstract:

Background

Mailed fecal immunochemical testing (FIT) programs can improve colorectal cancer (CRC) screening rates, but health systems vary how they implement (i.e., adapt) these programs for their organizations. A health insurance plan implemented a mailed FIT program (named BeneFIT), and participating health systems could adapt the program. This multi-method study explored which program adaptations might have resulted in higher screening rates.

Methods

First, we conducted a descriptive analysis of CRC screening rates by key health system characteristics and program adaptations. Second, we generated an overall model by fitting a weighted regression line to our data. Third, we applied Configurational Comparative Methods (CCMs) to determine how combinations of conditions were linked to higher screening rates. The main outcome measure was CRC screening rates.

Results

Seventeen health systems took part in at least 1 year of BeneFIT. The overall screening completion rate was 20% (4–28%) in year 1 and 25% (12–35%) in year 2 of the program. Health systems that used two or more adaptations had higher screening rates, and no single adaptation clearly led to higher screening rates. In year 1, small systems, with just one clinic, that used phone reminders (n = 2) met the implementation success threshold (≥ 19% screening rate) while systems with > 1 clinic were successful when offering a patient incentive (n = 4), scrubbing mailing lists (n = 4), or allowing mailed FIT returns with no other adaptations (n = 1). In year 2, larger systems with 2–4 clinics were successful with a phone reminder (n = 4) or a patient incentive (n = 3). Of the 10 systems that implemented BeneFIT in both years, seven improved their CRC screening rates in year 2.

Conclusions

Health systems can choose among many adaptations and successfully implement a health plan’s mailed FIT program. Different combinations of adaptations led to success with health system size emerging as an important contextual factor.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Protocol for a hybrid type 2 cluster randomized trial of trauma-focused cognitive behavioral therapy and a pragmatic individual-level implementation strategy

Abstract:

Background

More than two-thirds of youth experience trauma during childhood, and up to 1 in 5 of these youth develops posttraumatic stress symptoms that significantly impair their functioning. Although trauma-focused cognitive behavior therapy (TF-CBT) has a strong evidence base, it is rarely adopted, delivered with adequate fidelity, or evaluated in the most common setting where youth access mental health services—schools. Given that individual behavior change is ultimately required for successful implementation, even when organizational factors are firmly in place, focusing on individual-level processes represents a potentially parsimonious approach. Beliefs and Attitudes for Successful Implementation in Schools (BASIS) is a pragmatic, motivationally focused multifaceted strategy that augments training and consultation and is designed to target precise mechanisms of behavior change to produce enhanced implementation and youth clinical outcomes. This study protocol describes a hybrid type 2 effectiveness-implementation trial designed to concurrently evaluate the main effects, mediators, and moderators of both the BASIS implementation strategy on implementation outcomes and TF-CBT on youth mental health outcomes.

Methods

Using a cluster randomized controlled design, this trial will assign school-based mental health (SMH) clinicians and schools to one of three study arms: (a) enhanced treatment-as-usual (TAU), (b) attention control plus TF-CBT, or (c) BASIS+TF-CBT. With a proposed sample of 120 SMH clinicians who will each recruit 4–6 youth with a history of trauma (480 children), this project will gather data across 12 different time points to address two project aims. Aim 1 will evaluate, relative to an enhanced TAU condition, the effects of TF-CBT on identified mechanisms of change, youth mental health outcomes, and intervention costs and cost-effectiveness. Aim 2 will compare the effects of BASIS against an attention control plus TF-CBT condition on theoretical mechanisms of clinician behavior change and implementation outcomes, as well as examine costs and cost-effectiveness.

Discussion

This study will generate critical knowledge about the effectiveness and cost-effectiveness of BASIS—a pragmatic, theory-driven, and generalizable implementation strategy designed to enhance motivation—to increase the yield of evidence-based practice training and consultation, as well as the effectiveness of TF-CBT in a novel service setting.

Trial registration

ClinicalTrials.gov registration number NCT04451161. Registered on June 30, 2020.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Identifying pathways for large-scale implementation of a school-based mental health programme in the Eastern Mediterranean Region: A theory-driven approach

Abstract:

Globally there is a substantial burden of mental health problems among children and adolescents. Task-shifting/task-sharing mental health services to non-specialists, e.g. teachers in school settings, provide a unique opportunity for the implementation of mental health interventions at scale in low- and middle-income countries (LMICs). There is scant information to guide the large-scale implementation of school-based mental health programme in LMICs.This article describes pathways for large-scale implementation of a School Mental Health Program (SMHP) in the Eastern Mediterranean Region (EMR).

A collaborative learning group (CLG) comprising stakeholders involved in implementing the SMHP including policymakers, programme managers and researchers from EMR countries was established. Participants in the CLG applied the theory of change (ToC) methodology to identify sets of preconditions, assumptions and hypothesized pathways for improving the mental health outcomes of school-aged children in public schools through implementation of the SMHP. The proposed pathways were then validated through multiple regional and national ToC workshops held between January 2017 and September 2019, as the SMHP was being rolled out in three EMR countries: Egypt, Pakistan and Iran. Preconditions, strategies and programmatic/contextual adaptations that apply across these three countries were drawn from qualitative narrative summaries of programme implementation processes and facilitated discussions during biannual CLG meetings.

The ToC for large-scale implementation of the SMHP in the EMR suggests that identifying national champions, formulating dedicated cross-sectoral (including the health and education sector) implementation teams, sustained policy advocacy and stakeholders engagement across multiple levels, and effective co-ordination among education and health systems especially at the local level are among the critical factors for large-scale programme implementation. The pathways described in this paper are useful for facilitating effective implementation of the SMHP at scale and provide a theory-based framework for evaluating the SMHP and similar programmes in the EMR and other LMICs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the subscription access journal Clinical Gastroenterology and Hepatology

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Methods

Results

Conclusion

Plain Language Summary

Authors:

✪ Open Access

Read the full text in the open access journal JMIR mHealth and uHealth

Abstract:

Authors:

✪ Open Access

Read the full text open access in the journal Preventive Medicine

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Studies in Family Planning

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal PLOS ONE

Abstract:

Background

Aim

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal Health Policy and Planning

Abstract: