Skip to content

✪ Organizational culture and climate profiles: Relationships with fidelity to three evidence-based practices for autism in elementary schools

Authors:

Nathaniel J. Williams, Hannah E. Frank, Lindsay Frederick, Rinad S. Beidas, David S. Mandell, Gregory A. Aarons, Philip Green & Jill Locke

University of Washington affiliated authors are displayed in bold.

Published: February 2019

Read the full text in the open access journal Implementation Science

Abstract:

Background

Implementation researchers have typically studied organizational culture and climate by testing whether individual dimensions are linked to the implementation of evidence-based practices (EBPs) rather than examining how the overarching social context influences implementation. This approach may limit implementation theory and strategy development to the extent that individual dimensions of culture and climate interact, mutually reinforce or counteract one another, or exhibit non-linear relationships. This study tests whether empirically identifiable culture and climate profiles emerge in a sample of organizations and examines how these profiles relate to EBP fidelity and work attitudes that support EBP sustainment, focusing on three EBPs for youth with autism delivered in schools as an example.

Methods

The study included 65 elementary schools in the U.S. that implemented three EBPs—discrete trial training, pivotal response training, and visual schedules—for youth with autism. Organizational culture and climate and work attitudes were assessed using the Organizational Social Context measure at the beginning of the school year. Observations of EBP fidelity occurred mid school-year. We used bias-adjusted stepwise latent profile modeling to (1) identify subpopulations of schools that share similar culture and climate profiles, and (2) test for mean differences across profiles in observed EBP fidelity and teacher and staff work attitudes.

Results

Controlling for region, four profiles best characterized the organizational cultures and climates of schools. Teachers and staff in schools with a comprehensive profile (high proficiency culture, positive climate) exhibited higher fidelity to two of three EBPs (d’s = .95 to 1.64) and reported superior work attitudes (d’s = .71 to 1.93) than teachers and staff in all other schools. Teachers and staff in supportive schools (low rigidity culture, positive climate) had better work attitudes, but not better fidelity, than those in schools with indifferent (low culture/climate, elevated stress) and constrained (high rigidity and resistance, high stress) profiles.

Conclusions

Organizational culture and climate profiles are a strong predictor of EBP fidelity and work attitudes that support EBP sustainment, highlighting the importance of an organization’s overarching social context when developing implementation theory and strategies. Strategies that foster a comprehensive profile may improve EBP implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

More in Fidelity

More in Organizational Assessment

More in Organizational Climate

More in Organizational Culture

No publications in this category…yet!

✪ Strategies to increase implementation of pharmacotherapy for alcohol use disorders: A structured review of care delivery and implementation interventions

Authors:

Emily C. Williams, Theresa E. Matson, & Alex H. S. Harris

University of Washington affiliated authors are displayed in bold.

Published: February 2019

Read the full text in the open access journal Addiction Science & Clinical Practice

Abstract:

Background

Effective medications for treating alcohol use disorders (AUD) are available but underutilized. Multiple barriers to their provision have been identified, and optimal strategies for addressing and overcoming barriers to use of medications for AUD treatment remain elusive. We conducted a structured review of published care delivery and implementation studies evaluating interventions that aimed to increase medication treatment for patients with AUD to identify interventions and component strategies that were most effective.

Methods

We reviewed literature through May 2018 and used networking to identify intervention studies with AUD medication receipt reported as a primary or secondary outcome. Studies were identified as care delivery studies, characterized by patient-level recruitment and willingness to be randomized to candidate treatment options, and implementation studies, characterized by inclusion of all patients treated at sites involved in the study. Each identified study was independently coded by two investigators for strategies used, guided by a published taxonomy of implementation strategies. All authors reviewed coding discrepancies and revised codes based on consensus. After reaching internal consensus, we solicited feedback from lead investigators on studies to code additional strategies. We reviewed implementation strategies used across studies to assess their relationship with medication receipt, as well as alcohol use outcomes, as available.

Results

Nine studies were identified: four RCTs of care delivery interventions, four quasi-experimental evaluations of large-scale implementation interventions, and one quasi-experimental evaluation of a targeted single-site implementation intervention. Implementation strategies used were variable across studies; no strategy was universally used. Effects of the interventions on receipt of AUD pharmacotherapy and alcohol use outcomes also varied. Three of four care delivery interventions resulted in increased receipt of AUD medications, but only one of these three improved alcohol use outcomes. One large-scale and one single-site implementation intervention were associated with increased AUD medication receipt, and these studies did not assess alcohol use outcomes. Patterns of implementation strategies did not clearly distinguish studies that successfully increased use of pharmacotherapy versus those that did not.

Conclusions

Our review did not reveal strategies most effective for implementing AUD medications. Interventions designed to overcome identified barriers may have missed the mark, or differences in the intensity or targets of strategies may matter more than differences in strategies. Further research is needed to understand effective implementation methods and to better understand patient-level perspective, preferences and barriers to receipt of medications.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

More in Implementation Strategies

More in Review

More in United States

✪ Measuring the Implementation of Behavioral Intervention Technologies: Recharacterization of Established Outcomes

Authors:

Eric DA Hermes, Aaron R Lyon, Stephen M Schueller, and Joseph E Glass

University of Washington affiliated authors are displayed in bold.

Published: January 2019

Read the full text in the open access Journal of Medical Internet Research

Abstract:

Behavioral intervention technologies (BITs) are websites, software, mobile apps, and sensors designed to help users address or change behaviors, cognitions, and emotional states. BITs have the potential to transform health care delivery, and early research has produced promising findings of efficacy. BITs also favor new models of health care delivery and provide novel data sources for measurement. However, there are few examples of successful BIT implementation and a lack of consensus on as well as inadequate descriptions of BIT implementation measurement. The aim of this viewpoint paper is to provide an overview and characterization of implementation outcomes for the study of BIT use in routine practice settings.

Eight outcomes for the evaluation of implementation have been previously described: acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability. In a proposed recharacterization of these outcomes with respect to BIT implementation, definitions are clarified, expansions to the level of analysis are identified, and unique measurement characteristics are discussed. Differences between BIT development and implementation, an increased focus on consumer-level outcomes, the expansion of providers who support BIT use, and the blending of BITs with traditional health care services are specifically discussed.

BITs have the potential to transform health care delivery. Realizing this potential, however, will hinge on high-quality research that consistently and accurately measures how well such technologies have been integrated into health services. This overview and characterization of implementation outcomes support BIT research by identifying and proposing solutions for key theoretical and practical measurement challenges.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

More in Commentary

More in eHealth

More in Open Access

User-Centered Redesign of Evidence-Based Psychosocial Interventions to Enhance Implementation—Hospitable Soil or Better Seeds?

Authors:

Aaron R. Lyon & Eric J. Bruns

University of Washington affiliated authors are displayed in bold.

Published: January 2019

Read the full text in the subscription access journal JAMA Psychiatry

More in UW Affiliated First Author...

No additional publications in this category…yet!

More in Commentary...

No additional publications in this category…yet!

More in User-Centered Design...

No additional publications in this category…yet!

✪ Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda

Authors:

Byron J. Powell, Maria E. Fernandez, Nathaniel J. Williams, Gregory A. Aarons, Rinad S. Beidas, Cara C. Lewis, Sheena M. McHugh and Bryan J. Weiner

University of Washington affiliated authors are displayed in bold.

Published: January 2019

Read the full text in the open access journal Frontiers in Public Health

Abstract:

The field of implementation science was developed to better understand the factors that facilitate or impede implementation and generate evidence for implementation strategies. In this article, we briefly review progress in implementation science, and suggest five priorities for enhancing the impact of implementation strategies.

Specifically, we suggest the need to:

  1. enhance methods for designing and tailoring implementation strategies;
  2. specify and test mechanisms of change;
  3. conduct more effectiveness research on discrete, multi-faceted, and tailored implementation strategies;
  4. increase economic evaluations of implementation strategies; and
  5. improve the tracking and reporting of implementation strategies.

We believe that pursuing these priorities will advance implementation science by helping us to understand when, where, why, and how implementation strategies improve implementation effectiveness and subsequent health outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

More in Tailored Implementation

More in Implementation Strategies

More in Economic Evaluation

More in Mechanisms

✪ Integrating implementation and user-centered design strategies to enhance the impact of health services: Protocol from a concept mapping study

Authors:

Alex R. Dopp, Kathryn E. Parisi, Sean A. Munson & Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

Published: January 2019

Read the full text in the open access journal Health Research Policy and Systems

Abstract:

Background

Innovative approaches are needed to maximise the uptake and sustainment of evidence-based practices in a variety of health service contexts. This protocol describes a study that will seek to characterise the potential of one such approach, user-centred design (UCD), which is an emerging field that seeks to ground the design of an innovation in information about the people who will ultimately use that innovation. The use of UCD to enhance strategies for implementation of health services, although promising, requires a multidisciplinary perspective based on a firm understanding of how experts from each discipline perceives the interrelatedness and suitability of these strategies.

Method

This online study will use a combination of purposive and snowball sampling to recruit a sample of implementation experts (n = 30) and UCD experts (n = 30). These participants will each complete a concept mapping task, which is a mixed-method conceptualisation technique that will allow for identification of distinct clusters of implementation and/or UCD strategies. The research team has selected a set of implementation strategies and UCD strategies that each participant will sort and rate on dimensions of importance and feasibility. Data analyses will focus on describing the sample, identifying related clusters of strategies, and examining the convergences, divergences, and potential for collaboration between implementation science and UCD.

Discussion

By leading to a better understanding of the overlap between implementation science and UCD, grounded within established theoretical frameworks, this study holds promise for improving the impact and sustainability of evidence-based health services in community settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

More in Protocol

More in User-Centered Design

More in Open Access

Integration of PrEP Services Into Routine Antenatal and Postnatal Care Experiences From an Implementation Program in Western Kenya

Authors:

Jillian Pintye, John Kinuthia, D. Allen Roberts, Anjuli D. Wagner, Kenneth Mugwanya, Felix Abuna, Harison Lagat, George Owiti, Carol E. Levin, Ruanne V. Barnabas, Jared M. Baeten, and Grace John-Stewart

University of Washington affiliated authors are displayed in bold.

Published: December 2018

Read the full text in the subscription access journal JAIDS – Journal of Acquired Immune Deficiency Syndromes

✪ Human papillomavirus vaccine delivery in Mozambique: Identification of implementation performance drivers using the Consolidated Framework for Implementation Research (CFIR)

Authors:

Caroline Soi, Sarah Gimbel, Baltazar Chilundo, Vasco Muchanga, Luisa Matsinhe and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

Published: December 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

Since 2012 Gavi, the Vaccine Alliance has provided financial support for HPV vaccine introduction in low- and middle-income countries (LMICs); however, funding has been contingent on establishing a demonstration project prior to national scale-up, in order to gauge effectiveness of delivery models. Although by 2016, most beneficiary countries had completed demonstration projects, few have scaled up delivery nationwide. An important barrier was the dearth of published, country-specific implementation recommendations. We employed the Consolidated Framework for Implementation Research (CFIR) as a lens to identify drivers of heterogeneous (dissimilar) implementation performance during Mozambique’s 2-year demonstration project. Mozambique presents a compelling example as the country conducted demonstration projects in three different districts with extremely different economic resources and sociocultural practices.

Methods

A post implementation interpretive evaluation was undertaken. Forty key informant interviews were conducted with district and health facility immunization staff, Ministry of Education managers, and teachers across the three demonstration districts, central level informants from MOH, research institutes, and immunization program partners. We compared valence and strength ratings of CFIR constructs, across diverse implementation sites, so as to explain drivers and barriers to implementation success. Two researchers coded separately, and subsequent content analysis followed pre-defined CFIR construct themes.

Results

Eighteen constructs emerged from informants’ responses as implementation influencers. Adaptability was identified as an important construct because delivery modalities needed to meet differing levels of girls’ school attendance. Expanding outside of school-based delivery was needed in the low-performing district, making the vaccine delivery process more complex. Available resources varied across the three sites, with one site receiving direct Gavi support, while others received primarily state-based support. These latter sites reported considerably more implementation bottlenecks, in part related to weaker infrastructural characteristics and insufficient organizational incentives. Health workers’ beliefs in importance of vaccines and an organizational culture of making personal sacrifice for immunization program activities drove implementation performance. Advocacy and social mobilization through the right opinion leaders and champions generated higher demand.

Conclusion

HPV vaccination presents a pertinent opportunity for the prevention of cervical cancer in Mozambique, sub-Saharan Africa, and other LMICs. However, important barriers to broad-scale implementation exist. We recommend the development of local and global strategies to overcome barriers and facilitate its expanded utilization.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**