Skip to content

✪ Confirmatory factor analysis of the Evidence-Based Practice Attitudes Scale with school-based behavioral health consultants

Authors:

Clayton R. Cook, Chayna Davis, Eric C. Brown, Jill Locke, Mark G. Ehrhart, Gregory A. Aarons, Madeline Larson and Aaron R. Lyon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

The Evidence-Based Practice Attitude Scale (EBPAS) is a widely used tool, but it has not been adapted and validated for use in schools, the most common setting where youth access behavioral health services. This study examined the factor structure, psychometric properties, and criterion-related validity of the school-adapted EBPAS in a sample of school-based behavioral health consultants.

Method

A research team comprised of experts in implementation of evidence-based practices in schools along with the original developer adapted the EBPAS for the school setting. The adapted instrument was administered to a representative sample (n = 196) of school-based behavioral health consultants to assess the reliability and structural validity via a series of confirmatory factor analyses.

Results

The original EBPAS factor structure was confirmed, with the final model supporting four first-order factors that load onto a second-order factor capturing general attitudes toward evidence-based practice. Correlations among the subscales indicated both unique and shared variance. Correlations between EBPAS scores and consultant variables demonstrated differential criterion-related validity, with the total score and the Requirements and Openness subscales demonstrating the strongest correlations.

Conclusions

The adapted EBPAS performed well when administered to behavioral health consultants operating in the educator sector, supporting the relevance of assessing attitudes in school settings. Potential directions for future research and applications of the EBPAS in schools and other service sectors are discussed.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Study protocol: A cluster-randomized trial implementing Sustained Patient-centered Alcohol-related Care (SPARC trial)

Authors:

Joseph E. Glass, Jennifer F. Bobb, Amy K. Lee, Julie E. Richards, Gwen T. Lapham, Evette Ludman, Carol Achtmeyer, Ryan M. Caldeiro, Rebecca Parrish, Emily C. Williams, Paula Lozano and Katharine A. Bradley

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

Experts recommend that alcohol-related care be integrated into primary care (PC) to improve prevention and treatment of unhealthy alcohol use. However, few healthcare systems offer such integrated care. To address this gap, implementation researchers and clinical leaders at Kaiser Permanente Washington (KPWA) partnered to design a high-quality program of evidence-based care for unhealthy alcohol use: the Sustained Patient-centered Alcohol-related Care (SPARC) program. SPARC implements systems of clinical care designed to increase both prevention and treatment of unhealthy alcohol use. This clinical care for unhealthy alcohol use was implemented using three strategies: electronic health record (EHR) decision support, performance monitoring and feedback, and front-line support from external practice coaches with expertise in alcohol-related care (“SPARC implementation intervention” hereafter).

The purpose of this report is to describe the protocol of the SPARC trial, a pragmatic, cluster-randomized, stepped-wedge implementation trial to evaluate whether the SPARC implementation intervention increased alcohol screening and brief alcohol counseling (so-called brief interventions), and diagnosis and treatment of alcohol use disorders (AUDs) in 22 KPWA PC clinics.

Methods/Design

The SPARC trial sample includes all adult patients who had a visit to any of the 22 primary care sites in the trial during the study period (January 1, 2015–July 31, 2018). The 22 sites were randomized to implement the SPARC program on different dates (in seven waves, approximately every 4 months). Primary outcomes are the proportion of patients with PC visits who (1) screen positive for unhealthy alcohol use and have documented brief interventions and (2) have a newly recognized AUD and subsequently initiate and engage in alcohol-related care. Main analyses compare the rates of these primary outcomes in the pre- and post-implementation periods, following recommended approaches for analyzing stepped-wedge trials. Qualitative analyses assess barriers and facilitators to implementation and required adaptations of implementation strategies.

Discussion

The SPARC trial is the first study to our knowledge to use an experimental design to test whether practice coaches with expertise in alcohol-related care, along with EHR clinical decision support and performance monitoring and feedback to sites, increase both preventive care—alcohol screening and brief intervention—as well as diagnosis and treatment of AUDs.

Trial registration

The trial is registered at ClinicalTrials.Gov: NCT02675777. Registered February 5, 2016, https://clinicaltrials.gov/ct2/show/NCT02675777.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Testing the effectiveness and implementation of a brief version of the Common Elements Treatment Approach (CETA) in Ukraine: A study protocol for a randomized controlled trial

Authors:

Laura K. Murray, Emily E. Haroz, S. Benjamin Doty, Namrita S. Singh, Sergey Bogdanov, Judith Bass, Shannon Dorsey and Paul Bolton

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2018

Read the full text in the open access journal Trials

Abstract:

Background

Mental illness is a major public health concern. Despite progress understanding which treatments work, a significant treatment gap remains. An ongoing concern is treatment length. Modular, flexible, transdiagnostic approaches have been offered as one solution to scalability challenges. The Common Elements Treatment Approach (CETA) is one such approach and offers the ability to treat a wide range of common mental health problems. CETA is supported by two randomized trials from low- and middle-income countries showing strong effectiveness and implementation outcomes.

Methods/design

This trial evaluates the effectiveness and implementation of two versions of CETA using a non-inferiority design to test two primary hypotheses: (1) a brief five-session version of CETA (Brief CETA) will provide similar effectiveness for reducing the severity of common mental health problems such as depression, post-traumatic stress, impaired functioning, anxiety, and substance use problems compared with the standard 8–12-session version of CETA (Standard CETA); and (2) both Brief and Standard CETA will have superior impact on the outcomes compared to a wait-list control condition. For both hypotheses, the main effect will be assessed using longitudinal data and mixed-effects regression models over a 6-month period post baseline. A secondary aim includes exploration of implementation factors. Additional planned analyses will include exploration of: moderators of treatment impact by disorder severity and comorbidity; the impact of individual therapeutic components; and trends in symptom change between end of treatment and 6-month assessment for all participants.

Discussion

This trial is the first rigorous study comparing a standard-length (8–12 sessions) modular, flexible, transdiagnostic, cognitive-behavioral approach to a shortened version of the approach (five sessions). Brief CETA entails “front-loading” with elements that research suggests are strong mechanisms of change. The study design will allow us to draw conclusions about the effects of both Brief and Standard CETA as well as which elements are integral to their mechanisms of action, informing future implementation and fidelity efforts. The results from this trial will inform future dissemination, implementation and scale-up of CETA in Ukraine and contribute to our understanding of the effects of modular, flexible, transdiagnostic approaches in similar contexts.

Trial registration

ClinicalTrials.gov, ID: NCT03058302 (U.S. National Library of Medicine). Registered on 20 February 2017.

✪ Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

Authors:

Lisa Amaya-Jackson, Dana Hagele, John Sideris, Donna Potter, Ernestine C. Briggs, Leila Keen, Robert A. Murphy, Shannon Dorsey, Vanessa Patchett, George S. Ake and Rebecca Socolar

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2018

Read the full text in the journal BMC Health Services Research

Abstract:

Background

A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice.

Methods

Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression.

Results

One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria.

Conclusion

Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Clinic flow for STI, HIV, and TB patients in an urban infectious disease clinic offering point-of-care testing services in Durban, South Africa

Authors:

Katrina J. Stime, Nigel Garrett, Yukteshwar Sookrajh, Jienchi Dorward, Ntuthu Dlamini, Ayo Olowolagba, Monisha
Sharma
, Ruanne V. Barnabas and Paul K. Drain

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2018

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Many clinics in Southern Africa have long waiting times. The implementation of point-of-care (POC) tests to accelerate diagnosis and improve clinical management in resource-limited settings may improve or worsen clinic flow and waiting times. The objective of this study was to describe clinic flow with special emphasis on the impact of POC testing at a large
urban public healthcare clinic in Durban, South Africa.

Methods

We used time and motion methods to directly observe patients and practitioners. We created patient flow maps and recorded individual patient waiting and consultation times for patients seeking STI, TB, or HIV care. We conducted semi-structured interviews with 20 clinic staff to ascertain staff opinions on clinic flow and POC test implementation.

Results

Among 121 observed patients, the total number of queues ranged from 4 to 7 and total visit times ranged from 0:14 (hours:minutes) to 7:38. Patients waited a mean of 2:05 for standard-of-care STI management, and approximately 4:56 for STI POC diagnostic testing. Stable HIV patients who collected antiretroviral therapy refills waited a mean of 2:42 in the standard queue and 2:26 in the fast-track queue. A rapid TB test on a small sample of patients with the Xpert MTB/RIF assay and treatment initiation took a mean of 6:56, and 40% of patients presenting with TB-related symptoms were asked to return for an additional clinic visit to obtain test results. For all groups, the mean clinical assessment time with a nurse
or physician was 7 to 9 min, which accounted for 2 to 6% of total visit time. Staff identified poor clinic flow and personnel shortages as areas of concern that may pose challenges to expanding POC tests in the current clinic environment.

Conclusions

This busy urban clinic had multiple patient queues, long clinical visits, and short clinical encounters. Although POC testing ensured patients received a diagnosis sooner, it more than doubled the time STI patients spent at the clinic and did not result in same-day diagnosis for all patients screened for TB. Further research on implementing POC testing efficiently into care pathways is required to make these promising assays a success.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ An evaluation of a common elements treatment approach for youth in Somali refugee camps

Authors:

L. K. Murray, B. J. Hall, S. Dorsey, A. M. Ugueto, E. S. Puffer, A. Sim, A. Ismael, J. Bass, C. Akiba, L. Lucid, J. Harrison, A. Erikson, and P. A. Bolton

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2018

Read the full text in the open access journal Global Mental Health

Excerpt:

Introduction

Children, defined as any boy or girl under 18 years, make up almost half of the world’s refugee population (United Nations High Commissioner for Refugees, 2016) and are exposed to challenges, traumas and stressors at the individual, family, and community levels that increase their risk for mental health problems (Barenbaum et al., 2004; Betancourt & Khan, 2008; Reed et al., 2012). These may include forced migration, forced labor, witnessing of murder and mass killings, lack of food and shelter, rape, torture, loss and separation from family, recruitment and use by armed forces, physical abuse, and family and sexual violence (Lustig et al., 2004; Office of the Special Representative of the Secretary-General for Children & Armed Conflict et al., 2009). Overlaid on potentially traumatic events are the daily, chronic stressors caused by displacement and associated with living in the camp environment – lack of basic needs, crowded and unsafe living conditions, and interpersonal conflict, among others (Layne et al., 2010; Miller & Rasmussen, 2010).

Children affected by these types of traumas and stressors present with a wide range of mental health symptoms, including those associated with posttraumatic stress (PTS), depression, anxiety, conduct problems, risk behaviors (e.g., alcohol or drug use), and distress associated with grief reactions (Barenbaum et al., 2004; Lustig et al., 2004; Sagi-Schwartz, 2008; Attanayake et al., 2009; Okello et al., 2013[for review], Morgos et al., 2008; Fernando et al., 2010; Miller & Rasmussen, 2010; Reed et al., 2012; Meyer et al., 2013; Newnham et al., 2015). Prevalence is difficult to study in these contexts; however, most studies find higher rates of mental health problems among displaced children compared with non-displaced populations (Goldstein et al., 1997; Paardekooper et al., 1999; Tousignant et al., 1999; Morgos et al., 2008; Bronstein & Montgomery, 2011; Reed et al., 2012).

There remains limited evidence on the effectiveness of interventions to treat mental health problems of children in refugee settings in low- and middle-income countries (LMICs). Some studies suggest that cognitive–behavioral-based treatments can be effective for reducing mental health symptoms in refugee children (Bolton et al., 2007; Layne et al., 2010). Relatedly, some eclectic psychosocial programs have been tested with conflict-affected populations, and show an impact on outcomes such as self-esteem or hope, but not mental health (Tol et al., 2014). Studies have generally utilized focal disorder treatments – or treatments focused on one disorder or cluster of symptoms. For example, Layne and colleagues used a treatment developed for posttraumatic stress disorder (PTSD) and grief (Layne et al., unpublished treatment manual) and Bolton and team (2007) used a treatment developed for depression (Interpersonal Therapy for depression; IPT). In contrast to this focal disorder treatment model where everyone receives the same elements in the same order, in common elements approaches providers learn elements that can be combined in different ways (elements used, order, dose) to treat a range of common mental health symptoms, and how to handle comorbidity (e.g., depression, trauma, anxiety co-occurrence) (Chorpita et al., 2005; Weisz et al., 2011; Weisz et al., 2012; Murray et al., 2014a). This approach is potentially more efficient and sustainable in both high-income countries (Mansell et al., 2008; Weisz et al., 2011; Weisz et al., 2012) and in LMICs (Bolton et al., 2014; Murray et al., 2014a; Ventevogel, 2015; Weisz et al., 2015) because it does not require providers to learn multiple interventions. Additionally, in settings with high rates of disorder comorbidity, such as in refugee populations, a model that can address multiple disorders may also be more appropriate (Murray & Jordans, 2016).

Current project

This paper reports on: (1) an evaluation of a common elements treatment approach (CETA) (Bolton et al., 2007; Bolton et al., 2014; Murray et al., 2014a; Weisz et al., 2015) developed for comorbid presentations of depression, anxiety, post traumatic stress, and/or externalizing symptoms among children in three Somali refugee camps on the Ethiopian/Somali border; and (2) an evaluation of implementation factors including acceptability, applicability/fit, feasibility and treatment facilitators, and barriers from the perspective of staff of the implementing partner organization, lay providers, and families who engaged in…

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ An updated protocol for a systematic review of implementation-related measures

Authors:

Cara C. Lewis, Kayne D. Mettert, Caitlin N. Dorsey, Ruben G. Martinez, Bryan J. Weiner, Elspeth Nolen, Cameo Stanick, Heather Halko and Byron J. Powell

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2018

Read the full text in the open access journal Systematic Reviews

Abstract:

Background

Implementation science is the study of strategies used to integrate evidence-based practices into real-world settings (Eccles and Mittman, Implement Sci. 1(1):1, 2006). Central to the identification of replicable, feasible, and effective implementation strategies is the ability to assess the impact of contextual constructs and intervention characteristics that may influence implementation, but several measurement issues make this work quite difficult. For instance, it is unclear which constructs have no measures and which measures have any evidence of psychometric properties like reliability and validity. As part of a larger set of studies to advance implementation science measurement (Lewis et al., Implement Sci. 10:102, 2015), we will complete systematic reviews of measures that map onto the Consolidated Framework for Implementation Research (Damschroder et al., Implement Sci. 4:50, 2009) and the Implementation Outcomes Framework (Proctor et al., Adm Policy Ment Health. 38(2):65-76, 2011), the protocol for which is described in this manuscript.

Methods

Our primary databases will be PubMed and Embase. Our search strings will be comprised of five levels: (1) the outcome or construct term; (2) terms for measure; (3) terms for evidence-based practice; (4) terms for implementation; and (5) terms for mental health. Two trained research specialists will independently review all titles and abstracts followed by full-text review for inclusion. The research specialists will then conduct measure-forward searches using the “cited by” function to identify all published empirical studies using each measure. The measure and associated publications will be compiled in a packet for data extraction. Data relevant to our Psychometric and Pragmatic Evidence Rating Scale (PAPERS) will be independently extracted and then rated using a worst score counts methodology reflecting “poor” to “excellent” evidence.

Discussion

We will build a centralized, accessible, searchable repository through which researchers, practitioners, and other stakeholders can identify psychometrically and pragmatically strong measures of implementation contexts, processes, and outcomes. By facilitating the employment of psychometrically and pragmatically strong measures identified through this systematic review, the repository would enhance the cumulativeness, reproducibility, and applicability of research findings in the rapidly growing field of implementation science.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Successful Deployment of High Flow Nasal Cannula in a Peruvian Pediatric Intensive Care Unit Using Implementation Science—Lessons Learned

Authors:

Katie R. Nielsen, Rosario Becerra, Gabriela Mallma, & José Tantaleán da Fieno

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2018

Read the full text in the open access journal Frontiers in Pediatrics

Abstract:

Acute lower respiratory infections are the leading cause of death outside the neonatal period for children less than 5 years of age. Widespread availability of invasive and non-invasive mechanical ventilation in resource-rich settings has reduced mortality rates; however, these technologies are not always available in many low- and middle-income countries due to the high cost and trained personnel required to implement and sustain their use. High flow nasal cannula (HFNC) is a form of non-invasive respiratory support with growing evidence for use in pediatric respiratory failure. Its simple interface makes utilization in resource-limited settings appealing, although widespread implementation in these settings lags behind resource-rich settings. Implementation science is an emerging field dedicated to closing the know-do gap by incorporating evidence-based interventions into routine care, and its principles have guided the scaling up of many global health interventions. In 2016, we introduced HFNC use for respiratory failure in a pediatric intensive care unit in Lima, Peru using implementation science methodology. Here, we review our experience in the context of the principles of implementation science to serve as a guide for others considering HFNC implementation in resource-limited settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research

Authors:

Maria E. Fernandez, Timothy J. Walker, Bryan J. Weiner, William A. Calo, Shuting Liang, Betsy Risendal, Daniela B. Friedman, Shin Ping Tu, Rebecca S. Williams, Sara Jacobs, Alison K. Herrmann and Michelle C. Kegler

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

Scientists and practitioners alike need reliable, valid measures of contextual factors that influence implementation. Yet, few existing measures demonstrate reliability or validity. To meet this need, we developed and assessed the psychometric properties of measures of several constructs within the Inner Setting domain of the Consolidated Framework for Implementation Research (CFIR).

Methods

We searched the literature for existing measures for the 7 Inner Setting domain constructs (Culture Overall, Culture Stress, Culture Effort, Implementation Climate, Learning Climate, Leadership Engagement, and Available Resources). We adapted items for the healthcare context, pilot-tested the adapted measures in 4 Federally Qualified Health Centers (FQHCs), and implemented the revised measures in 78 FQHCs in the 7 states (N = 327 respondents) with a focus on colorectal cancer (CRC) screening practices. To psychometrically assess our measures, we conducted confirmatory factor analysis models (CFA; structural validity), assessed inter-item consistency (reliability), computed scale correlations (discriminant validity), and calculated inter-rater reliability and agreement (organization-level construct reliability and validity).

Results

CFAs for most constructs exhibited good model fit (CFI > 0.90, TLI > 0.90, SRMR < 0.08, RMSEA < 0.08), with almost all factor loadings exceeding 0.40. Scale reliabilities ranged from good (0.7 ≤ α < 0.9) to excellent (α ≥ 0.9). Scale correlations fell below 0.90, indicating discriminant validity. Inter-rater reliability and agreement were sufficiently high to justify measuring constructs at the clinic-level.

Conclusions

Our findings provide psychometric evidence in support of the CFIR Inner Setting measures. Our findings also suggest the Inner Setting measures from individuals can be aggregated to represent the clinic-level. Measurement of the Inner Setting constructs can be useful in better understanding and predicting implementation in FQHCs and can be used to identify targets of strategies to accelerate and enhance implementation efforts in FQHCs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Mobile Health Strategy to Support Adherence to Antiretroviral Preexposure Prophylaxis

Authors:

Jonathan D. Fuchs, Kristefer Stojanovski, Eric Vittinghoff, Vanessa M. McMahan, Sybill G. Hosek, K. Rivet Amico, Aminta Kouyate, Hailey J. Gilmore, Susan P. Buchbinder, Richard T. Lester, Robert M. Grant, and Albert Y. Liu

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2018

Read the full text open access in the journal AIDS Patient Care and STDs