Skip to content

✪ Implementation Climate and Time Predict Intensity of Supervision Content Related to Evidence Based Treatment

Authors:

Michael D. Pullmann, Leah Lucid, Julie P. Harrison, Prerna Martin, Esther Deblinger, Katherine S. Benjamin and Shannon Dorsey
University of Washington affiliated authors are displayed in bold.
Published: October 2018

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Objective

Children infrequently receive evidence-based treatments (EBTs) for mental health problems due to a science-to-practice implementation gap. Workplace-based clinical supervision, in which supervisors provide oversight, feedback, and training on clinical practice, may be a method to support EBT implementation. Our prior research suggests that the intensity of supervisory focus on EBT (i.e., thoroughness of coverage) during workplace-based supervision varies. This study explores predictors of supervisory EBT intensity.

Methods

Participants were twenty-eight supervisors and 70 clinician supervisees. They completed a baseline survey, and audio recorded supervision sessions over 1 year. Four hundred and thirty eight recordings were coded for supervision content. We chose to explore predictors of two EBT content elements due to their strong evidence for effectiveness and sufficient variance to permit testing. These included a treatment technique (“exposure”) and a method to structure treatment (“assessment”). We also explored predictors of non-EBT content (“other topics”). Mixed-effects models explored predictors at organizational/supervisor, clinician, and session levels.

Results

Positive implementation climate predicted greater intensity of EBT content coverage for assessment (coefficient = 0.82, p = 0.004) and exposure (coefficient = 0.87, p = 0.001). Intensity of exposure coverage was also predicted by more time spent discussing each case (coefficient = 0.04, p < 0.001). Predictors of greater non-EBT content coverage included longer duration of supervision sessions (coefficient = 0.05, p < 0.001) and lower levels of supervisor EBT knowledge (coefficient = −0.17, p = 0.013). No other supervisor- or clinician-level variables were significant predictors in the mixed effects models.

Conclusion

This was the first study to explore multi-level predictors of objectively coded workplace-based supervision content. Results suggest that organizations that expect, support and reward EBT are more likely to have greater intensity of EBT supervision coverage, which in turn may positively impact clinician EBT fidelity and client outcomes. There was evidence that supervisor knowledge of the EBT contributes to greater coverage, although robust supervisor and clinician factors that drive supervision are yet to be identified. Findings highlight the potential effectiveness of implementation strategies that simultaneously address organizational implementation climate and supervisor practices. More research is needed to identify mechanisms that support integration of EBT into supervision.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Testing the effectiveness and implementation of a brief version of the Common Elements Treatment Approach (CETA) in Ukraine: A study protocol for a randomized controlled trial

Authors:

Laura K. Murray, Emily E. Haroz, S. Benjamin Doty, Namrita S. Singh, Sergey Bogdanov, Judith Bass, Shannon Dorsey and Paul Bolton

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2018

Read the full text in the open access journal Trials

Abstract:

Background

Mental illness is a major public health concern. Despite progress understanding which treatments work, a significant treatment gap remains. An ongoing concern is treatment length. Modular, flexible, transdiagnostic approaches have been offered as one solution to scalability challenges. The Common Elements Treatment Approach (CETA) is one such approach and offers the ability to treat a wide range of common mental health problems. CETA is supported by two randomized trials from low- and middle-income countries showing strong effectiveness and implementation outcomes.

Methods/design

This trial evaluates the effectiveness and implementation of two versions of CETA using a non-inferiority design to test two primary hypotheses: (1) a brief five-session version of CETA (Brief CETA) will provide similar effectiveness for reducing the severity of common mental health problems such as depression, post-traumatic stress, impaired functioning, anxiety, and substance use problems compared with the standard 8–12-session version of CETA (Standard CETA); and (2) both Brief and Standard CETA will have superior impact on the outcomes compared to a wait-list control condition. For both hypotheses, the main effect will be assessed using longitudinal data and mixed-effects regression models over a 6-month period post baseline. A secondary aim includes exploration of implementation factors. Additional planned analyses will include exploration of: moderators of treatment impact by disorder severity and comorbidity; the impact of individual therapeutic components; and trends in symptom change between end of treatment and 6-month assessment for all participants.

Discussion

This trial is the first rigorous study comparing a standard-length (8–12 sessions) modular, flexible, transdiagnostic, cognitive-behavioral approach to a shortened version of the approach (five sessions). Brief CETA entails “front-loading” with elements that research suggests are strong mechanisms of change. The study design will allow us to draw conclusions about the effects of both Brief and Standard CETA as well as which elements are integral to their mechanisms of action, informing future implementation and fidelity efforts. The results from this trial will inform future dissemination, implementation and scale-up of CETA in Ukraine and contribute to our understanding of the effects of modular, flexible, transdiagnostic approaches in similar contexts.

Trial registration

ClinicalTrials.gov, ID: NCT03058302 (U.S. National Library of Medicine). Registered on 20 February 2017.

✪ Pilot to policy: statewide dissemination and implementation of evidence-based treatment for traumatized youth

Authors:

Lisa Amaya-Jackson, Dana Hagele, John Sideris, Donna Potter, Ernestine C. Briggs, Leila Keen, Robert A. Murphy, Shannon Dorsey, Vanessa Patchett, George S. Ake and Rebecca Socolar

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2018

Read the full text in the journal BMC Health Services Research

Abstract:

Background

A model for statewide dissemination of evidence-based treatment (EBT) for traumatized youth was piloted and taken to scale across North Carolina (NC). This article describes the implementation platform developed, piloted, and evaluated by the NC Child Treatment Program to train agency providers in Trauma-Focused Cognitive Behavioral Therapy using the National Center for Child Traumatic Stress Learning Collaborative (LC) Model on Adoption & Implementation of EBTs. This type of LC incorporates adult learning principles to enhance clinical skills development as part of training and many key implementation science strategies while working with agencies and clinicians to implement and sustain the new practice.

Methods

Clinicians (n = 124) from northeastern NC were enrolled in one of two TF-CBT LCs that lasted 12 months each. During the LC clinicians were expected to take at least two clients through TF-CBT treatment with fidelity and outcomes monitoring by trainers who offered consultation by phone and during trainings. Participating clinicians initiated treatment with 281 clients. The relationship of clinician and client characteristics to treatment fidelity and outcomes was examined using hierarchical linear regression.

Results

One hundred eleven clinicians completed general training on trauma assessment batteries and TF-CBT. Sixty-five clinicians met all mastery and fidelity requirements to meet roster criteria. One hundred fifty-six (55%) clients had fidelity-monitored assessment and TF-CBT. Child externalizing, internalizing, and post-traumatic stress symptoms, as well as parent distress levels, decreased significantly with treatment fidelity moderating child PTSD outcomes. Since this pilot, 11 additional cohorts of TF-CBT providers have been trained to these roster criteria.

Conclusion

Scaling up or outcomes-oriented implementation appears best accomplished when training incorporates: 1) practice-based learning, 2) fidelity coaching, 3) clinical assessment and outcomes-oriented treatment, 4) organizational skill-building to address barriers for agencies, and 5) linking clients to trained clinicians via an online provider roster. Demonstrating clinician performance and client outcomes in this pilot and subsequent cohorts led to legislative support for dissemination of a service array of EBTs by the NC Child Treatment Program.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ An evaluation of a common elements treatment approach for youth in Somali refugee camps

Authors:

L. K. Murray, B. J. Hall, S. Dorsey, A. M. Ugueto, E. S. Puffer, A. Sim, A. Ismael, J. Bass, C. Akiba, L. Lucid, J. Harrison, A. Erikson, and P. A. Bolton

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2018

Read the full text in the open access journal Global Mental Health

Excerpt:

Introduction

Children, defined as any boy or girl under 18 years, make up almost half of the world’s refugee population (United Nations High Commissioner for Refugees, 2016) and are exposed to challenges, traumas and stressors at the individual, family, and community levels that increase their risk for mental health problems (Barenbaum et al., 2004; Betancourt & Khan, 2008; Reed et al., 2012). These may include forced migration, forced labor, witnessing of murder and mass killings, lack of food and shelter, rape, torture, loss and separation from family, recruitment and use by armed forces, physical abuse, and family and sexual violence (Lustig et al., 2004; Office of the Special Representative of the Secretary-General for Children & Armed Conflict et al., 2009). Overlaid on potentially traumatic events are the daily, chronic stressors caused by displacement and associated with living in the camp environment – lack of basic needs, crowded and unsafe living conditions, and interpersonal conflict, among others (Layne et al., 2010; Miller & Rasmussen, 2010).

Children affected by these types of traumas and stressors present with a wide range of mental health symptoms, including those associated with posttraumatic stress (PTS), depression, anxiety, conduct problems, risk behaviors (e.g., alcohol or drug use), and distress associated with grief reactions (Barenbaum et al., 2004; Lustig et al., 2004; Sagi-Schwartz, 2008; Attanayake et al., 2009; Okello et al., 2013[for review], Morgos et al., 2008; Fernando et al., 2010; Miller & Rasmussen, 2010; Reed et al., 2012; Meyer et al., 2013; Newnham et al., 2015). Prevalence is difficult to study in these contexts; however, most studies find higher rates of mental health problems among displaced children compared with non-displaced populations (Goldstein et al., 1997; Paardekooper et al., 1999; Tousignant et al., 1999; Morgos et al., 2008; Bronstein & Montgomery, 2011; Reed et al., 2012).

There remains limited evidence on the effectiveness of interventions to treat mental health problems of children in refugee settings in low- and middle-income countries (LMICs). Some studies suggest that cognitive–behavioral-based treatments can be effective for reducing mental health symptoms in refugee children (Bolton et al., 2007; Layne et al., 2010). Relatedly, some eclectic psychosocial programs have been tested with conflict-affected populations, and show an impact on outcomes such as self-esteem or hope, but not mental health (Tol et al., 2014). Studies have generally utilized focal disorder treatments – or treatments focused on one disorder or cluster of symptoms. For example, Layne and colleagues used a treatment developed for posttraumatic stress disorder (PTSD) and grief (Layne et al., unpublished treatment manual) and Bolton and team (2007) used a treatment developed for depression (Interpersonal Therapy for depression; IPT). In contrast to this focal disorder treatment model where everyone receives the same elements in the same order, in common elements approaches providers learn elements that can be combined in different ways (elements used, order, dose) to treat a range of common mental health symptoms, and how to handle comorbidity (e.g., depression, trauma, anxiety co-occurrence) (Chorpita et al., 2005; Weisz et al., 2011; Weisz et al., 2012; Murray et al., 2014a). This approach is potentially more efficient and sustainable in both high-income countries (Mansell et al., 2008; Weisz et al., 2011; Weisz et al., 2012) and in LMICs (Bolton et al., 2014; Murray et al., 2014a; Ventevogel, 2015; Weisz et al., 2015) because it does not require providers to learn multiple interventions. Additionally, in settings with high rates of disorder comorbidity, such as in refugee populations, a model that can address multiple disorders may also be more appropriate (Murray & Jordans, 2016).

Current project

This paper reports on: (1) an evaluation of a common elements treatment approach (CETA) (Bolton et al., 2007; Bolton et al., 2014; Murray et al., 2014a; Weisz et al., 2015) developed for comorbid presentations of depression, anxiety, post traumatic stress, and/or externalizing symptoms among children in three Somali refugee camps on the Ethiopian/Somali border; and (2) an evaluation of implementation factors including acceptability, applicability/fit, feasibility and treatment facilitators, and barriers from the perspective of staff of the implementing partner organization, lay providers, and families who engaged in…

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Authors:

Shannon Dorsey, Suzanne E. U. Kerns, Leah Lucid, Michael D. Pullmann, Julie P. Harrison, Lucy Berliner, Kelly Thompson, and Esther Deblinger

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

Methods

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

Results

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

Conclusions

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

Trial registration

NCT01800266, Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results])
**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children’s Mental Health Initiative

Authors:

Shannon Dorsey, Aaron R. Lyon, Michael D. Pullmann, Nathaniel Jungbluth, Lucy Berliner, & Rinad Beidas

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: March 2016

Read the full text in the subscription access journal Administration and Policy in Mental Health and Mental Health Services Research