Skip to content
Implementation Science at UW

Keywords: Clinical Supervision

✪ A randomized controlled trial testing supervision strategies in community mental health

Authors:

Shannon Dorsey, Rashed AlRasheed, Suzanne EU Kerns, Rosemary D Meza, Noah Triplett, Esther Deblinger, Nathaniel Jungbluth, Lucy Berliner, Lavangi Naithani, and Michael D Pullmann

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Clinicians need supports beyond training to deliver evidence-based treatments with fidelity. Workplace-based clinical supervision often is a commonly provided support in community mental health, yet too few studies have empirically examined supervision and its impact on clinician fidelity and treatment delivery.

Method

Building on a Washington State-funded evidence-based treatment initiative (CBT+), we conducted a randomized controlled trial (RCT), testing two supervision conditions delivered by workplace-based supervisors (supervisors employed by community mental health organizations). The RCT followed a supervision-as-usual (SAU) phase for comparison. The treatment of focus was trauma-focused cognitive behavioral therapy (TF-CBT). Clinicians (N = 238) from 25 organizations participated in the study across the SAU baseline and RCT phases. In the RCT phase, clinicians were randomized to either symptom and fidelity monitoring (SFM) or SFM and behavioral rehearsal (SFM + BR). For BR, clinicians engaged in a short role play of an upcoming treatment element. Supervisors delivered both conditions, with regular study monitoring for drift. Clinicians audiorecorded therapy sessions with enrolled clients, and masked coders coded a subset of recordings for adherence to TF-CBT. One hundred and thirty-three clinicians had recorded TF-CBT session data for 258 youth. We examined six adherence outcomes, including potential moderators.

Results

Results of generalized estimating equations indicated that there were no real differences on adherence outcomes for experimental conditions (SFM, SFM + BR) compared to SAU. Adherence scores in the baseline SAU phase and the RCT conditions were high. Only one interaction was significant.

Conclusions

Contrary to our hypotheses, we did not see improvements in adherence with the RCT conditions. However, nonsignificant findings seem best explained by clinicians’ acceptable/high adherence in SAU. This study was conducted within the context of a long-standing, state-funded EBT initiative, in which clinicians and their supervisors receive training and support, and in which participating community mental health organizations have adopted and supported TF-CBT.

Trial Registration

ClinicalTrials.gov ID: NCT01800266

Plain Language Summary

Clinicians often receive training in evidence-based treatments (EBTs), but training alone is not enough for clinicians to deliver EBTs well. They need other supports. One of the necessary supports is clinical supervision. In public community mental health organizations, which are often resource-constrained, routine clinical supervision is a commonly available support. However, its potential for supporting high-quality EBT delivery is not well understood. This study looked at supervision and clinicians’ delivery of trauma-focused cognitive behavioral therapy (TF-CBT), an EBT for youth who have mental health problems subsequent to trauma. We found that clinicians who received workplace-based supervision on TF-CBT from TF-CBT-trained supervisors, within the context of a state-funded EBT initiative, delivered TF-CBT well. This initiative supported delivery by providing training and supervisor-specific supports. In a second phase of the study, we rigorously tested supervisors’ use of two specific technique packages. These packages included having supervisors review: (a) graphed client mental health symptoms across treatment and clinicians’ report of TF-CBT elements delivered each session or (b) these plus having clinicians do a brief demonstration of how they would deliver an upcoming TF-CBT element to their client, so supervisors could “see” clinicians’ skill and provide feedback. Contrary to expectations, we did not see important differences in clinicians’ TF-CBT delivery. This may be because the clinicians enrolled in our study were already delivering TF-CBT well and, therefore, there was less opportunity for changes. Future studies should explore if these techniques are more helpful for specific situations or clinicians.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Co-developed implementation guidelines to maximize acceptability, feasibility, and usability of mobile phone supervision in Kenya

Authors:

Noah S. Triplett, Anne Mbwayo, Sharon Kiche, Lucy Liu, Jacinto Silva, Rashed AlRasheed, Clara Johnson, Cyrilla Amanya, Sean Munson, Bryan J. Weiner, Pamela Y. Collins & Shannon Dorsey

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Cambridge Prisms: Global Mental Health

Abstract:

Opportunities exist to leverage mobile phones to replace or supplement in-person supervision of lay counselors. However, contextual variables, such as network connectivity and provider preferences, must be considered. Using an iterative and mixed methods approach, we co-developed implementation guidelines to support the implementation of mobile phone supervision with lay counselors and supervisors delivering a culturally adapted trauma-focused cognitive behavioral therapy in Western Kenya. Guidelines were shared and discussed with lay counselors in educational outreach visits led by supervisors. We evaluated the impact of guidelines and outreach on the acceptability, feasibility, and usability of mobile phone supervision. Guidelines were associated with significant improvements in acceptability and usability of mobile phone supervision. There was no evidence of a significant difference in feasibility. Qualitative interviews with lay counselors and supervisors contextualized how guidelines impacted acceptability and feasibility – by setting expectations for mobile phone supervision, emphasizing importance, increasing comfort, and sharing strategies to improve mobile phone supervision. Introducing and discussing co-developed implementation guidelines significantly improved the acceptability and usability of mobile phone supervision. This approach may provide a flexible and scalable model to address challenges with implementing evidence-based practices and implementation strategies in lower-resourced areas.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying human-centered design to maximize acceptability, feasibility, and usability of mobile technology supervision in Kenya: A mixed methods pilot study protocol

Authors:

Noah S. Triplett, Sean Munson, Anne Mbwayo, Teresia Mutavi, Bryan J. Weiner, Pamela Collins, Cyrilla Amanya, & Shannon Dorsey

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2021

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Although research continues to support task-shifting as an effective model of delivering evidence-based practices (EBPs), little scholarship has focused how to scale up and sustain task-shifting in low- and middle-income countries, including how to sustainably supervise lay counselors. Ongoing supervision is critical to ensure EBPs are delivered with fidelity; however, the resources and expertise required to provide ongoing supervision may limit the potential to scale up and sustain task shifting. Opportunities may exist to leverage mobile technology to replace or supplement in-person supervision in low-resource contexts, but contextual variables, such as network connectivity and lay counselor preferences surrounding mobile technology, must be examined and considered when designing and implementing mobile technology supervision.

Methods

This study builds from an existing randomized trial in Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy as lay counselors. The study will use an iterative and mixed methods approach, with qualitative interviews and a Human-Centered Design (HCD) workshop informing a non-randomized pilot trial. Semi-structured interviews will be conducted with lay counselors and supervisors to understand how mobile technology is currently being used for supervision and determine the barriers and facilitators to mobile technology supervision. Data from these interviews will inform an HCD workshop, where lay counselors and supervisors “re-design” supervision to most effectively leverage mobile technology. Workshop participants will also participate in focus groups to gather perceptions on the use of HCD techniques. The final outcome of the workshop will be a set of refined workflows, which will be tested in a mixed method, nonrandomized pilot with newly trained lay counselors and existing supervisors. The pilot trial will evaluate the acceptability, feasibility, and usability of mobile technology supervision through self-report questionnaires as well as perceptions of effectiveness through qualitative interviews with a subset of lay counselors and all supervisors.

Discussion

This study will provide a launching point for future research on supervision and methods to engage stakeholders to design and tailor interventions and implementation supports to fit low-resourced contexts.

Trial registration

The parent trial from which this study builds was registered on ClinicalTrials.gov on August 9, 2017 (NCT03243396).

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation Climate and Time Predict Intensity of Supervision Content Related to Evidence Based Treatment

Authors:

Michael D. Pullmann, Leah Lucid, Julie P. Harrison, Prerna Martin, Esther Deblinger, Katherine S. Benjamin and Shannon Dorsey
University of Washington affiliated authors are displayed in bold.
Published: October 2018

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Objective

Children infrequently receive evidence-based treatments (EBTs) for mental health problems due to a science-to-practice implementation gap. Workplace-based clinical supervision, in which supervisors provide oversight, feedback, and training on clinical practice, may be a method to support EBT implementation. Our prior research suggests that the intensity of supervisory focus on EBT (i.e., thoroughness of coverage) during workplace-based supervision varies. This study explores predictors of supervisory EBT intensity.

Methods

Participants were twenty-eight supervisors and 70 clinician supervisees. They completed a baseline survey, and audio recorded supervision sessions over 1 year. Four hundred and thirty eight recordings were coded for supervision content. We chose to explore predictors of two EBT content elements due to their strong evidence for effectiveness and sufficient variance to permit testing. These included a treatment technique (“exposure”) and a method to structure treatment (“assessment”). We also explored predictors of non-EBT content (“other topics”). Mixed-effects models explored predictors at organizational/supervisor, clinician, and session levels.

Results

Positive implementation climate predicted greater intensity of EBT content coverage for assessment (coefficient = 0.82, p = 0.004) and exposure (coefficient = 0.87, p = 0.001). Intensity of exposure coverage was also predicted by more time spent discussing each case (coefficient = 0.04, p < 0.001). Predictors of greater non-EBT content coverage included longer duration of supervision sessions (coefficient = 0.05, p < 0.001) and lower levels of supervisor EBT knowledge (coefficient = −0.17, p = 0.013). No other supervisor- or clinician-level variables were significant predictors in the mixed effects models.

Conclusion

This was the first study to explore multi-level predictors of objectively coded workplace-based supervision content. Results suggest that organizations that expect, support and reward EBT are more likely to have greater intensity of EBT supervision coverage, which in turn may positively impact clinician EBT fidelity and client outcomes. There was evidence that supervisor knowledge of the EBT contributes to greater coverage, although robust supervisor and clinician factors that drive supervision are yet to be identified. Findings highlight the potential effectiveness of implementation strategies that simultaneously address organizational implementation climate and supervisor practices. More research is needed to identify mechanisms that support integration of EBT into supervision.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Authors:

Shannon Dorsey, Suzanne E. U. Kerns, Leah Lucid, Michael D. Pullmann, Julie P. Harrison, Lucy Berliner, Kelly Thompson, and Esther Deblinger

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2018

Read the full text in the open access journal Implementation Science

Abstract:

Background

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

Methods

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

Results

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

Conclusions

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

Trial registration

NCT01800266, Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results])
**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**