Skip to content

✪ Exploring the impact of workforce turnover on the sustainability of evidence-based programs: A scoping review

Authors:

Kelley M. Pascoe, Miruna Petrescu-Prahova, Lesley Steinman, Jennifer Bacci, Siobhan Mahorter, Basia Belza, & Bryan Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Evidence-based programs (EBPs) are used across disciplines to integrate research into practice and improve outcomes at the individual and/or community level. Despite widespread development and implementation of EBPs, many programs are not sustained beyond the initial implementation period due to many factors, including workforce turnover. This scoping review summarizes research on the impact of workforce turnover on the sustainability of EBPs and recommendations for mitigating these impacts.

Methods

We searched 10 databases for articles that focused on an EBP and described an association between workforce turnover and the sustainment or sustainability of the program. We created a data abstraction tool to extract relevant information from each article and applied the data abstraction tool to all included articles to create the dataset. Data were mapped and analyzed using the program sustainability framework (PSF).

Results and Discussion

A total of 30 articles were included in this scoping review and mapped to the PSF. Twenty-nine articles described impacts of workforce turnover and 18 articles proposed recommendations to address the impacts. The most frequent impacts of workforce turnover included increased need for training, loss of organizational knowledge, lack of EBP fidelity, and financial stress. Recommendations to address the impact of workforce turnover included affordable and alternative training modalities, the use of champions or volunteers, increasing program alignment with organizational goals, and generating diverse funding portfolios.

Conclusion

The sustainment of EBPs is critical to ensure and maintain the short- and long-term benefits of the EBP for all participants and communities. Understanding the impacts of workforce turnover, a determinant of sustainability, can create awareness among EBP-implementing organizations and allow for proactive planning to increase the likelihood of program sustainability.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Process evaluation of PrEP implementation in Kenya: adaptation of practices and contextual modifications in public HIV care clinics

Authors:

Elizabeth M. Irungu, Josephine Odoyo, Elizabeth Wamoni, Elizabeth A. Bukusi, Nelly R. Mugo, Kenneth Ngure, Jennifer F. Morton, Kenneth K. Mugwanya, Jared M. Baeten, & Gabrielle O'Malley, for the Partners Scale-Up Project Team

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access Journal of the International AIDS Society

Abstract:

Introduction

In Africa, oral pre-exposure prophylaxis (PrEP) is largely provided via over-burdened public HIV care clinics. Successfully incorporating PrEP services into these clinics may require adaptations to practices outlined in national implementation guidelines and modifications to routine existing service delivery. We aimed to describe adaptations made by public HIV clinics in Kenya to integrate PrEP delivery into existing services.

Methods

The Partners Scale-Up Project aimed to catalyze integration of PrEP in 25 public HIV care clinics. Between May and December 2018, we conducted qualitative interviews with health providers and documented clinic observations in technical assistance (TA) reports to understand the process of PrEP service integration. We analyzed 36 health provider interview transcripts and 25 TA reports to identify clinic-level adaptations to activities outlined in Kenyan Ministry of Health PrEP guidelines and modifications made to existing service delivery practices to successfully incorporate PrEP services. Identified adaptations were reported using the expanded framework for reporting adaptations and modifications (FRAME).

Results

All clinics (n = 25) performed HIV testing, HIV risk assessment, PrEP education and adherence counseling as stipulated in the guidelines. Most clinics initiated clients on PrEP without creatinine testing if otherwise healthy. While monthly refill appointments are recommended, a majority of clinics issued PrEP users two to three months of pills at a time. Clinics also implemented practices that had not been specified in the guidelines including incorporating PrEP-related topics into routine health talks, calling clients with missed PrEP appointments, discussing PrEP service delivery in regular staff meetings, ‘fast-tracking’ PrEP clients and dispensing PrEP in clinic rooms rather than at clinic-based pharmacies. PrEP initiation numbers were highest among clinics that did not require creatinine testing, conducted peer on-the-job PrEP training and those that discussed PrEP delivery in their routine meetings. Above-average continuation was observed among clinics that discussed PrEP in their routine meetings, dispensed PrEP in clinic rooms and offered PrEP at non-regular hours.

Conclusions

Health providers in public HIV care clinics instituted practices and made innovative adaptations to PrEP delivery to reduce barriers for clients and staff. Encouraging clinic level adaptations to national implementation guidelines will facilitate scale-up of PrEP delivery.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Aligning implementation science with improvement practice: A call to action

Authors:

Jennifer Leeman, Catherine Rohweder, Matthew Lee, Alison Brenner, Andrea Dwyer, Linda K. Ko, Meghan C. O’Leary, Grace Ryan, Thuy Vu, & Shoba Ramanadhan

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

In several recent articles, authors have called for aligning the fields of implementation and improvement science. In this paper, we call for implementation science to also align with improvement practice. Multiple implementation scholars have highlighted the importance of designing implementation strategies to fit the existing culture, infrastructure, and practice of a healthcare system. Worldwide, healthcare systems are adopting improvement models as their primary approach to improving healthcare delivery and outcomes. The prevalence of improvement models raises the question of how implementation scientists might best align their efforts with healthcare systems’ existing improvement infrastructure and practice.

Main body

We describe three challenges and five benefits to aligning implementation science and improvement practice. Challenges include (1) use of different models, terminology, and methods, (2) a focus on generalizable versus local knowledge, and (3) limited evidence in support of the effectiveness of improvement tools and methods. We contend that implementation science needs to move beyond these challenges and work toward greater alignment with improvement practice. Aligning with improvement practice would benefit implementation science by (1) strengthening research/practice partnerships, (2) fostering local ownership of implementation, (3) generating practice-based evidence, (4) developing context-specific implementation strategies, and (5) building practice-level capacity to implement interventions and improve care. Each of these potential benefits is illustrated in a case study from the Centers for Disease Control and Prevention’s Cancer Prevention and Control Research Network.

Conclusion

To effectively integrate evidence-based interventions into routine practice, implementation scientists need to align their efforts with the improvement culture and practice that is driving change within healthcare systems worldwide. This paper provides concrete examples of how researchers have aligned implementation science with improvement practice across five implementation projects.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Clinical leaders and providers’ perspectives on delivering medications for the treatment of opioid use disorder in Veteran Affairs’ facilities

Authors:

Eric J. Hawkins, Anissa N. Danner, Carol A. Malte, Brittany E. Blanchard, Emily C. Williams, Hildi J. Hagedorn, Adam J. Gordon, Karen Drexler, Jennifer L. Burden, Jennifer Knoeppel, Aline Lott, George G. Sayre, Amanda M. Midboe, & Andrew J. Saxon

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Addiction Science & Clinical Practice

Abstract:

Background

Improving access to medication treatment of opioid use disorder (MOUD) is a national priority, yet common modifiable barriers (e.g., limited provider knowledge, negative beliefs about MOUD) often challenge implementation of MOUD delivery. To address these barriers, the VA launched a multifaceted implementation intervention focused on planning and educational strategies to increase MOUD delivery in 18 medical facilities. The purpose of this investigation was to determine if a multifaceted intervention approach to increase MOUD delivery changed providers’ perceptions about MOUD over the first year of implementation.

Methods

Cross-disciplinary teams of clinic providers and leadership from primary care, pain, and mental health clinics at 18 VA medical facilities received invitations to complete an anonymous, electronic survey prior to intervention launch (baseline) and at 12- month follow-up. Responses were summarized using descriptive statistics, and changes over time were compared using regression models adjusted for gender and prescriber status, and clustered on facility. Responses to open-ended questions were thematically analyzed using a template analysis approach.

Results

Survey response rates at baseline and follow-up were 57.1% (56/98) and 50.4% (61/121), respectively. At both time points, most respondents agreed that MOUD delivery is important (94.7 vs. 86.9%), lifesaving (92.8 vs. 88.5%) and evidence-based (85.2 vs. 89.5%). Over one-third (37.5%) viewed MOUD delivery as time-consuming, and only 53.7% affirmed that clinic providers wanted to prescribe MOUD at baseline; similar responses were seen at follow-up (34.5 and 52.4%, respectively). Respondents rated their knowledge about OUD, comfort discussing opioid use with patients, job satisfaction, ability to help patients with OUD, and support from colleagues favorably at both time points. Respondents’ ratings of MOUD delivery filling a gap in care were high but declined significantly from baseline to follow-up (85.7 vs. 73.7%, p < 0.04). Open-ended responses identified implementation barriers including lack of support to diagnose and treat OUD and lack of time.

Conclusions

Although perceptions about MOUD generally were positive, targeted education and planning strategies did not improve providers’ and clinical leaders’ perceptions of MOUD over time. Strategies that improve leaders’ prioritization and support of MOUD and address time constraints related to delivering MOUD may increase access to MOUD in non-substance use treatment clinics.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Population-based implementation of behavioral health detection and treatment into primary care: early data from New York state

Authors:

Deborah J. Bowen, Ashley Heald, Erin LePoire, Amy Jones, Danielle Gadbois, Joan Russo, & Jay Carruthers

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

The Collaborative Care Model is a well-established, evidence-based approach to treating depression and other common behavioral health conditions in primary care settings. Despite a robust evidence base, real world implementation of Collaborative Care has been limited and very slow. The goal of this analysis is to better describe and understand the progression of implementation in the largest state-led Collaborative Care program in the nation—the New York State Collaborative Care Medicaid Program.

Data are presented using the RE-AIM model, examining the proportion of clinics in each of the model’s five steps from 2014 to 2019.

Methods

We used the RE-AIM model to shape our data presentation, focusing on the proportion of clinics moving into each of the five steps of this model over the years of implementation. Data sources included: a New York State Office of Mental Health clinic tracking database, billing applications, quarterly reports, and Medicaid claims.

Results

A total of 84% of clinics with which OMH had an initial contact [n = 611clinics (377 FQHCs and 234 non-FQHCs)] received some form of training and technical assistance. Of those, 51% went on to complete a billing application, 41% reported quarterly data at least once, and 20% were able to successfully bill Medicaid. Of clinics that reported data prior to the first quarter of 2019, 79% (n = 130) maintained Collaborative Care for 1 year or more. The receipt of any training and technical assistance was significantly associated with our implementation indices: (completed billing application, data reporting, billing Medicaid, and maintaining Collaborative Care). The average percent of patient improvement for depression and anxiety across 155 clinics that had at least one quarter of data was 44.81%. Training and technical assistance source (Office of Mental Health, another source, or both) and intensity (high/low) were significantly related to implementation indices and were observed in FQHC versus non-FQHC samples.

Conclusions

Offering Collaborative Care training and technical assistance, particularly high intensity training and technical assistance, increases the likelihood of implementation. Other state-wide organizations might consider the provision of training and technical assistance when assisting clinics to implement Collaborative Care.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ De-implementing and sustaining an intervention to eliminate nursing home resident bed and chair alarms: Interviews on leadership and staff perspectives

Authors:

Christine W. Hartmann, Christopher Gillespie, George G. Sayre, & A. Lynn Snow

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2021

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Improving nursing home quality of care relies partly on reducing or stopping ineffective or harmful practices, a process known as de-implementation. We know little about de-implementation in this setting. Relatively recent policy changes reclassified resident position-change (bed and chair) alarms, which monitor resident movement, as restraints. This created an optimal environment in which to study impressions of an alarm de-implementation and sustainment intervention.

Methods

This cross-sectional interview study focused on understanding participants’ experience of a quality improvement program in the Department of Veterans Affairs Community Living Centers (nursing homes). The program’s goal was to improve resident outcomes and staff communication and teamwork through, among other foci, eliminating resident position-change alarms. The Community Living Centers were located in geographically dispersed areas of the continental United States. Interview participants were leadership and staff members from seven Community Living Centers. We conducted in-depth, semi-structured qualitative interviews using a convenience sample and used a thematic analytic approach.

Results

We conducted seventeen interviews. We identified five main themes: Initiating De-implementation (compelling participants with evidence, engaging local leadership, and site-level education and training), Changing Expectations (educating staff and family members), Using Contrasting Approaches (gradual or abrupt elimination of alarms), Witnessing Positive Effects of De-implementation (reduction in resident falls, improved resident sleep, reduction in distressing behaviors, and increased resident engagement), and Staying the Course (sustainment of the initiative).

Conclusions

Findings highlight how participants overcame barriers and successfully eliminated resident position-change alarms and sustained the de-implementation through using convincing evidence for the initiative, local leadership involvement and support, and staff and family member education and engagement. These findings and the resulting three-phase process to support nursing homes' de-implementation efforts expand the de-implementation science knowledge base and provide a promising framework for other nursing home-based de-implementation initiatives.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Low costs and opportunities for efficiency: a cost analysis of the first year of programmatic PrEP delivery in Kenya’s public sector

Authors:

Kathryn Peebles, Kenneth K. Mugwanya, Elizabeth Irungu, Josephine Odoyo, Elizabeth Wamoni, Jennifer F. Morton, Kenneth Ngure, Elizabeth A. Bukusi, Nelly R. Mugo, Sarah Masyuko, Irene Mukui, Jared M. Baeten, & Ruanne V. Barnabas for the Partners Scale-Up Project Team

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2021

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

In 2017, the Kenyan Ministry of Health integrated provision of pre-exposure prophylaxis (PrEP) into public HIV-1 care clinics as a key component of the national HIV-1 prevention strategy. Estimates of the cost of PrEP provision are needed to inform the affordability and cost-effectiveness of PrEP in Kenya.

Methods

We conducted activity-based micro-costing from the payer perspective to estimate both the financial and economic costs of all resources and activities required to provide PrEP in Kenya’s public sector. We estimated total and unit costs in 2019 United States dollars from a combination of project expense reports, Ministry of Health training reports, clinic staff interviews, time-and-motion observations, and routinely collected data from PrEP recipient files from 25 high-volume HIV-1 care clinics.

Results

In the first year of programmatic PrEP delivery in 25 HIV-1 care clinics, 2,567 persons initiated PrEP and accrued 8,847 total months of PrEP coverage, accounting for 2 % of total outpatient clinic visits. The total financial cost to the Ministry of Health was $91,175, translating to an average of $10.31 per person per month. The majority (69 %) of financial costs were attributable to PrEP medication, followed by administrative supplies (17 %) and training (9 %). Economic costs were higher ($188,584 total; $21.32 per person per month) due to the inclusion of the opportunity cost of staff time re-allocated to provide PrEP and a proportional fraction of facility overhead. The vast majority (88 %) of the annual $80,811 economic cost of personnel time was incurred during activities to recruit new clients (e.g., discussion of PrEP within HIV-1 testing and counseling services), while the remaining 12 % was for activities related to both initiation and maintenance of PrEP provision (e.g., client consultations, technical advising, support groups).

Conclusions

Integration of PrEP provision into existing public health HIV-1 care service delivery platforms resulted in minimal additional staff burden and low incremental costs. Efforts to improve the efficiency of PrEP provision should focus on reductions in the cost of PrEP medication and extra-clinic demand creation and community sensitization to reduce personnel time dedicated to recruitment-related activities.

Trial registration

ClinicalTrials.gov registration NCT03052010. Retrospectively registered on February 14, 2017.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementing Dialectical Behavior Therapy Skills Training for Emotional Problem Solving for Adolescents (DBT STEPS-A) in a Low-Income School

Authors:

Carla D. Chugani, Courtney E. Murphy, Janine Talis, Elizabeth Miller, Christopher McAneny, Daniel Condosta, Julie Kamnikar, Edward Wehrer, & James J. Mazza

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2021

Read the full text in the open access journal School Mental Health

Abstract:

Adolescents living in low-income areas often have high need for mental health supports due to experiences of poverty and trauma, coupled with limited access and availability of such supports. This study investigated the implementation of a socio-emotional learning curriculum titled, “Dialectical Behavior Therapy Skills Training for Emotional Problem Solving for Adolescents (DBT STEPS-A),” which was integrated into health classes in a low-income high school.

While preliminary evidence suggests that DBT STEPS-A can be effective in reducing mental health symptoms in high school students, this study is the first to explore the program’s acceptability, appropriateness, and feasibility when implemented in a low-income school. The implementation presented here also diverged from recommended training protocols due to time and cost limitations. Quantitative and qualitative data were collected from 29 school stakeholders prior to implementation and from 23 school stakeholders post-implementation.

Our results indicate that DBT STEPS-A is acceptable and feasible for teachers involved in offering the program and that more work is needed to address appropriateness of the content for racially and socio-economically diverse students, ease of implementing lessons, and support for teachers using DBT STEPS-A skills outside of class. We conclude with a discussion of key implementation challenges and solutions generated.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**