Feasibility Archives - Page 8 of 8 - Implementation Science at UW

✪ Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Abstract:

Background

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

Methods

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

Results

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

Conclusions

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

Trial registration

NCT01800266, Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results])
^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ An individually tailored family-centered intervention for pediatric obesity in primary care: study protocol of a randomized type II hybrid effectiveness–implementation trial (Raising Healthy Children study)

Abstract:

Background

Pediatric obesity is a multi-faceted public health concern that can lead to cardiovascular diseases, cancers, and early mortality. Small changes in diet, physical activity, or BMI can significantly reduce the possibility of developing cardiometabolic risk factors. Family-based behavioral interventions are an underutilized, evidence-based approach that have been found to significantly prevent excess weight gain and obesity in children and adolescents. Poor program availability, low participation rates, and non-adherence are noted barriers to positive outcomes. Effective interventions for pediatric obesity in primary care are hampered by low family functioning, motivation, and adherence to recommendations.

Methods

This (type II) hybrid effectiveness–implementation randomized trial tests the Family Check-Up 4 Health (FCU4Health) program, which was designed to target health behavior change in children by improving family management practices and parenting skills, with the goal of preventing obesity and excess weight gain. The FCU4Health is assessment driven to tailor services and increase parent motivation. A sample of 350 families with children aged 6 to 12 years who are identified as overweight or obese (BMI ≥ 85th percentile for age and gender) will be enrolled at three primary care clinics [two Federally Qualified Healthcare Centers (FQHCs) and a children’s hospital]. All clinics serve predominantly Medicaid patients and a large ethnic minority population, including Latinos, African Americans, and American Indians who face disparities in obesity, cardiometabolic risk, and access to care. The FCU4Health will be coordinated with usual care, using two different delivery strategies: an embedded approach for the two FQHCs and a referral model for the hospital-based clinic. To assess program effectiveness (BMI, body composition, child health behaviors, parenting, and utilization of support services) and implementation outcomes (such outcomes as acceptability, adoption, feasibility, appropriateness, fidelity, and cost), we use a multi-method and multi-informant assessment strategy including electronic health record data, behavioral observation, questionnaires, interviews, and cost capture methods.

Discussion

This study has the potential to prevent excess weight gain, obesity, and health disparities in children by establishing the effectiveness of the FCU4Health and collecting information critical for healthcare decision makers to support sustainable implementation of family-based programs in primary care.

Trial registration

NCT03013309 ClinicalTrials.gov
^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Psychometric assessment of three newly developed implementation outcome measures

Abstract:

Background

Implementation outcome measures are essential for monitoring and evaluating the success of implementation efforts. Yet, currently available measures lack conceptual clarity and have largely unknown reliability and validity. This study developed and psychometrically assessed three new measures: the Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).

Methods

Thirty-six implementation scientists and 27 mental health professionals assigned 31 items to the constructs and rated their confidence in their assignments. The Wilcoxon one-sample signed rank test was used to assess substantive and discriminant content validity. Exploratory and confirmatory factor analysis (EFA and CFA) and Cronbach alphas were used to assess the validity of the conceptual model. Three hundred twenty-six mental health counselors read one of six randomly assigned vignettes depicting a therapist contemplating adopting an evidence-based practice (EBP). Participants used 15 items to rate the therapist’s perceptions of the acceptability, appropriateness, and feasibility of adopting the EBP. CFA and Cronbach alphas were used to refine the scales, assess structural validity, and assess reliability. Analysis of variance (ANOVA) was used to assess known-groups validity. Finally, half of the counselors were randomly assigned to receive the same vignette and the other half the opposite vignette; and all were asked to re-rate acceptability, appropriateness, and feasibility. Pearson correlation coefficients were used to assess test-retest reliability and linear regression to assess sensitivity to change.

Results

All but five items exhibited substantive and discriminant content validity. A trimmed CFA with five items per construct exhibited acceptable model fit (CFI = 0.98, RMSEA = 0.08) and high factor loadings (0.79 to 0.94). The alphas for 5-item scales were between 0.87 and 0.89. Scale refinement based on measure-specific CFAs and Cronbach alphas using vignette data produced 4-item scales (α’s from 0.85 to 0.91). A three-factor CFA exhibited acceptable fit (CFI = 0.96, RMSEA = 0.08) and high factor loadings (0.75 to 0.89), indicating structural validity. ANOVA showed significant main effects, indicating known-groups validity. Test-retest reliability coefficients ranged from 0.73 to 0.88. Regression analysis indicated each measure was sensitive to change in both directions.

Conclusions

The AIM, IAM, and FIM demonstrate promising psychometric properties. Predictive validity assessment is planned.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Using Practice Facilitation to Increase Rates of Colorectal Cancer Screening in Community Health Centers, North Carolina, 2012-2013: Feasibility, Facilitators, and Barriers

Abstract:

Introduction

Practice facilitation involves trained individuals working with practice staff to conduct quality improvement activities and support delivery of evidence-based clinical services. We examined the feasibility of using practice facilitation to assist federally qualified health centers (FQHCs) to increase colorectal cancer screening rates in North Carolina.

Methods

The intervention consisted of 12 months of facilitation in 3 FQHCs. We conducted chart audits to obtain data on changes in documented recommendation for colorectal cancer screening and completed screening. Key informant interviews provided qualitative data on barriers to and facilitators of implementing office systems.

Results

Overall, the percentage of eligible patients with a documented colorectal cancer screening recommendation increased from 15% to 29% (P < .001). The percentage of patients up to date with colorectal cancer screening rose from 23% to 34% (P = .03). Key informants in all 3 clinics said the implementation support from the practice facilitator was critical for initiating or improving office systems and that modifying the electronic medical record was the biggest challenge and most time-consuming aspect of implementing office systems changes. Other barriers were staff turnover and reluctance on the part of local gastroenterology practices to perform free or low-cost diagnostic colonoscopies for uninsured or underinsured patients.

Conclusion

Practice facilitation is a feasible, acceptable, and promising approach for supporting universal colorectal cancer screening in FQHCs. A larger-scale study is warranted.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Integrated Delivery of Antiretroviral Treatment and Pre-exposure Prophylaxis to HIV-1–Serodiscordant Couples: A Prospective Implementation Study in Kenya and Uganda

Authors:

Jared M. Baeten, Renee Heffron, Lara Kidoguchi, Nelly R. Mugo, Elly Katabira, Elizabeth A. Bukusi, Stephen Asiimwe, Jessica E. Haberer, Jennifer Morton, Kenneth Ngure, Nulu Bulya, Josephine Odoyo, Edna Tindimwebwa, Craig Hendrix, Mark A. Marzinke, Norma C. Ware, Monique A. Wyatt, Susan Morrison, Harald Haugen, Andrew Mujugira, Deborah Donnell, Connie Celum, & the Partners Demonstration Project Team

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: August 2016

Read the full text in the open access journal PLOS Medicine

Abstract:

Background

Antiretroviral-based interventions for HIV-1 prevention, including antiretroviral therapy (ART) to reduce the infectiousness of HIV-1 infected persons and pre-exposure prophylaxis (PrEP) to reduce the susceptibility of HIV-1 uninfected persons, showed high efficacy for HIV-1 protection in randomized clinical trials. We conducted a prospective implementation study to understand the feasibility and effectiveness of these interventions in delivery settings.

Methods and Findings

Between November 5, 2012, and January 5, 2015, we enrolled and followed 1,013 heterosexual HIV-1-serodiscordant couples in Kenya and Uganda in a prospective implementation study. ART and PrEP were offered through a pragmatic strategy, with ART promoted for all couples and PrEP offered until 6 mo after ART initiation by the HIV-1 infected partner, permitting time to achieve virologic suppression. One thousand thirteen couples were enrolled, 78% of partnerships initiated ART, and 97% used PrEP, during a median follow-up of 0.9 years. Objective measures of adherence to both prevention strategies demonstrated high use (≥85%).

Given the low HIV-1 incidence observed in the study, an additional analysis was added to compare observed incidence to incidence estimated under a simulated counterfactual model constructed using data from a prior prospective study of HIV-1-serodiscordant couples. Counterfactual simulations predicted 39.7 HIV-1 infections would be expected in the population at an incidence of 5.2 per 100 person-years (95% CI 3.7–6.9). However, only two incident HIV-1 infections were observed, at an incidence of 0.2 per 100 person-years (95% CI 0.0–0.9, p < 0.0001 versus predicted). The use of a non-concurrent comparison of HIV-1 incidence is a potential limitation of this approach; however, it would not have been ethical to enroll a contemporaneous population not provided access to ART and PrEP.

Conclusions

Integrated delivery of time-limited PrEP until sustained ART use in African HIV-1-serodiscordant couples was feasible, demonstrated high uptake and adherence, and resulted in near elimination of HIV-1 transmission, with an observed HIV incidence of <0.5% per year compared to an expected incidence of >5% per year.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Preventing Chronic Disease

Abstract:

Introduction

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Medicine

Abstract:

Background

Methods and Findings

Conclusions

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Administration and Policy in Mental Health and Mental Health Services Research