Open Access Archives - Page 34 of 35 - Implementation Science at UW

✪ The impact of inter-organizational alignment (IOA) on implementation outcomes: evaluating unique and shared organizational influences in education sector mental health

Abstract:

Background

Integrated healthcare delivered by work groups in nontraditional service settings is increasingly common, yet contemporary implementation frameworks typically assume a single organization—or organizational unit—within which system-level processes influence service quality and implementation success. Recent implementation frameworks predict that inter-organizational alignment (i.e., similarity in values, characteristics, activities related to implementation across organizations) may facilitate the implementation of evidence-based practices (EBP), but few studies have evaluated this premise. This study’s aims examine the impact of overlapping organizational contexts by evaluating the implementation contexts of externally employed mental health clinicians working in schools—the most common integrated service delivery setting for children and adolescents. Aim 1 is to estimate the effects of unique intra-organizational implementation contexts and combined inter-organizational alignment on implementation outcomes. Aim 2 is to examine the underlying mechanisms through which inter-organizational alignment facilitates or hinders EBP implementation.

Methods/design

This study will conduct sequential, exploratory mixed-methods research to evaluate the intra- and inter-organizational implementation contexts of schools and the external community-based organizations that most often employ school-based mental health clinicians, as they relate to mental health EBP implementation. Aim 1 will involve quantitative surveys with school-based, externally-employed mental health clinicians, their supervisors, and proximal school-employed staff (total n = 120 participants) to estimate the effects of each organization’s general and implementation-specific organizational factors (e.g., climate, leadership) on implementation outcomes (fidelity, acceptability, appropriateness) and assess the moderating role of the degree of clinician embeddedness in the school setting. Aim 2 will explore the mechanisms through which inter-organizational alignment influences implementation outcomes by presenting the results of Aim 1 surveys to school-based clinicians (n = 30) and conducting semi-structured qualitative interviews. Qualitative data will be evaluated using an integrative inductive and deductive approach.

Discussion

The study aims are expected to identify intra- and inter-organizational constructs that are most instrumental to EBP implementation success in school-based integrated care settings and illuminate mechanisms that may account for the influence of inter-organizational alignment. In addition to improving school-based mental health, these findings will spur future implementation science that considers the relationships across organizations and optimize the capacity of implementation science to guide practice in increasingly complex systems of care.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health

Abstract:

Background

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials.

Methods

Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and techniques attributable to the supervisor and clinician levels.

Results

Interrater reliability among coders was excellent. EBT cases averaged 12.4 min of supervision per session. Intensity of coverage for EBT content varied, with some discussed frequently at medium or high intensity (exposure) and others infrequently discussed or discussed only at low intensity (behavior management; assigning/reviewing client homework). Other than fidelity assessment, supervision techniques common in treatment trials (e.g., reviewing actual practice, behavioral rehearsal) were used rarely or primarily at low intensity. In general, EBT content clustered more at the clinician level; different techniques clustered at either the clinician or supervisor level.

Conclusions

Workplace-based clinical supervision may be a feasible implementation strategy for supporting EBT implementation, yet it differs from supervision in treatment trials. Time allotted per case is limited, compressing time for EBT coverage. Techniques that involve observation of clinician skills are rarely used. Workplace-based supervision content appears to be tailored to individual clinicians and driven to some degree by the individual supervisor. Our findings point to areas for intervention to enhance the potential of workplace-based supervision for implementation effectiveness.

Trial registration

NCT01800266, Clinical Trials, Retrospectively Registered (for this descriptive study; registration prior to any intervention [part of phase II RCT, this manuscript is only phase I descriptive results])
^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Evaluating the sustainability, scalability, and replicability of an STH transmission interruption intervention: The DeWorm3 implementation science protocol

Authors:

Arianna Rubin Means, Sitara S. R. Ajjampur, Robin Bailey, Katya Galactionova, Marie-Claire Gwayi-Chore, Katherine Halliday, Moudachirou Ibikounle, Sanjay Juvekar, Khumbo Kalua, Gagandeep Kang, Pallavi Lele, Adrian J. F. Luty, Rachel Pullan, Rajiv Sarkar, Fabian Schär, Fabrizio Tediosi, Bryan J. Weiner, Elodie Yard, & Judd Walson, on behalf of the DeWorm3 Implementation Science Team

^{University of Washington affiliated authors are displayed in bold.}

✪ Open Access

Published: January 2018

Read the full text in the open access journal PLOS: Neglected Tropical Diseases

✪ An individually tailored family-centered intervention for pediatric obesity in primary care: study protocol of a randomized type II hybrid effectiveness–implementation trial (Raising Healthy Children study)

Abstract:

Background

Pediatric obesity is a multi-faceted public health concern that can lead to cardiovascular diseases, cancers, and early mortality. Small changes in diet, physical activity, or BMI can significantly reduce the possibility of developing cardiometabolic risk factors. Family-based behavioral interventions are an underutilized, evidence-based approach that have been found to significantly prevent excess weight gain and obesity in children and adolescents. Poor program availability, low participation rates, and non-adherence are noted barriers to positive outcomes. Effective interventions for pediatric obesity in primary care are hampered by low family functioning, motivation, and adherence to recommendations.

Methods

This (type II) hybrid effectiveness–implementation randomized trial tests the Family Check-Up 4 Health (FCU4Health) program, which was designed to target health behavior change in children by improving family management practices and parenting skills, with the goal of preventing obesity and excess weight gain. The FCU4Health is assessment driven to tailor services and increase parent motivation. A sample of 350 families with children aged 6 to 12 years who are identified as overweight or obese (BMI ≥ 85th percentile for age and gender) will be enrolled at three primary care clinics [two Federally Qualified Healthcare Centers (FQHCs) and a children’s hospital]. All clinics serve predominantly Medicaid patients and a large ethnic minority population, including Latinos, African Americans, and American Indians who face disparities in obesity, cardiometabolic risk, and access to care. The FCU4Health will be coordinated with usual care, using two different delivery strategies: an embedded approach for the two FQHCs and a referral model for the hospital-based clinic. To assess program effectiveness (BMI, body composition, child health behaviors, parenting, and utilization of support services) and implementation outcomes (such outcomes as acceptability, adoption, feasibility, appropriateness, fidelity, and cost), we use a multi-method and multi-informant assessment strategy including electronic health record data, behavioral observation, questionnaires, interviews, and cost capture methods.

Discussion

This study has the potential to prevent excess weight gain, obesity, and health disparities in children by establishing the effectiveness of the FCU4Health and collecting information critical for healthcare decision makers to support sustainable implementation of family-based programs in primary care.

Trial registration

NCT03013309 ClinicalTrials.gov
^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Sexually transmitted infections in the era of antiretroviral-based HIV prevention: Priorities for discovery research, implementation science, and community involvement

Excerpt:

Summary points

Persons living with HIV who achieve sustained viral suppression with antiretroviral therapy can avoid sexual transmission of HIV without using condoms.
Similarly, pre-exposure prophylaxis with tenofovir-emtricitabine in HIV-uninfected persons is highly effective.
With this background, rates of sexually transmitted infections are increasing in some HIV-infected populations, and in some at risk for HIV acquisition.
The implications require reassessment of the alignment and prioritization of HIV research funding, public health policy, and community engagement.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Data-driven quality improvement in low-and middle-income country health systems: lessons from seven years of implementation experience across Mozambique, Rwanda, and Zambia

Abstract:

Background

Well-functioning health systems need to utilize data at all levels, from the provider, to local and national-level decision makers, in order to make evidence-based and needed adjustments to improve the quality of care provided. Over the last 7 years, the Doris Duke Charitable Foundation’s African Health Initiative funded health systems strengthening projects at the facility, district, and/or provincial level to improve population health. Increasing data-driven decision making was a common strategy in Mozambique, Rwanda and Zambia. This paper describes the similar and divergent approaches to increase data-driven quality of care improvements (QI) and implementation challenge and opportunities encountered in these three countries.

Methods

Eight semi-structured in-depth interviews (IDIs) were administered to program staff working in each country. IDIs for this paper included principal investigators of each project, key program implementers (medically-trained support staff, data managers and statisticians, and country directors), as well as Ministry of Health counterparts. IDI data were collected through field notes; interviews were not audio recorded. Data were analyzed using thematic analysis but no systematic coding was conducted. IDIs were supplemented through donor report abstractions, a structured questionnaire, one-on-one phone calls, and email exchanges with country program leaders to clarify and expand on key themes emerging from IDIs.

Results

Project successes ranged from over 450 collaborative action-plans developed, implemented, and evaluated in Mozambique, to an increase from <10% to >80% of basic clinical protocols followed in intervention facilities in rural Zambia, and a shift from a lack of awareness of health data among health system staff to collaborative ownership of data and using data to drive change in Rwanda.

Conclusion

Based on common successes across the country experiences, we recommend future data-driven QI interventions begin with data quality assessments to promote that rapid health system improvement is possible, ensure confidence in available data, serve as the first step in data-driven targeted improvements, and improve staff data analysis and visualization skills. Explicit Ministry of Health collaborative engagement can ensure performance review is collaborative and internally-driven rather than viewed as an external “audit.”

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Health system strengthening: a qualitative evaluation of implementation experience and lessons learned across five African countries

Abstract:

Background

Achieving the United Nations Sustainable Development Goals in sub-Saharan Africa will require substantial improvements in the coverage and performance of primary health care delivery systems. Projects supported by the Doris Duke Charitable Foundation’s (DDCF) African Health Initiative (AHI) created public-private-academic and community partnerships in five African countries to implement and evaluate district-level health system strengthening interventions. In this study, we captured common implementation experiences and lessons learned to understand core elements of successful health systems interventions.

Methods

We used qualitative data from key informant interviews and annual progress reports from the five Population Health Implementation and Training (PHIT) partnership projects funded through AHI in Ghana, Mozambique, Rwanda, Tanzania, and Zambia.

Results

Four major overarching lessons were highlighted. First, variety and inclusiveness of concerned key players (public, academic and private) are necessary to address complex health system issues at all levels. Second, a learning culture that promotes evidence creation and ability to efficiently adapt were key in order to meet changing contextual needs. Third, inclusion of strong implementation science tools and strategies allowed informed and measured learning processes and efficient dissemination of best practices. Fourth, five to seven years was the minimum time frame necessary to effectively implement complex health system strengthening interventions and generate the evidence base needed to advocate for sustainable change for the PHIT partnership projects.

Conclusion

The AHI experience has raised remaining, if not overlooked, challenges and potential solutions to address complex health systems strengthening intervention designs and implementation issues, while aiming to measurably accomplish sustainable positive change in dynamic, learning, and varied contexts.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Measuring health systems strength and its impact: experiences from the African Health Initiative

Abstract:

Background

Health systems are essential platforms for accessible, quality health services, and population health improvements. Global health initiatives have dramatically increased health resources; however, funding to strengthen health systems has not increased commensurately, partially due to concerns about health system complexity and evidence gaps demonstrating health outcome improvements. In 2009, the African Health Initiative of the Doris Duke Charitable Foundation began supporting Population Health Implementation and Training Partnership projects in five sub-Saharan African countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia) to catalyze significant advances in strengthening health systems. This manuscript reflects on the experience of establishing an evaluation framework to measure health systems strength, and associate measures with health outcomes, as part of this Initiative.

Methods

Using the World Health Organization’s health systems building block framework, the Partnerships present novel approaches to measure health systems building blocks and summarize data across and within building blocks to facilitate analytic procedures. Three Partnerships developed summary measures spanning the building blocks using principal component analysis (Ghana and Tanzania) or the balanced scorecard (Zambia). Other Partnerships developed summary measures to simplify multiple indicators within individual building blocks, including health information systems (Mozambique), and service delivery (Rwanda). At the end of the project intervention period, one to two key informants from each Partnership’s leadership team were asked to list – in rank order – the importance of the six building blocks in relation to their intervention.

Results

Though there were differences across Partnerships, service delivery and information systems were reported to be the most common focus of interventions, followed by health workforce and leadership and governance. Medical products, vaccines and technologies, and health financing, were the building blocks reported to be of lower focus.

Conclusion

The African Health Initiative experience furthers the science of evaluation for health systems strengthening, highlighting areas for further methodological development – including the development of valid, feasible measures sensitive to interventions in multiple contexts (particularly in leadership and governance) and describing interactions across building blocks; in developing summary statistics to facilitate testing intervention effects on health systems and associations with health status; and designing appropriate analytic models for complex, multi-level open health systems.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Tackling the hard problems: Implementation experience and lessons learned in newborn health from the African Health Initiative

Abstract:

Background

The Doris Duke Charitable Foundation’s African Health Initiative supported the implementation of Population Health Implementation and Training (PHIT) Partnership health system strengthening interventions in designated areas of five countries: Ghana, Mozambique, Rwanda, Tanzania, and Zambia. All PHIT programs included health system strengthening interventions with child health outcomes from the outset, but all increasingly recognized the need to increase focus to improve health and outcomes in the first month of life. This paper uses a case study approach to describe interventions implemented in newborn health, compare approaches, and identify lessons learned across the programs’ collective implementation experience.

Methods

Case studies were built using quantitative and qualitative methods, applying the World Health Organization Health Systems Strengthening Framework, and maternal, newborn and child health continuum of care framework. We identified the following five primary themes in health systems strengthening intervention strategies used to target improvement in newborn health, which were incorporated by all PHIT projects with varying results: health service delivery at the community level (Tanzania), combining community and health facility level interventions (Zambia), participatory information feedback and clinical training (Ghana), performance review and enhancement (Mozambique), and integrated clinical and system-level improvement (Rwanda), and used individual case studies to illustrate each of these themes.

Results

Tanzania and Zambia included significant community-based components, including mobilization and sensitization for increased uptake of essential services, while Ghana, Mozambique, and Rwanda focused more efforts on improving the quality of services delivered once a patient enters a health facility. All countries included aspects that improved communication across levels of the health system, whether through district-wide data sharing and peer learning networks in Mozambique and Rwanda, or improved referral processes and systems in Tanzania, Zambia, and Ghana.

Conclusion

Key lessons learned include the importance of focusing intervention components on addressing drivers of neonatal mortality across the maternal and newborn care continuum at all levels of the health system, matching efforts to improve service utilization with provision of high quality facility-based services, and the critical role of leadership to catalyze improvements in newborn health.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Psychometric assessment of three newly developed implementation outcome measures

Abstract:

Background

Implementation outcome measures are essential for monitoring and evaluating the success of implementation efforts. Yet, currently available measures lack conceptual clarity and have largely unknown reliability and validity. This study developed and psychometrically assessed three new measures: the Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).

Methods

Thirty-six implementation scientists and 27 mental health professionals assigned 31 items to the constructs and rated their confidence in their assignments. The Wilcoxon one-sample signed rank test was used to assess substantive and discriminant content validity. Exploratory and confirmatory factor analysis (EFA and CFA) and Cronbach alphas were used to assess the validity of the conceptual model. Three hundred twenty-six mental health counselors read one of six randomly assigned vignettes depicting a therapist contemplating adopting an evidence-based practice (EBP). Participants used 15 items to rate the therapist’s perceptions of the acceptability, appropriateness, and feasibility of adopting the EBP. CFA and Cronbach alphas were used to refine the scales, assess structural validity, and assess reliability. Analysis of variance (ANOVA) was used to assess known-groups validity. Finally, half of the counselors were randomly assigned to receive the same vignette and the other half the opposite vignette; and all were asked to re-rate acceptability, appropriateness, and feasibility. Pearson correlation coefficients were used to assess test-retest reliability and linear regression to assess sensitivity to change.

Results

All but five items exhibited substantive and discriminant content validity. A trimmed CFA with five items per construct exhibited acceptable model fit (CFI = 0.98, RMSEA = 0.08) and high factor loadings (0.79 to 0.94). The alphas for 5-item scales were between 0.87 and 0.89. Scale refinement based on measure-specific CFAs and Cronbach alphas using vignette data produced 4-item scales (α’s from 0.85 to 0.91). A three-factor CFA exhibited acceptable fit (CFI = 0.96, RMSEA = 0.08) and high factor loadings (0.75 to 0.89), indicating structural validity. ANOVA showed significant main effects, indicating known-groups validity. Test-retest reliability coefficients ranged from 0.73 to 0.88. Regression analysis indicated each measure was sensitive to change in both directions.

Conclusions

The AIM, IAM, and FIM demonstrate promising psychometric properties. Predictive validity assessment is planned.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods/design

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal PLOS: Neglected Tropical Diseases

Abstract:

[SECTION NAME]

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Medicine

Excerpt:

Summary points

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions