UW First Author Archives - Page 19 of 23 - Implementation Science at UW

✪ Implementation strategy and cost of Mozambique’s HPV vaccine demonstration project

Abstract:

Background

Cost is an important determinant of health program implementation. In this study, we conducted a comprehensive evaluation of the implementation strategy of Mozambique’s school-based HPV vaccine demonstration project. We sought to estimate the total costs for the program, cost per fully immunized girl (FIG), and compute projections for the total cost of implementing a similar national level vaccination program.

Methods

We collected primary data through document review, participatory observation, and key informant interviews at all levels of the national health system and Ministry of Education. We used a combination of micro-costing methods—identification and measurement of resource quantities and valuation by application of unit costs, and gross costing—for consideration of resource bundles as they apply to the number of vaccinated girls. We extrapolated the cost per FIG to the HPV-vaccine-eligible population of Mozambique, to demonstrate the projected total annual cost for two scenarios of a similarly executed HPV vaccine program.

Results

The total cost of the Mozambique HPV vaccine demonstration project was $523,602. The mean cost per FIG was $72 (Credibility Intervals (CI): $62 - $83) in year one, $38 (CI: $37 - $40) in year two, and $54 CI: $49 - $61) for years one and two. The mean cost per FIG with the third HPV vaccine dose excluded from consideration was $60 (CI: $50 - $72) in year one, $38 (CI: $31 - $46) in year two, and $48 (CI: $42 - $55) for years one and two. The mean cost per FIG when only one HPV vaccine dose is considered was $30 (CI: $27 - $33)) in year one, $19 (CI: $15–$23) in year two, and $24 (CI: $22–$27) for both years. The projected annual cost of a two-and one-dose vaccine program targeting all 10-year-old girls in the country was $18.2 m (CI: $15.9 m - $20.7 m) and $9 m (CI: $8 m - $10 m) respectively.

Conclusion

National adaptation and scale-up of Mozambique’s school-based HPV vaccine strategy may result in substantial costs depending on dosing. For sustainability, stakeholders will need to negotiate vaccine price and achieve higher efficiency in startup activities and demand creation.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Use of Human-Centered Design to Improve Implementation of Evidence-Based Psychotherapies in Low-Resource Communities: Protocol for Studies Applying a Framework to Assess Usability 

Abstract:

Background

This paper presents the protocol for the National Institute of Mental Health (NIMH)–funded University of Washington’s ALACRITY (Advanced Laboratories for Accelerating the Reach and Impact of Treatments for Youth and Adults with Mental Illness) Center (UWAC), which uses human-centered design (HCD) methods to improve the implementation of evidence-based psychosocial interventions (EBPIs). We propose that usability—the degree to which interventions and implementation strategies can be used with ease, efficiency, effectiveness, and satisfaction—is a fundamental, yet poorly understood determinant of implementation.

Objective

We present a novel Discover, Design/Build, and Test (DDBT) framework to study usability as an implementation determinant. DDBT will be applied across Center projects to develop scalable and efficient implementation strategies (eg, training tools), modify existing EBPIs to enhance usability, and create usable and nonburdensome decision support tools for quality delivery of EBPIs.

Methods

Stakeholder participants will be implementation practitioners/intermediaries, mental health clinicians, and patients with mental illness in nonspecialty mental health settings in underresourced communities. Three preplanned projects and 12 pilot studies will employ the DDBT model to (1) identify usability challenges in implementing EBPIs in underresourced settings; (2) iteratively design solutions to overcome these challenges; and (3) compare the solution to the original version of the EPBI or implementation strategy on usability, quality of care, and patient-reported outcomes. The final products from the center will be a streamlined modification and redesign model that will improve the usability of EBPIs and implementation strategies (eg, tools to support EBPI education and decision making); a matrix of modification targets (ie, usability issues) that are both common and unique to EBPIs, strategies, settings, and patient populations; and a compilation of redesign strategies and the relative effectiveness of the redesigned solution compared to the original EBPI or strategy.

Results

The UWAC received institutional review board approval for the three separate studies in March 2018 and was funded in May 2018.

Conclusions

The outcomes from this center will inform the implementation of EBPIs by identifying cross-cutting features of EBPIs and implementation strategies that influence the use and acceptability of these interventions, actively involving stakeholder clinicians and implementation practitioners in the design of the EBPI modification or implementation strategy solution and identifying the impact of HCD-informed modifications and solutions on intervention effectiveness and quality.

Trial Registration

ClinicalTrials.gov NCT03515226 (https://clinicaltrials.gov/ct2/show/NCT03515226), NCT03514394 (https://clinicaltrials.gov/ct2/show/NCT03514394), and NCT03516513 (https://clinicaltrials.gov/ct2/show/NCT03516513).

International Registered Report Identifier (IRRID)

DERR1-10.2196/14990

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Organizational Readiness to Implement System Changes in an Alaskan Tribal Dental Care Organization

✪ Scaling-up the Systems Analysis and Improvement Approach for prevention of mother-to-child HIV transmission in Mozambique (SAIA-SCALE): a stepped-wedge cluster randomized trial

Abstract:

Background

The introduction of option B+ — rapid initiation of lifelong antiretroviral therapy regardless of disease status for HIV-infected pregnant and breastfeeding women — can dramatically reduce HIV transmission during pregnancy, birth, and breastfeeding. Despite significant investments to scale-up Option B+, results have been mixed, with high rates of loss to follow-up, sub-optimal viral suppression, continued pediatric HIV transmission, and HIV-associated maternal morbidity. The Systems Analysis and Improvement Approach (SAIA) cluster randomized trial demonstrated that a package of systems engineering tools improved flow through the prevention of mother-to-child HIV transmission (PMTCT) cascade. This five-step, facility-level intervention is designed to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). This protocol describes a novel model for SAIA delivery (SAIA-SCALE) led by district nurse supervisors (rather than research nurses), and evaluation procedures, to serve as a foundation for national scale-up.

Methods

The SAIA-SCALE stepped wedge trial includes three implementation waves, each 12 months in duration. Districts are the unit of assignment, with four districts randomly assigned per wave, covering all 12 districts in Manica province, Mozambique. In each district, the three highest volume health facilities will receive the SAIA-SCALE intervention (totaling 36 intervention facilities). The RE-AIM framework will guide SAIA-SCALE’s evaluation. Reach describes the proportion of clinics and population in Manica province reached, and sub-groups not reached. Effectiveness assesses impact on PMTCT process measures and patient-level outcomes. Adoption describes the proportion of districts/clinics adopting SAIA-SCALE, and determinants of adoption using the Organizational Readiness for Implementing Change (ORIC) tool. Implementation will identify SAIA-SCALE core elements and determinants of successful implementation using the Consolidated Framework for Implementation Research (CFIR). Maintenance describes the proportion of districts sustaining the intervention. We will also estimate the budget and program impact from the payer perspective for national scale-up.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by frontline health workers, and to identify low-cost, contextually appropriate PMTCT improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial is designed to test a model for national intervention scale-up.

Trial Registration

ClinicalTrials.gov NCT03425136 (registered 02/06/2018).

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Costs of implementing and sustaining enhanced collaborative care programs involving community partners

Abstract:

Background

Collaborative care is an evidence-based program for treating depression in primary care. We sought to expand this model by recruiting clinics interested in incorporating community partners (i.e., community-based organizations (CBO) and/or family members) in the care team. Seven sites implemented evidence-based collaborative care programs with community partners while collecting information on costs of implementing and sustaining programs.

Methods

Sites retrospectively collected data on planning and implementation costs with technical assistance from study researchers. Sites also prospectively collected cost of care activities over a 1-month period once the program was implemented to determine resources needed to sustain programs. Personnel salary costs were adjusted, adding 30% for benefits and 30% for administrative overhead.

Results

The programs implemented varied considerably in staffing, involvement of care partners, and allocation of costs. Total planning and implementation costs varied from $39,280 to $60,575. The largest implementation cost category involved workflow development and ranged from $16,325 to $31,375 with the highest costs in this category attributed to the most successful implementation among clinic-CBO programs. Following implementation, cost per patient over the 1-month period ranged from $154 to $544. Ongoing strategic decision-making and administrative costs, which were included in cost of care, ranged from $284 to $2328 for the month.

Conclusions

Sites implemented collaborative care through differing partnerships, staffing, and related costs. Costs to implement and sustain programs developed in partnership are often not collected but are crucial to understanding financial aspects of developing sustainable partnerships. Assessing such costs is feasible and can inform future partnership efforts.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Individual and organizational factors that affect implementation of evidence-based practices for children with autism in public schools: a cross-sectional observational study

Abstract:

Background

Children with autism receive most of their intervention services in public schools, but implementation of evidence-based practices (EBPs) for autism varies. Studies suggest that individual (attitudes) and organizational characteristics (implementation leadership and climate) may influence providers’ use of EBPs, but research is relatively limited in this area. This study examined individual and organizational factors associated with implementation of three EBPs—discrete trial training, pivotal response training, and visual schedules—for children with autism in special education classrooms in public elementary schools.

Methods

Participants included 67 autism support teachers and 85 other classroom staff from 52 public elementary schools in the northeastern United States. Participants reported their attitudes toward EBPs (e.g., intuitive appeal, willingness if required, openness, and divergence), implementation leadership and climate of their school, and the frequency with which they deliver each of three EBPs. Linear regression was used to estimate the association of attitudes about EBPs with organizational characteristics and intensity of EBP use. Demographic covariates with a bivariate association with EBP use significant at p < .20 were entered into the adjusted models.

Results

There were significant findings for only one EBP, discrete trial training. Teachers who reported higher perceived divergence (perceived difference of usual practice with academically developed or research-based practices) between EBPs and current practices used less discrete trial training (ƒ² = .18), and teachers who reported higher appeal (willingness to adopt EBPs given their intuitive appeal) of EBPs used more discrete trial training (ƒ² = .22). No organizational factors were significantly associated with implementation with any of the three EBPs.

Conclusions

Attitudes toward EBPs may affect teachers’ decisions to use EBPs; however, implementation leadership and climate did not predict EBP use. Future implementation efforts ought to consider the type of EBP and its fit within the context in terms of the EBP’s similarities to and differences from existing practices and programs in the setting. Implementation strategies that target individual attitudes about EBPs may be warranted in public schools.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Scaling-up PrEP Delivery in Sub-Saharan Africa: What Can We Learn from the Scale-up of ART?

Abstract:

Purpose of Review

Clinical trials have found that PrEP is highly effective in reducing risk of HIV acquisition across types of exposure, gender, PrEP regimens, and dosing schemes. Evidence is urgently needed to inform scale-up of PrEP to meet the ambitious WHO/UNAIDS prevention target of 3,000,000 individuals on PrEP by 2020.

Recent Findings

Successful models of delivering HIV services at scale evolved from years of formal research and programmatic evidence. These efforts produced lessons-learned relevant for scaling-up PrEP delivery, including the importance of streamlining laboratory tests, expanding prescription and management authority, differentiating medication access points, and reducing stigma and barriers of parental consent for PrEP uptake. Further research is especially needed in areas differentiating PrEP from ART delivery, including repeat HIV testing to ensure HIV negative status and defining and measuring prevention-effective adherence.

Summary

Evidence from 15 years of ART scale-up could immediately inform a public health approach to PrEP delivery.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation science and stigma reduction interventions in low- and middle-income countries: A systematic review

Abstract:

Background

Interventions to alleviate stigma are demonstrating effectiveness across a range of conditions, though few move beyond the pilot phase, especially in low- and middle-income countries (LMICs). Implementation science offers tools to study complex interventions, understand barriers to implementation, and generate evidence of affordability, scalability, and sustainability. Such evidence could be used to convince policy-makers and donors to invest in implementation. However, the utility of implementation research depends on its rigor and replicability. Our objectives were to systematically review implementation studies of health-related stigma reduction interventions in LMICs and critically assess the reporting of implementation outcomes and intervention descriptions.

Methods

PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of stigma reduction interventions in LMICs reporting at least one implementation outcome. Study- and intervention-level characteristics were abstracted. The quality of reporting of implementation outcomes was assessed using a five-item rubric, and the comprehensiveness of intervention description and specification was assessed using the 12-item Template for Intervention Description and Replication (TIDieR).

Results

A total of 35 eligible studies published between 2003 and 2017 were identified; of these, 20 (57%) used qualitative methods, 32 (91%) were type 1 hybrid effectiveness-implementation studies, and 29 (83%) were evaluations of once-off or pilot implementations. No studies adopted a formal theoretical framework for implementation research. Acceptability (20, 57%) and feasibility (14, 40%) were the most frequently reported implementation outcomes. The quality of reporting of implementation outcomes was low. The 35 studies evaluated 29 different interventions, of which 18 (62%) were implemented across sub-Saharan Africa, 20 (69%) focused on stigma related to HIV/AIDS, and 28 (97%) used information or education to reduce stigma. Intervention specification and description was uneven.

Conclusion

Implementation science could support the dissemination of stigma reduction interventions in LMICs, though usage to date has been limited. Theoretical frameworks and validated measures have not been used, key implementation outcomes like cost and sustainability have rarely been assessed, and intervention processes have not been presented in detail. Adapted frameworks, new measures, and increased LMIC-based implementation research capacity could promote the rigor of future stigma implementation research, helping the field deliver on the promise of stigma reduction interventions worldwide.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Integration of PrEP Services Into Routine Antenatal and Postnatal Care Experiences From an Implementation Program in Western Kenya

✪ Human papillomavirus vaccine delivery in Mozambique: Identification of implementation performance drivers using the Consolidated Framework for Implementation Research (CFIR)

Abstract:

Background

Since 2012 Gavi, the Vaccine Alliance has provided financial support for HPV vaccine introduction in low- and middle-income countries (LMICs); however, funding has been contingent on establishing a demonstration project prior to national scale-up, in order to gauge effectiveness of delivery models. Although by 2016, most beneficiary countries had completed demonstration projects, few have scaled up delivery nationwide. An important barrier was the dearth of published, country-specific implementation recommendations. We employed the Consolidated Framework for Implementation Research (CFIR) as a lens to identify drivers of heterogeneous (dissimilar) implementation performance during Mozambique’s 2-year demonstration project. Mozambique presents a compelling example as the country conducted demonstration projects in three different districts with extremely different economic resources and sociocultural practices.

Methods

A post implementation interpretive evaluation was undertaken. Forty key informant interviews were conducted with district and health facility immunization staff, Ministry of Education managers, and teachers across the three demonstration districts, central level informants from MOH, research institutes, and immunization program partners. We compared valence and strength ratings of CFIR constructs, across diverse implementation sites, so as to explain drivers and barriers to implementation success. Two researchers coded separately, and subsequent content analysis followed pre-defined CFIR construct themes.

Results

Eighteen constructs emerged from informants’ responses as implementation influencers. Adaptability was identified as an important construct because delivery modalities needed to meet differing levels of girls’ school attendance. Expanding outside of school-based delivery was needed in the low-performing district, making the vaccine delivery process more complex. Available resources varied across the three sites, with one site receiving direct Gavi support, while others received primarily state-based support. These latter sites reported considerably more implementation bottlenecks, in part related to weaker infrastructural characteristics and insufficient organizational incentives. Health workers’ beliefs in importance of vaccines and an organizational culture of making personal sacrifice for immunization program activities drove implementation performance. Advocacy and social mobilization through the right opinion leaders and champions generated higher demand.

Conclusion

HPV vaccination presents a pertinent opportunity for the prevention of cervical cancer in Mozambique, sub-Saharan Africa, and other LMICs. However, important barriers to broad-scale implementation exist. We recommend the development of local and global strategies to overcome barriers and facilitate its expanded utilization.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal BMC Public Health

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Research Protocols

Abstract:

Background

Objective

Methods

Results

Conclusions

Trial Registration

International Registered Report Identifier (IRRID)

Authors:

Read the open access full text in the subscription access journal JDR CLinical & Translational Research

More in Organizational Readiness for Change...

More by UW First Authors…

More in Organizational Assessment…

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial Registration

Authors:

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access from subscription journal Current HIV/AIDS Reports

Abstract:

Purpose of Review

Recent Findings

Summary

Authors:

✪ Open Access

Read the full text in the open access journal BMC Medicine

Abstract:

Background

Methods

Results

Conclusion

Authors:

Read the full text in the subscription access journal JAIDS – Journal of Acquired Immune Deficiency Syndromes

Authors:

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusion