2019 Archives - Implementation Science at UW

Using implementation science to close the gap between the optimal and typical practice of quantitative methods in clinical science

Individual and organizational characteristics predicting intervention use for children with autism in schools

✪ Adapting and Operationalizing the RE-AIM Framework for Implementation Science in Environmental Health: Clean Fuel Cooking Programs in Low Resource Countries

Abstract:

Introduction

The use of models and frameworks to design and evaluate strategies to improve delivery of evidence-based interventions is a foundational element of implementation science. To date, however, evaluative implementation science frameworks such as Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) have not been widely employed to examine environmental health interventions. We take advantage of a unique opportunity to utilize and iteratively adapt the RE-AIM framework to guide NIH-funded case studies of the implementation of clean cooking fuel programs in eleven low- and middle-income countries.

Methods

We used existing literature and expert consultation to translate and iteratively adapt the RE-AIM framework across several stages of the NIH Clean Cooking Implementation Science case study project. Checklists and templates to guide investigators were developed at each stage.

Results

The RE-AIM framework facilitated identification of important emerging issues across this set of case studies, in particular highlighting the fact that data associated with certain important outcomes related to health and welfare are chronically lacking in clean fuel programs. Monitoring of these outcomes should be prioritized in future implementation efforts. As RE-AIM was not originally designed to evaluate household energy interventions, employing the framework required adaptation. Specific adaptations include the broadening of Effectiveness to encompass indicators of success toward any stated programmatic goal, and expansion of Adoption to include household-level uptake of technology.

Conclusions

The RE-AIM implementation science framework proved to be a useful organizing schema for 11 case studies of clean fuel cooking programs, in particular highlighting areas requiring emphasis in future research and evaluation efforts. The iterative approach used here to adapt an implementation science framework to a specific programmatic goal may be of value to other multi-country program efforts, such as those led by international development agencies. The checklists and templates developed for this project are publicly available for others to use and/or further modify.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Lay Counselor Perspectives of Providing a Child-Focused Mental Health Intervention for Children: Task-Shifting in the Education and Health Sectors in Kenya

Abstract:

The global mental health treatment gap has increasingly been addressed using task-shifting; however, very little research has focused on lay counselors’ perspectives on the acceptability, feasibility, and appropriateness of mental health interventions in specific government-supported sectors that might scale up and sustain mental health care for children and adolescents. In western Kenya, these sectors include Education and Health.

Data come from a large hybrid effectiveness-implementation study examining implementation practices and policies in either or both sectors that support successful implementation of a child-focused intervention, Trauma-focused Cognitive Behavioral Therapy (TF-CBT), for children and adolescents who had experienced parental death. We examined lay counselors’ self-report of acceptability, feasibility, and appropriateness of TF-CBT. Lay counselors were teachers (n = 30) from the Education sector and Community Health Volunteers (CHVs; n = 30) from the Health sector, who were part of Sequence 1 of a large stepped-wedge, cluster randomized trial.

Lay counselor self-report surveys included reflective and formative measurement of acceptability, feasibility, and appropriateness administered after lay counselors in both sectors had experience delivering the locally-adapted, group-based TF-CBT intervention. Descriptive statistics (means, standard deviations) were used to understand counselors’ perspectives stratified by sector.

Both teachers and CHVs endorsed high acceptability, feasibility, and appropriateness of TF-CBT, with lay counselors’ responses on items from the formative measures providing some insight into specific aspects of acceptability, feasibility, and appropriateness that may be important to consider when planning for implementation support.

These early findings suggest that both sectors may hold promise for task-shifting of mental health care for children and adolescents but also underline the importance of considering the multiple facets of these three implementation outcomes as well as lay counselor context (Education vs. Health).

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Factors Influencing Primary Care Providers’ Unneeded Lumbar Spine MRI Orders for Acute, Uncomplicated Low-Back Pain: a Qualitative Study

Abstract:

Background

Clinical practice guidelines suggest that magnetic resonance imaging of the lumbar spine (LS-MRI) is unneeded during the first 6 weeks of acute, uncomplicated low-back pain. Unneeded LS-MRIs do not improve patient outcomes, lead to unnecessary surgeries and procedures, and cost the US healthcare system about $300 million dollars per year. However, why primary care providers (PCPs) order unneeded LS-MRI for acute, uncomplicated low-back pain is poorly understood.

Objective

To characterize and explain the factors contributing to PCPs ordering unneeded LS-MRI for acute, uncomplicated low-back pain.

Design

Qualitative study using semi-structured interviews.

Participants

Veterans Affairs PCPs identified from administrative data as having high or low rates of guideline-concordant LS-MRI ordering in 2016.

Approach

Providers were interviewed about their use of LS-MRI for acute, uncomplicated low-back pain and factors contributing to their decision-making. Directed content analysis of transcripts was conducted to identify and compare environmental-, patient-, and provider-level factors contributing to unneeded LS-MRI.

Key Results

Fifty-five PCPs participated (8.6% response rate). Both low (n = 33) and high (n = 22) guideline-concordant providers reported that LS-MRIs were required for specialty care referrals, but they differed in how other environmental factors (stringency of radiology utilization review, management of patient travel burden, and time constraints) contributed to LS-MRI ordering patterns. Low- and high-guideline-concordant providers reported similar patient factors (beliefs in value of imaging and pressure on providers). However, provider groups differed in how provider-level factors (guideline familiarity and agreement, the extent to which they acquiesced to patients, and belief in the value of LS-MRI) contributed to LS-MRI ordering patterns.

Conclusions

Results describe how diverse environmental, patient, and provider factors contribute to unneeded LS-MRI for acute, uncomplicated low-back pain. Prior research using a single intervention to reduce unneeded LS-MRI has been ineffective. Results suggest that multifaceted de-implementation strategies may be required to reduce unneeded LS-MRI.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Time and Organizational Cost for Facilitating Implementation of Primary Care Mental Health Integration

Abstract:

Background

Integrating mental health services into primary care settings is complex and challenging. Although facilitation strategies have successfully supported implementation of primary care mental health integration and other complex innovations, we know little about the time required or its cost.

Objective

To examine the time and organizational cost of facilitating implementation of primary care mental health integration.

Design

Descriptive analysis.

Participants

One expert external facilitator and two internal regional facilitators who helped healthcare system stakeholders, e.g., leaders, managers, clinicians, and non-clinical staff, implement primary care mental health integration at eight clinics.

Intervention

Implementation facilitation tailored to the needs and resources of the setting and its stakeholders.

Main Measures

We documented facilitators’ and stakeholders’ time and types of activities using a structured spreadsheet collected from facilitators on a weekly basis. We obtained travel costs and salary information. We conducted descriptive analysis of time data and estimated organizational cost.

Key Results

The external facilitator devoted 263 h (0.09 FTE), including travel, across all 8 clinics over 28 months. Internal facilitator time varied across networks (1792 h versus 1169 h), as well as clinics. Stakeholder participation time was similar across networks (1280.6 versus 1363.4 person hours) but the number of stakeholders varied (133 versus 199 stakeholders). The organizational cost of providing implementation facilitation also varied across networks ($263,490 versus $258,127). Stakeholder participation accounted for 35% of the cost of facilitation activities in one network and 47% of the cost in the other.

Conclusions

Although facilitation can improve implementation of primary care mental health integration, it requires substantial organizational investments that may vary by site and implementation effort. Furthermore, the cost of using an external expert to transfer facilitation skills and build capacity for implementation efforts appears to be minimal.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Feasibility and acceptability of an iris biometric system for unique patient identification in routine HIV services in Kenya

Understanding the Organizational Implementation Context of Schools: A Qualitative Study of School District Administrators, Principals, and Teachers

✪ The power of peers: an effectiveness evaluation of a cluster-controlled trial of group antenatal care in rural Nepal

Abstract:

Background

Reducing the maternal mortality ratio to less than 70 per 100,000 live births globally is one of the Sustainable Development Goals. Approximately 830 women die from pregnancy- or childbirth-related complications every day. Almost 99% of these deaths occur in developing countries. Increasing antenatal care quality and completion, and institutional delivery are key strategies to reduce maternal mortality, however there are many implementation challenges in rural and resource-limited settings. In Nepal, 43% of deliveries do not take place in an institution and 31% of women have insufficient antenatal care. Context-specific and evidence-based strategies are needed to improve antenatal care completion and institutional birth. We present an assessment of effectiveness outcomes for an adaptation of a group antenatal care model delivered by community health workers and midwives in close collaboration with government staff in rural Nepal.

Methods

The study was conducted in Achham, Nepal, via a public private partnership between the Nepali non-profit, Nyaya Health Nepal, and the Ministry of Health and Population, with financial and technical assistance from the American non-profit, Possible. We implemented group antenatal care as a prospective non-randomized, cluster-controlled, type I hybrid effectiveness-implementation study in six village clusters. The implementation approach allowed for iterative improvement in design by making changes to improve the quality of the intervention. We evaluated effectiveness through a difference in difference analysis of institutional birth rates between groups prior to implementation of the intervention and 1 year after implementation. Additionally, we assessed the change in knowledge of key danger signs and the acceptability of the group model compared with individual visits in a nested cohort of women receiving home visit care and home visit care plus group antenatal care. Using a directed content and thematic approach, we analyzed qualitative interviews to identify major themes related to implementation.

Results

At baseline, there were 457 recently-delivered women in the six village clusters receiving home visit care and 214 in the seven village clusters receiving home visit care plus group antenatal care. At endline, there were 336 and 201, respectively. The difference in difference analysis did not show a significant change in institutional birth rates nor antenatal care visit completion rates between the groups. There was, however, a significant increase in both institutional birth and antenatal care completion in each group from baseline to endline. We enrolled a nested cohort of 52 participants receiving home visit care and 62 participants receiving home visit care plus group antenatal care. There was high acceptability of the group antenatal care intervention and home visit care, with no significant differences between groups. A significantly higher percentage of women who participated in group antenatal care found their visits to be ‘very enjoyable’ (83.9% vs 59.6%, p = 0.0056). In the nested cohort, knowledge of key danger signs during pregnancy significantly improved from baseline to endline in the intervention clusters only (2 to 31%, p < 0.001), while knowledge of key danger signs related to labor and childbirth, the postpartum period, and the newborn did not in either intervention or control groups. Qualitative analysis revealed that women found that the groups provided an opportunity for learning and discussion, and the groups were a source of social support and empowerment. They also reported an improvement in services available at their village clinic. Providers noted the importance of the community health workers in identifying pregnant women in the community and linking them to the village clinics. Challenges in birth planning were brought up by both participants and providers.

Conclusion

While there was no significant change in institutional birth and antenatal care completion at the population level between groups, there was an increase of these outcomes in both groups. This may be secondary to the primary importance of community health worker involvement in both of these groups. Knowledge of key pregnancy danger signs was significantly improved in the home visit plus group antenatal care cohort compared with the home visit care only group. This initial study of Nyaya Health Nepal’s adapted group care model demonstrates the potential for impacting women’s antenatal care experience and should be studied over a longer period as an intervention embedded within a community health worker program.

Trial registration

ClinicalTrials.gov Identifier: NCT02330887, registered 01/05/2015, retroactively registered.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Costs of implementing and sustaining enhanced collaborative care programs involving community partners

Abstract:

Background

Collaborative care is an evidence-based program for treating depression in primary care. We sought to expand this model by recruiting clinics interested in incorporating community partners (i.e., community-based organizations (CBO) and/or family members) in the care team. Seven sites implemented evidence-based collaborative care programs with community partners while collecting information on costs of implementing and sustaining programs.

Methods

Sites retrospectively collected data on planning and implementation costs with technical assistance from study researchers. Sites also prospectively collected cost of care activities over a 1-month period once the program was implemented to determine resources needed to sustain programs. Personnel salary costs were adjusted, adding 30% for benefits and 30% for administrative overhead.

Results

The programs implemented varied considerably in staffing, involvement of care partners, and allocation of costs. Total planning and implementation costs varied from $39,280 to $60,575. The largest implementation cost category involved workflow development and ranged from $16,325 to $31,375 with the highest costs in this category attributed to the most successful implementation among clinic-CBO programs. Following implementation, cost per patient over the 1-month period ranged from $154 to $544. Ongoing strategic decision-making and administrative costs, which were included in cost of care, ranged from $284 to $2328 for the month.

Conclusions

Sites implemented collaborative care through differing partnerships, staffing, and related costs. Costs to implement and sustain programs developed in partnership are often not collected but are crucial to understanding financial aspects of developing sustainable partnerships. Assessing such costs is feasible and can inform future partnership efforts.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access Journal of Abnormal Psychology

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Autism

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Introduction

Methods

Results

Conclusions

Authors:

Read the full text in the open access journal Frontiers in Psychiatry

Abstract:

Authors:

✪ Open Access

Read the full text, open access in the subscription Journal of General Internal Medicine

Abstract:

Background

Objective

Design

Participants

Approach

Key Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the subscription access Journal of General Internal Medicine

Abstract:

Background

Objective

Design

Participants

Intervention

Main Measures

Key Results

Conclusions

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access International Journal of Medical Informatics

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal School Mental Health

Authors:

✪ Open Access

Read the full text in the open access journal Reproductive Health

Abstract:

Background

Methods

Results

Conclusion

Trial registration

Authors:

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Results

Conclusions