Mixed-Methods Archives - Page 4 of 8 - Implementation Science at UW

✪ Health System–Provided Rideshare Is Safe and Addresses Barriers to Colonoscopy Completion

✪ Centering School Leaders’ Expertise: Usability Evaluation of a Leadership-Focused Implementation Strategy to Support Tier 1 Programs in Schools

Abstract:

Although there are a growing number of implementation strategies to increase the adoption, fidelity, and sustainment of evidence-based practices (EBP), they are often complex and bulky, which can interfere with their widespread application. To address these challenges, the Helping Educational Leaders Mobilize Evidence (HELM) strategy was created as an adaptation of the evidence-based Leadership and Organizational Change for Implementation (LOCI) implementation strategy to enhance elementary school principals’ use of strategic implementation leadership to support the adoption and delivery of Tier 1 (i.e., universal social, emotional, and behavioral) EBP. In service of its iterative development, a human-centered design methodology was employed to increase the successful uptake and use of HELM. The Cognitive Walkthrough for Implementation Strategies (CWIS), a novel mixed-methods approach to evaluate implementation strategy usability, was applied to identify and test HELM strategy tasks of critical importance. A sample of 15 elementary school principals participated in group cognitive walkthrough testing as either school principal recipients or HELM coaches. Both user types rated the strategy as acceptable (principal M = 77.8, SD = 15.5; coach M = 87.5, SD = 7.9). Five usability issues were identified using a highly structured common usability issue framework and provided direction for the generation of redesign solutions to be incorporated in a subsequent version of the HELM strategy. The evaluation of the strategy’s usability improved its alignment with user needs, expectations, and contextual constraints, rendering a more usable strategy and broadly applicable information surrounding the development of psychosocial implementation strategies in real-world settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Drivers of success: improving implementation research tools for better health outcomes

Abstract:

A thorough examination of context, and how it influences implementation of evidence-based interventions, is a promising strategy for enhancing child survival initiatives. Spreading approaches that are identified as drivers of successful reduction in under-five mortality from ‘exemplar’ countries could be pivotal in leading to reductions in other settings facing stagnant mortality rates, in particular for low- and middle-income countries with high disease burden and insufficient programmatic capacity to effectively implement evidence-based interventions at scale. Yet there remains a lack of robust analytic methods to accurately assess mortality and describe the drivers of interventions’ implementation success at both national and subnational levels. The field of implementation science and its defining targets and tools is well positioned to address this knowledge gap by integrating qualitative and quantitative research methods into an adaptable evaluation framework that can be tailored to meet the specific needs across varying country contexts. These tools enhance the measurement of population health outcomes and provide crucial evidence on implementation barriers and facilitators that can inform policies that can be adjusted for diverse contexts. This commentary aims to emphasize the role of implementation research in understanding how exemplar countries achieved significant improvements in child survival and in identifying replicable lessons for other settings. Ultimately, all manuscripts underscore the relevance of implementation research in bolstering the reduction of under-five mortality.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Inequity in the face of success: understanding geographic and wealth-based equity in success of facility-based delivery for under-5 mortality reduction in six countries

Abstract:

Background

Between 2000–2015, many low- and middle-income countries (LMICs) implemented evidence-based interventions (EBIs) known to reduce under-5 mortality (U5M). Even among LMICs successful in reducing U5M, this drop was unequal subnationally, with varying success in EBI implementation. Building on mixed methods multi-case studies of six LMICs (Bangladesh, Ethiopia, Nepal, Peru, Rwanda, and Senegal) leading in U5M reduction, we describe geographic and wealth-based equity in facility-based delivery (FBD), a critical EBI to reduce neonatal mortality which requires a trusted and functional health system, and compare the implementation strategies and contextual factors which influenced success or challenges within and across the countries.

Methods

To obtain equity gaps in FBD coverage and changes in absolute geographic and wealth-based equity between 2000–2015, we calculated the difference between the highest and lowest FBD coverage across subnational regions and in the FBD coverage between the richest and poorest wealth quintiles. We extracted and compared contextual factors and implementation strategies associated with reduced or remaining inequities from the country case studies.

Results

The absolute geographic and wealth-based equity gaps decreased in three countries, with greatest drops in Rwanda – decreasing from 50 to 5% across subnational regions and from 43 to 13% across wealth quintiles. The largest increases were seen in Bangladesh – from 10 to 32% across geography – and in Ethiopia – from 22 to 58% across wealth quintiles. Facilitators to reducing equity gaps across the six countries included leadership commitment and culture of data use; in some countries, community or maternal and child health insurance was also an important factor (Rwanda and Peru). Barriers across all the countries included geography, while country-specific barriers included low female empowerment subnationally (Bangladesh) and cultural beliefs (Ethiopia). Successful strategies included building on community health worker (CHW) programs, with country-specific adaptation of pre-existing CHW programs (Rwanda, Ethiopia, and Senegal) and cultural adaptation of delivery protocols (Peru). Reducing delivery costs was successful in Senegal, and partially successful in Nepal and Ethiopia.

Conclusion

Variable success in reducing inequity in FBD coverage among countries successful in reducing U5M underscores the importance of measuring not just coverage but also equity. Learning from FBD interventions shows the need to prioritize equity in access and uptake of EBIs for the poor and in remote areas by adapting the strategies to local context.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes, Katherine Ritchey

Abstract:

Introduction

Falls in nursing homes are a major cause for decreases in residents’ quality of life and overall health. This study aims to reduce resident falls by implementing the LOCK Falls Programme, an evidence-based quality improvement intervention. The LOCK Falls Programme involves the entire front-line care team in (1) focusing on evidence of positive change, (2) collecting data through systematic observation and (3) facilitating communication and coordination of care through the practice of front-line staff huddles.

Methods and analysis

The study protocol describes a mixed-methods, 4-year hybrid (type 2) effectiveness-implementation study in State Veterans Homes in the USA. The study uses a pragmatic stepped-wedge randomised trial design and employs relational coordination theory and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to guide implementation and evaluation. A total of eight State Veterans Homes will participate and data will be collected over an 18-month period. Administrative data inclusive of all clinical assessments and Minimum Data Set assessments for Veterans with a State Veterans Home admission or stay during the study period will be collected (8480 residents total). The primary outcome is a resident having any fall. The primary analysis will be a partial intention-to-treat analysis using the rate of participants experiencing any fall. A staff survey (n=1200) and qualitative interviews with residents (n=80) and staff (n=400) will also be conducted. This research seeks to systematically address known barriers to nursing home quality improvement efforts associated with reducing falls.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Acceptability and Utility of a Digital Group Intervention to Prevent Perinatal Depression in Youths via Interactive Maternal Group for Information and Emotional Support (IMAGINE): Pilot Cohort Study

Abstract:

Background

Perinatal depression (depression during pregnancy or the first year postpartum) affects 10%-25% of perinatal individuals, with a higher risk among youths aged <25 years. The Mothers and Babies Course (MB) is an evidence-based intervention for the prevention of perinatal depression, grounded in cognitive behavioral therapy, attachment theory, and psychoeducation.

Objective

We developed a digital adaptation of MB (Interactive Maternal Group for Information and Emotional Support [IMAGINE]) and evaluated it in a pre-post mixed methods pilot among young perinatal people in the United States

Methods

IMAGINE was a structured digital group of up to 7 participants, with scheduled MB content and open discussion for 12 weeks, facilitated by a social worker. Scheduled content included asynchronous SMS text messages, graphics, prerecorded videos, mood polls, and optional weekly synchronous video calls. Eligible participants were pregnant or ≤80 days postpartum, aged 16 to 24 years, had access to a smartphone, spoke English, and had a Patient Health Questionnaire score <10. Participants were recruited throughout the United States from August 2020 to January 2021 through paid social media ads, in-person outreach at clinics, and respondent-driven sampling. Participants completed quantitative questionnaires at enrollment and 3 months, and qualitative interviews at 3 months. We determined uptake, acceptability (by Acceptability of Intervention Measure score), and utility (by use of cognitive behavioral therapy skills). We compared depression symptoms (by Patient Health Questionnaire score), social support (by abbreviated Social Support Behavior score), and perceived stress (by Perceived Stress Score) between enrollment and follow-up by paired 2-tailed t test.

Results

Among 68 individuals who contacted this study, 22 were screened, 13 were eligible, and 10 enrolled, for an uptake of 76.9%. Furthermore, 4 (40%) participants were pregnant at enrollment. Participants had a median age of 17.9 (IQR 17.4-21.7) years, 6 (67%) identified as Black, 5 (56%) Latinx, and 6 (67%) using Medicaid health insurance. Further, 9 (90%) participants completed follow-up. Among these, the mean acceptability score was 4.3 out of 5 (SD 0.6) and all participants said they would recommend IMAGINE to a friend. Participants reported using a median of 7 of 11 skills (IQR 5-7 skills) at least half the days. We found no significant changes in depression symptoms, perceived stress, or social support. Qualitatively, participants reported one-to-one support from the facilitator, connection with other parents, and regular mood reflection were especially helpful aspects of the intervention. Additionally, participants reported that the intervention normalized their mental health challenges, improved their ability to manage their mood, and increased their openness to mental health care.

Conclusions

This pilot study provides promising evidence of the acceptability and utility of IMAGINE among perinatal youths. Our study’s small sample size did not detect changes in clinical outcomes; our findings suggest IMAGINE warrants larger-scale evaluation.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Participatory development of a target policy profile to support soil-transmitted helminth elimination

Abstract:

Introduction

Soil-transmitted helminths (STH) are parasitic worms that infect nearly a quarter of the world's population, particularly those living in communities without access to adequate water, sanitation, and housing. Emerging evidence suggests that it may be possible to interrupt transmission of STH by deworming individuals of all ages via community-wide MDA (cMDA), as opposed to only treating children and other focal populations. Transitioning from a policy of STH control to STH elimination in targeted areas would require a fundamental shift in STH policy and programming. This policy change would require updated guidance to support countries as they adapt their current approaches for STH surveillance, supply chain management, community mobilization, and core programmatic activities in pursuit of STH elimination. There is an opportunity to engage with key stakeholders, such as program implementers and implementation partners, to understand what evidence they need to confidently adopt a new policy guideline and to deliver guideline adherent management at scale.

Methods

We aimed to engage with STH stakeholders to develop a Target Policy Profile (TPoP), a single document that describes optimal characteristics and evidence requirements that STH stakeholders prioritized in future potential STH transmission interruption efforts. Steps in TPoP development included a scoping review and key informant interviews (KIIs), which were used to design a two-stage Delphi technique to identify and verify TPoP components.

Results

The scoping review resulted in 25 articles, and 8 experts participated in KII's. Twenty respondents completed the first Delphi survey and 10 respondents completed the second. This systematic effort resulted in a net of 3 key information domains (background/context, clinical considerations, and implementation considerations) encompassing 24 evidence categories (examples include evidence regarding safety and adverse events, implementation feasibility, or evidence dissemination). For each evidence category, STH stakeholders reviewed, endorsed, or revised a range of options for how the evidence could be presented.

Discussion

This information can be used by guideline committees or global policy makers prior to convening guideline advisory groups. The TPoP tool may also speed the process of stakeholder consensus building around guidelines, accelerating progress towards implementing evidence-based policy at scale.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Optimising scale-up for public health impact: a multimethod implementation science research protocol to improve infant health outcomes in Ethiopia

Abstract:

Introduction

Child mortality rates remain high in sub-Saharan Africa, including Ethiopia. We are conducting a cluster randomised control trial in the Gondar zone of the Amhara region to determine the impact of pairing Orthodox priests with community health workers, known locally as the Health Development Army (HDA), on newborns’ nutritional status, early illness identification and treatment, and vaccination completeness.

Ensuring intervention efficacy with scientific rigour is essential, but there are often delays in adopting evidence into policy and programmes. Here, we present a protocol for conducting parallel implementation research alongside an efficacy study to understand intervention implementability and scalability. This will help develop a scale-up strategy for effective elements of the intervention to ensure rapid implementation at scale.

Methods and Analysis

We will conduct a stakeholder analysis of key implementation stakeholders and readiness surveys to assess their readiness to scale up the intervention. We will conduct semistructured interviews and focus group discussions with stakeholders, including HDA members, health workers, Orthodox priests, and caregivers, to determine the core intervention elements that need to be scaled, barriers and facilitators to scaling up the intervention in diverse sociocultural settings, as well as the human and technical requirements for national and regional implementation. Finally, to determine the financial resources necessary for sustaining and scaling the intervention, we will conduct activity-based costing to estimate implementation costs from the provider’s perspective.

Ethics and dissemination

The study received approval from the University of Gondar Institutional Review Board (approval no: VP/RTT/05/1030/2022) and the University of Washington Human Subjects Division (approval no: STUDY00015369). Participants will consent to participate. Results will be disseminated through workshops with stakeholders, local community meetings, presentations at local and international conferences, and journal publications. The study will provide evidence for factors to consider in developing a scale-up strategy to integrate the intervention into routine health system practices.
^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation measurement in global mental health: Results from a modified Delphi panel and investigator survey

Abstract:

Limited guidance exists to support investigators in the choice, adaptation, validation and use of implementation measures for global mental health implementation research. Our objectives were to develop consensus on best practices for implementation measurement and identify strengths and opportunities in current practice. We convened seven expert panelists. Participants rated approaches to measure adaptation and validation according to appropriateness and feasibility. Follow-up interviews were conducted and a group discussion was held. We then surveyed investigators who have used quantitative implementation measures in global mental health implementation research. Participants described their use of implementation measures, including approaches to adaptation and validation, alongside challenges and opportunities. Panelists agreed that investigators could rely on evidence of a measure’s validity, reliability and dimensionality from similar contexts. Panelists did not reach consensus on whether to establish the pragmatic qualities of measures in novel settings. Survey respondents (n = 28) most commonly reported using the Consolidated Framework for Implementation Research Inner Setting Measures (n = 9) and the Program Assessment Sustainability Tool (n = 5). All reported adapting measures to their settings; only two reported validating their measures. These results will support guidance for implementation measurement in support of mental health services in diverse global settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text open access in the journal Clinical Gastroentorology and Hepatology

Authors:

✪ Open Access

Read the full text open access in the journal School Mental Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMC Pediatrics

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMC Pediatrics

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Methods and analysis

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Methods

Results

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Open

Abstract:

Introduction

Methods and Analysis

Ethics and dissemination

Authors:

✪ Open Access

Read the full text open access in the journal Cambridge Prisms: Global Mental Health

Abstract:

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal American Journal of Preventive Medicine