Assessment Archives - Page 5 of 7 - Implementation Science at UW

✪ Adapting and testing measures of organizational context in primary care clinics in KwaZulu-Natal, South Africa

Abstract:

Background

Implementation science frameworks situate intervention implementation and sustainment within the context of the implementing organization and system. Aspects of organizational context such as leadership have been defined and measured largely within US health care settings characterized by decentralization and individual autonomy. The relevance of these constructs in other settings may be limited by differences like collectivist orientation, resource constraints, and hierarchical power structures. We aimed to adapt measures of organizational context in South African primary care clinics.

Methods

We convened a panel of South African experts in social science and HIV care delivery and presented implementation domains informed by existing frameworks and prior work in South Africa. Based on panel input, we selected contextual domains and adapted candidate items. We conducted cognitive interviews with 25 providers in KwaZulu-Natal Province to refine measures. We then conducted a cross-sectional survey of 16 clinics with 5–20 providers per clinic (N = 186). We assessed reliability using Cronbach’s alpha and calculated interrater agreement (awg) and intraclass correlation coefficient (ICC) at the clinic level. Within clinics with moderate agreement, we calculated correlation of clinic-level measures with each other and with hypothesized predictors – staff continuity and infrastructure – and a clinical outcome, patient retention on antiretroviral therapy.

Results

Panelists emphasized contextual factors; we therefore focused on elements of clinic leadership, stress, cohesion, and collective problem solving (critical consciousness). Cognitive interviews confirmed salience of the domains and improved item clarity. After excluding items related to leaders’ coordination abilities due to missingness and low agreement, all other scales demonstrated individual-level reliability and at least moderate interrater agreement in most facilities. ICC was low for most leadership measures and moderate for others. Measures tended to correlate within facility, and higher stress was significantly correlated with lower staff continuity. Organizational context was generally more positively rated in facilities that showed consistent agreement.

Conclusions

As theorized, organizational context is important in understanding program implementation within the South African health system. Most adapted measures show good reliability at individual and clinic levels. Additional revision of existing frameworks to suit this context and further testing in high and low performing clinics is warranted.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ How pharmacists would design and implement a community pharmacy-based colorectal cancer screening program

Abstract:

Background

Distributing CRC screening through pharmacies, a highly accessible health service, may create opportunities for more equitable access to CRC screening. However, providing CRC screening in a new context introduces a substantial implementation challenge.

Methods

We conducted 23 semi-structured interviews with community pharmacists practicing in Washington state and North Carolina about distributing fecal immunochemical tests (FIT) to patients in the pharmacy. The Consolidated Framework for Implementation Research (CFIR) was used to guide analysis.

Results

Pharmacists believed that delivering FITs was highly compatible with their environment, workflow, and scope of practice. While knowledge about FIT eligibility criteria varied, pharmacists felt comfortable screening patients. They identified standardized eligibility criteria, patient-facing educational materials, and continuing education as essential design features. Pharmacists proposed adapting existing pharmacy electronic health record systems for patient reminders/prompts to facilitate FIT completion. While pharmacists felt confident that they could discuss test results with patients, they also expressed a need for stronger communication and care coordination with primary care providers.

Discussion

When designing a pharmacy-based CRC screening program, pharmacists desired programmatic procedures to fit their current knowledge and context. Findings indicate that if proper attention is given to multi-level factors, FIT delivery can be extended to pharmacies.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Similarities and Differences Between Pragmatic Trials and Hybrid Effectiveness-Implementation Trials

✪ Acceptability of venue-based HIV testing and prevention interventions for men who have sex with transgender women and transgender women in Lima, Perú: a formative, qualitative study

Abstract:

Background

Despite being at elevated risk for HIV, men who have sex with transgender women (MSTW) are an overlooked population in the global HIV response. Venue-based HIV interventions have previously had success reaching other HIV priority populations, including transgender women (TW). Similar approaches could be applied for MSTW.

Objective

To evaluate the prospective acceptability of venue-based HIV testing and prevention interventions for MSTW and TW in Lima, Peru.

Methods

In this exploratory qualitative study, we conducted in-depth interviews (IDI) and focus group discussions (FGD) with three types of participants: MSTW (7 IDIs, 1 FGD), TW (1 FGD), and owners of social venues frequented by MSTW/TW in Lima (2 IDIs). We elicited participants’ attitudes and perceptions related to the following four hypothetical interventions delivered at social venues in Lima: rapid HIV testing; HIV self-test distribution; condom/lubricant distribution; and enrolment in a mobile app supporting HIV prevention. We performed a mixed deductive-inductive thematic analysis using the framework method, then applied the Theoretical Framework of Acceptability to classify the overall acceptability of each intervention.

Results

Condom/lubricant distribution and app-based HIV prevention information were highly acceptable among all participant types. The two HIV testing interventions had relatively lower acceptability; however, participants suggested this could be overcome if such interventions focused on ensuring discretion, providing access to healthcare professionals, and offering appropriate incentives.

Conclusions

Overall, MSTW and TW shared similar favourable attitudes towards venue-based HIV interventions. Venue-based outreach warrants further exploration as a strategy for engaging MSTW and TW in HIV prevention activities.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Acceptability and feasibility of policy implementation strategies for taxes earmarked for behavioral health services

Abstract:

Background

This study's aims are to: (1) Compare the acceptability and feasibility of five types of implementation strategies that could be deployed to increase the reach of evidence-based practices (EBPs) with revenue from policies that earmark taxes for behavioral health services, and (2) Illustrate how definitions of implementation strategies and measures of acceptability and feasibility can be used in policy-focused implementation science research.

Methods

Web-based surveys of public agency and community organization professionals involved with earmarked tax policy implementation were completed in 2022–2023 (N = 211, response rate = 24.9%). Respondents rated the acceptability and feasibility of five types of implementation strategies (dissemination, implementation process, integration, capacity-building, and scale-up). Aggregate acceptability and feasibility scores were calculated for each type of strategy (scoring range 4–20). Analyses of variance compared scores across strategies and between organizational actor types.

Findings

For acceptability, capacity-building strategies had the highest rating (M = 16.3, SD = 3.0), significantly higher than each of the four other strategies, p ≤ . 004), and scale-up strategies had the lowest rating (M = 15.6). For feasibility, dissemination strategies had the highest rating (M = 15.3, significantly higher than three of the other strategies, p ≤ .002) and scale-up strategies had the lowest rating (M = 14.4).

Conclusions

Capacity-building and dissemination strategies may be well-received and readily deployed by policy implementers to support EBPs implementation with revenue from taxes earmarked for behavioral health services. Adapting definitions of implementation strategies for policy-focused topics, and applying established measures of acceptability and feasibility to these strategies, demonstrates utility as an approach to advance research on policy-focused implementation strategies.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Centering School Leaders’ Expertise: Usability Evaluation of a Leadership-Focused Implementation Strategy to Support Tier 1 Programs in Schools

Abstract:

Although there are a growing number of implementation strategies to increase the adoption, fidelity, and sustainment of evidence-based practices (EBP), they are often complex and bulky, which can interfere with their widespread application. To address these challenges, the Helping Educational Leaders Mobilize Evidence (HELM) strategy was created as an adaptation of the evidence-based Leadership and Organizational Change for Implementation (LOCI) implementation strategy to enhance elementary school principals’ use of strategic implementation leadership to support the adoption and delivery of Tier 1 (i.e., universal social, emotional, and behavioral) EBP. In service of its iterative development, a human-centered design methodology was employed to increase the successful uptake and use of HELM. The Cognitive Walkthrough for Implementation Strategies (CWIS), a novel mixed-methods approach to evaluate implementation strategy usability, was applied to identify and test HELM strategy tasks of critical importance. A sample of 15 elementary school principals participated in group cognitive walkthrough testing as either school principal recipients or HELM coaches. Both user types rated the strategy as acceptable (principal M = 77.8, SD = 15.5; coach M = 87.5, SD = 7.9). Five usability issues were identified using a highly structured common usability issue framework and provided direction for the generation of redesign solutions to be incorporated in a subsequent version of the HELM strategy. The evaluation of the strategy’s usability improved its alignment with user needs, expectations, and contextual constraints, rendering a more usable strategy and broadly applicable information surrounding the development of psychosocial implementation strategies in real-world settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ The Effect of Stigma on Family Planning and HIV Pre-exposure Prophylaxis Decisions of Young Women Accessing Post-Abortion Care in Kenya

Abstract:

Adolescent girls and young women (AGYW) in Eastern and Southern Africa face parallel epidemics of unintended pregnancy and HIV. Their sexual health decisions are often dominated by intersecting stigmas. In an implementation science project integrating delivery of daily, oral pre-exposure prophylaxis (PrEP) for HIV prevention into 14 post-abortion care (PAC) clinics in Kenya, we enrolled a subset of PrEP initiating AGYW (aged 15 to 30 years) into a research cohort. Utilizing log binomial models, we estimated the effect of PrEP stigma on PrEP continuation (measured via self-report and urine assay for tenofovir) and abortion stigma on contraceptive initiation. Between April 2022 and February 2023, 401 AGYW were enrolled after initiating PrEP through their PAC provider, of which 120 (29.9%) initiated highly-effective contraception. Overall, abortion and PrEP stigmas were high in this cohort. Abortion stigma was more prevalent among those that were adolescents, unmarried, and reported social harm. Among 114 AGYW returning for the month 1 follow-up visit, 83.5% reported continuing PrEP and 52.5% had tenofovir detected. In this subset, higher levels of PrEP stigma were significantly associated with greater likelihood of PrEP adherence, but not PrEP continuation. For abortion stigma, greater scores in the subdomain of isolation were significantly associated with greater likelihood of initiating a highly-effective contraception, while greater scores in the subdomain of community condemnation were significantly associated with reduced likelihood of initiating a highly-effective contraception. Given the burden of stigma documented by our work, PAC settings are a pivotal space to integrate stigma-informed counseling and to empower young women to optimize contraceptive and PrEP decisions.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Drivers of success: improving implementation research tools for better health outcomes

Abstract:

A thorough examination of context, and how it influences implementation of evidence-based interventions, is a promising strategy for enhancing child survival initiatives. Spreading approaches that are identified as drivers of successful reduction in under-five mortality from ‘exemplar’ countries could be pivotal in leading to reductions in other settings facing stagnant mortality rates, in particular for low- and middle-income countries with high disease burden and insufficient programmatic capacity to effectively implement evidence-based interventions at scale. Yet there remains a lack of robust analytic methods to accurately assess mortality and describe the drivers of interventions’ implementation success at both national and subnational levels. The field of implementation science and its defining targets and tools is well positioned to address this knowledge gap by integrating qualitative and quantitative research methods into an adaptable evaluation framework that can be tailored to meet the specific needs across varying country contexts. These tools enhance the measurement of population health outcomes and provide crucial evidence on implementation barriers and facilitators that can inform policies that can be adjusted for diverse contexts. This commentary aims to emphasize the role of implementation research in understanding how exemplar countries achieved significant improvements in child survival and in identifying replicable lessons for other settings. Ultimately, all manuscripts underscore the relevance of implementation research in bolstering the reduction of under-five mortality.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Adaptation of a Tailored Lung Cancer Screening Decision Aid for People With HIV

Abstract:

Background

People with HIV are both at elevated risk of lung cancer and at high risk of multimorbidity, which makes shared decision-making (SDM) for lung cancer screening (LCS) in people with HIV complex. Currently no known tools have been adapted for SDM in people with HIV.

Research Question

Can an SDM decision aid be adapted to include HIV-specific measures with input from both people with HIV and their providers?

Study Design and Methods

This study used qualitative methods including focus groups of people with HIV and interviews with HIV care providers to adapt and iterate an SDM tool for people with HIV. Eligible participants were those with HIV enrolled in an HIV primary care clinic who met age and smoking eligibility criteria for LCS and HIV care providers at the clinic. Both the focus groups and interviews included semistructured discussions of SDM and decision aid elements for people with HIV. We used a framework-guided thematic analysis, mapping themes onto the Health Equity Implementation framework.

Results

Forty-three people with HIV participated in eight focus groups; 10 providers were interviewed. Key themes from patients included broad interest in adapting LCS SDM specifically for people with HIV, a preference for clear LCS recommendations, and the need for positive framing emphasizing survival. Providers were enthusiastic about personalized LCS risk assessments and point-of-care tools. Both patients and providers gave mixed views on the usefulness of HIV-specific risk measures in patient-facing tools. Themes were used to adapt a personalized and flexible SDM tool for LCS in people with HIV.

Interpretation

People with HIV and providers were enthusiastic about specific tools for SDM that are personalized and tailored for people with HIV, that make recommendations, and that inform LCS decision-making. Divergent views on presenting patient-facing quantitative risk assessments suggests that these elements could be optional but available for review. This tool may have usefulness in complex decision-making for LCS in this population and currently is being evaluated in a pilot prospective trial.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Fidelity-consistency and deliberateness of modifications in parenting programs

Abstract:

Background

Evidence-based interventions (EBIs) are frequently modified in practice. It is recommended that decisions to modify EBIs should be made deliberately to ensure fidelity-consistency, yet the relationship between fidelity-consistency and deliberateness is not well understood. This study aims to explore modifications in a sample of practitioners delivering evidence-based parenting programs (i.e., interventions to strengthen parent–child relationships, reduce harmful interactions, and improve child health and well-being). The study investigated three research questions: (1) What kind of modifications are made during the delivery of parenting programs? (2) To what degree are the identified modifications consistent with the core functions of each program? and (3) Is deliberateness associated with the fidelity-consistency of the identified modifications?

Methods

In total, 28 group leaders of five widely disseminated parenting programs in Sweden participated in five focus groups, and two participants from each group also participated in individual interviews (n = 10). A content analysis approach was used where the identification of modifications was directed by the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and then assessed for fidelity-consistency and four levels of deliberateness (universal, situational, conditional, and unintentional). Chi-square tests were performed to compare consistent and inconsistent modifications, and logistic regression was performed to explore whether deliberateness predicted consistency

Results

A total of 137 content modifications were identified, covering most of the content modification categories in FRAME. The most common were tailoring/tweaking/refining, adding elements, shortening/condensing, lengthening/extending, and integrating another treatment. Modifications were mostly fidelity-consistent but consistency varied greatly among categories. Furthermore, modifications made unintentionally or situationally were more likely to be fidelity-inconsistent

Conclusions

These results indicate that explicit consideration of modifications and their impact could be essential for sustaining the fidelity-consistent use of EBIs, even as such interventions are continuously modified.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Preventive Oncology & Epidemiology

Abstract:

Background

Methods

Results

Discussion

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Journal of General Internal Medicine

Authors:

✪ Open Access

Read the full text in the open access journal HIV Research & Clinical Practice

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Background

Methods

Findings

Conclusions

Authors:

✪ Open Access

Read the full text open access in the journal School Mental Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal AIDS and Behavior

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMC Pediatrics

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal CHEST Pulmonary

Abstract:

Background

Research Question

Study Design and Methods

Results

Interpretation

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions