UW Articles Archive - Page 26 of 60 - Implementation Science at UW

✪ Higher rates of mental health screening of adolescents recorded after provider training using simulated patients in a Kenyan HIV clinic: results of a pilot study

Abstract:

Background

Kenyan adolescent girls and young women (AGYW) experience a dual burden of HIV and common mental disorders (CMD). HIV clinics are a key entry point for AGYW in need of integrated CMD and HIV care; however, rates of screening and referral for CMDs are low. Our objective was to test an evidence-based provider training strategy, simulated patient encounters (SPEs), on CMD service delivery for AGYW in a Kenyan HIV clinic.

Methods

This pilot study was conducted in a public HIV clinic in Thika, Kenya from January to November 2021. The simulated patient encounter (SPE) implementation strategy included case script development from prior qualitative work, patient actor training, and a three-day SPE training including four standardized mock clinical encounters followed by quantitative surveys assessing provider competencies for each encounter. We abstracted medical record data related to HIV and CMDs such as HIV status, reason for visit, CMD screening test performed, and counselling or referral information. We conducted an interrupted time series analysis using abstracted HIV and CMD screening rates from AGYW ages 16–25 years visiting the clinic 7 months before and 3 months after SPE training. We used generalized linear models to assess changes in CMD screening rates after training.

Results

A total of 10 providers participated in the training. Competency ratings improved across four mock encounters (mean score from 8.1 to 13.7) between first and fourth encounters. We abstracted all medical records (n = 1,154) including from 888 (76%) AGYW seeking HIV treatment, 243 (21%) seeking prevention services, and 34 (3%) seeking other services. CMD screening rates increased immediately following training from 8 to 21% [relative risk (RR) = 2.57, 95% confidence interval (CI) = 1.34–4.90, p < 0.01]. The 3 months following the SPE training resulted in an 11% relative increase in CMD screening proportion compared to the 7 months pre-SPE (RR: 1.11, 95% CI: 1.04–1.17, p < 0.01). Finally, 1% of all pre-SPE screens resulted in referral versus 5% of post-SPE screens (p = 0.07).

Conclusions

The SPE model is a promising implementation strategy for improving HIV provider competencies and CMD service delivery for adolescents in HIV clinics. Future research is needed to explore effects on adolescent clinical outcomes in larger trials.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation determinants and strategies in integration of PrEP into maternal and child health and family planning services: experiences of frontline healthcare workers in Kenya

Abstract:

Background

Delivery of PrEP to adolescent girls and young women (AGYW) and to pregnant women through maternal and child health (MCH) and family planning (FP) clinics is scaling up in Kenya. Evaluation of implementation challenges and strategies is critical to optimize delivery.

Methods

We conducted focus group discussions (FGDs) with healthcare workers (HCWs) in MCH and FP clinics offering PrEP in a large implementation project in Kisumu, Kenya. Discussion guides were based on the Consolidated Framework for Implementation Research (CFIR). FGDs were audio recorded and transcribed. Directed content analysis was used to identify implementation challenges and strategies to overcome them.

Results

Fifty HCWs from 26 facilities participated in 8 FGDs. HCWs believed PrEP integration was appropriate because it met the needs of AGYW and pregnant women by providing a female-controlled prevention strategy and aligned with policy priorities of elimination of vertical HIV transmission. They were universally accepting of PrEP provision, especially through MCH clinics, noting the relative advantage of this approach because it: (1) enabled high coverage, (2) harmonized PrEP and MCH visits, and (3) minimized stigma compared to PrEP offered through HIV care clinics. However, HCWs noted implementation challenges affecting feasibility and adoption including: (1) increased workload and documentation burden amid workforce shortages, (2) insufficient health care worker knowledge (3) multiple implementing partners with competing priorities (4) drug and documentation form stockouts. HCWs employed various implementation strategies to overcome challenges, including task shifting from nurses to HIV testing providers, patient flow modifications (e.g., fast-tracking PrEP clients to reduce wait times), PrEP demand generation and myth clarification during health talks, provider education, dedicated PrEP delivery rooms, and coordination with adolescent-friendly services. Additional suggested strategies to improve PrEP integration included community education to increase broader PrEP awareness and enable shorter counseling sessions, and task-shifting data entry and client risk assessments.

Conclusions

HCWs were enthusiastic about the appropriateness and acceptability of integrating PrEP services into MCH and FP clinics but noted challenges to adoption and feasibility. Strategies to address challenges focused on improving provider time and space constraints, and increasing provider and client knowledge.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Promoting alcohol treatment engagement post-hospitalization with brief intervention, medications and CBT4CBT: protocol for a randomized clinical trial in a diverse patient population

Abstract:

Background

Alcohol use disorder (AUD) commonly causes hospitalization, particularly for individuals disproportionately impacted by structural racism and other forms of marginalization. The optimal approach for engaging hospitalized patients with AUD in treatment post-hospital discharge is unknown. We describe the rationale, aims, and protocol for Project ENHANCE (ENhancing Hospital-initiated Alcohol TreatmeNt to InCrease Engagement), a clinical trial testing increasingly intensive approaches using a hybrid type 1 effectiveness-implementation approach.

Methods

We are randomizing English and/or Spanish-speaking individuals with untreated AUD (n = 450) from a large, urban, academic hospital in New Haven, CT to: (1) Brief Negotiation Interview (with referral and telephone booster) alone (BNI), (2) BNI plus facilitated initiation of medications for alcohol use disorder (BNI + MAUD), or (3) BNI + MAUD + initiation of computer-based training for cognitive behavioral therapy (CBT4CBT, BNI + MAUD + CBT4CBT). Interventions are delivered by Health Promotion Advocates. The primary outcome is AUD treatment engagement 34 days post-hospital discharge. Secondary outcomes include AUD treatment engagement 90 days post-discharge and changes in self-reported alcohol use and phosphatidylethanol. Exploratory outcomes include health care utilization. We will explore whether the effectiveness of the interventions on AUD treatment engagement and alcohol use outcomes differ across and within racialized and ethnic groups, consistent with disproportionate impacts of AUD. Lastly, we will conduct an implementation-focused process evaluation, including individual-level collection and statistical comparisons between the three conditions of costs to providers and to patients, cost-effectiveness indices (effectiveness/cost ratios), and cost–benefit indices (benefit/cost ratios, net benefit [benefits minus costs). Graphs of individual- and group-level effectiveness x cost, and benefits x costs, will portray relationships between costs and effectiveness and between costs and benefits for the three conditions, in a manner that community representatives also should be able to understand and use.

Conclusions

Project ENHANCE is expected to generate novel findings to inform future hospital-based efforts to promote AUD treatment engagement among diverse patient populations, including those most impacted by AUD.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ The implementation and effectiveness of multi-tasked, paid community health workers on maternal and child health: A cluster-randomized pragmatic trial and qualitative process evaluation in Tanzania

Abstract:

Community health worker programs have proliferated worldwide based on evidence that they help prevent mortality, particularly among children. However, there is limited evidence from randomized studies on the processes and effectiveness of implementing community health worker programs through public health systems. This paper describes the results of a cluster-randomized pragmatic implementation trial (registration number ISRCTN96819844) and qualitative process evaluation of a community health worker program in Tanzania that was implemented from 2011–2015. Program effects on maternal, newborn and child health service utilization, childhood morbidity and sick childcare seeking were evaluated using difference-in-difference regression analysis with outcomes measured through pre- and post-intervention household surveys in intervention and comparison trial arms. A qualitative process evaluation was conducted between 2012 and 2014 and comprised of in-depth interviews and focus group discussions with community health workers, community members, facility-based health workers and staff of district health management teams. The community health worker program reduced incidence of illness and improved access to timely and appropriate curative care for children under five; however, there was no effect on facility-based maternal and newborn health service utilization. The positive outcomes occurred because of high levels of acceptability of community health workers within communities, as well as the durability of community health workers’ motivation and confidence. Implementation factors that generated these effects were the engagement of communities in program startup; the training, remuneration and supervision of the community health workers from the local health system and community. The lack of program effects on maternal and newborn health service utilization at facilities were attributed to lapses in the availability of needed care at facilities. Strategies that strengthen and align communities’ and health systems core capacities, and their ability to learn, adapt and integrate evidence-based interventions, are needed to maximize the health impact of community health workers.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Toward a more comprehensive understanding of organizational influences on implementation: the organization theory for implementation science framework

Abstract:

Introduction

Implementation is influenced by factors beyond individual clinical settings. Nevertheless, implementation research often focuses on factors related to individual providers and practices, potentially due to limitations of available frameworks. Extant frameworks do not adequately capture the myriad organizational influences on implementation. Organization theories capture diverse organizational influences but remain underused in implementation science. To advance their use among implementation scientists, we distilled 70 constructs from nine organization theories identified in our previous work into theoretical domains in the Organization Theory for Implementation Science (OTIS) framework.

Methods

The process of distilling organization theory constructs into domains involved concept mapping and iterative consensus-building. First, we recruited organization and implementation scientists to participate in an online concept mapping exercise in which they sorted organization theory constructs into domains representing similar theoretical concepts. Multidimensional scaling and hierarchical cluster analyses were used to produce visual representations (clusters) of the relationships among constructs in concept maps. Second, to interpret concept maps, we engaged members of the Cancer Prevention and Control Research Network (CPCRN) OTIS workgroup in consensus-building discussions.

Results

Twenty-four experts participated in concept mapping. Based on resulting construct groupings' coherence, OTIS workgroup members selected the 10-cluster solution (from options of 7–13 clusters) and then reorganized clusters in consensus-building discussions to increase coherence. This process yielded six final OTIS domains: organizational characteristics (e.g., size; age); governance and operations (e.g., organizational and social subsystems); tasks and processes (e.g., technology cycles; excess capacity); knowledge and learning (e.g., tacit knowledge; sense making); characteristics of a population of organizations (e.g., isomorphism; selection pressure); and interorganizational relationships (e.g., dominance; interdependence).

Discussion

Organizational influences on implementation are poorly understood, in part due to the limitations of extant frameworks. To improve understanding of organizational influences on implementation, we distilled 70 constructs from nine organization theories into six domains. Applications of the OTIS framework will enhance understanding of organizational influences on implementation, promote theory-driven strategies for organizational change, improve understanding of mechanisms underlying relationships between OTIS constructs and implementation, and allow for framework refinement. Next steps include testing the OTIS framework in implementation research and adapting it for use among policymakers and practitioners.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Healthcare worker perceived barriers and facilitators to implementing a tuberculosis preventive therapy program in rural South Africa: a content analysis using the consolidated framework for implementation research

Abstract:

Background

South African national tuberculosis (TB) guidelines, in accordance with the World Health Organization, recommend conducting routine household TB contact investigation with provision of TB preventive therapy (TPT) for those who qualify. However, implementation of TPT has been suboptimal in rural South Africa. We sought to identify barriers and facilitators to TB contact investigations and TPT management in rural Eastern Cape, South Africa, to inform the development of an implementation strategy to launch a comprehensive TB program.

Methods

We collected qualitative data through individual semi-structured interviews with 19 healthcare workers at a district hospital and four surrounding primary-care clinics referring to the hospital. The consolidated framework for implementation research (CFIR) was used to develop interview questions as well as guide deductive content analysis to determine potential drivers of implementation success or failure

Results

A total of 19 healthcare workers were interviewed. Identified common barriers included lack of provider knowledge regarding efficacy of TPT, lack of TPT documentation workflows for clinicians, and widespread community resource constraints. Facilitators identified included healthcare workers high interest to learn more about the effectiveness of TPT, interest in problem-solving logistical barriers in provision of comprehensive TB care (including TPT), and desire for clinic and nurse-led TB prevention efforts.

Conclusion

The use of the CFIR, a validated implementation determinants framework, provided a systematic approach to identify barriers and facilitators to TB household contact investigation, specifically the provision and management of TPT in this rural, high TB burden setting. Specific resources—time, trainings, and evidence—are necessary to ensure healthcare providers feel knowledgeable and competent about TPT prior to prescribing it more broadly. Tangible resources such as improved data systems coupled with political coordination and funding for TPT programming are essential for sustainability.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Participatory logic modeling in a multi-site initiative to advance implementation science

Abstract:

Background

Logic models map the short-term and long-term outcomes that are expected to occur with a program, and thus are an essential tool for evaluation. Funding agencies, especially in the United States (US), have encouraged the use of logic models among their grantees. They also use logic models to clarify expectations for their own funding initiatives. It is increasingly recognized that logic models should be developed through a participatory approach which allows input from those who carry out the program being evaluated. While there are many positive examples of participatory logic modeling, funders have generally not engaged grantees in developing the logic model associated with their own initiatives. This article describes an instance where a US funder of a multi-site initiative fully engaged the funded organizations in developing the initiative logic model. The focus of the case study is Implementation Science Centers in Cancer Control (ISC3), a multi-year initiative funded by the National Cancer Institute.

Methods

The reflective case study was collectively constructed by representatives of the seven centers funded under ISC3. Members of the Cross-Center Evaluation (CCE) Work Group jointly articulated the process through which the logic model was developed and refined. Individual Work Group members contributed descriptions of how their respective centers reviewed and used the logic model. Cross-cutting themes and lessons emerged through CCE Work Group meetings and the writing process.

Results

The initial logic model for ISC3 changed in significant ways as a result of the input of the funded groups. Authentic participation in the development of the logic model led to strong buy-in among the centers, as evidenced by their utilization. The centers shifted both their evaluation design and their programmatic strategy to better accommodate the expectations reflected in the initiative logic model.

Conclusions

The ISC3 case study demonstrates how participatory logic modeling can be mutually beneficial to funders, grantees and evaluators of multi-site initiatives. Funded groups have important insights about what is feasible and what will be required to achieve the initiative’s stated objectives. They can also help identify the contextual factors that either inhibit or facilitate success, which can then be incorporated into both the logic model and the evaluation design. In addition, when grantees co-develop the logic model, they have a better understanding and appreciation of the funder’s expectations and thus are better positioned to meet those expectations.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ ‘I understood the texting process well’ – Participant perspectives on usability and acceptability of SMS-based telehealth follow-up after voluntary medical male circumcision in South Africa

Abstract:

Background

Voluntary medical male circumcision (MC) is a biomedical HIV prevention method that requires post-operative follow-up for healing confirmation. Recent research found that a two-way texting (2wT) app providing SMS-based telehealth for MC patients was safe and reduced provider workload. We evaluated 2wT usability among MC clients in South Africa assigned the 2wT intervention within a larger randomized controlled trial (RCT) of 2wT safety and workload.

Methods

This quantitative usability study is within an RCT where 547 men used 2wT to interact with an MC provider via SMS. The sub-study involved the first 100 men assigned to 2wT who completed a usability survey 14 days after surgery. Acceptability was assessed through 2wT response rates of the 547 men. Regression models analyzed associations between age, wage, location, potential adverse events (AEs), and 2wT responses.

Results

Men assigned to 2wT found it safe, comfortable, and convenient, reporting time and cost savings. High response rates (88%) to daily messages indicated acceptability. Age, wage, and location didn't affect text responses or potential AEs.

Conclusion

2wT for post-MC follow-up was highly usable and acceptable, suggesting its viability as an alternative to in-person visits. It enhanced confidence in wound self-management. This SMS-based telehealth can enhance MC care quality and be adapted to similar contexts for independent healing support, particularly for men.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A machine learning approach to improve implementation monitoring of family-based preventive interventions in primary care

Abstract:

Background

Evidence-based parenting programs effectively prevent the onset and escalation of child and adolescent behavioral health problems. When programs have been taken to scale, declines in the quality of implementation diminish intervention effects. Gold-standard methods of implementation monitoring are cost-prohibitive and impractical in resource-scarce delivery systems. Technological developments using computational linguistics and machine learning offer an opportunity to assess fidelity in a low burden, timely, and comprehensive manner.

Methods

In this study, we test two natural language processing (NLP) methods [i.e., Term Frequency-Inverse Document Frequency (TF-IDF) and Bidirectional Encoder Representations from Transformers (BERT)] to assess the delivery of the Family Check-Up 4 Health (FCU4Health) program in a type 2 hybrid effectiveness-implementation trial conducted in primary care settings that serve primarily Latino families. We trained and evaluated models using 116 English and 81 Spanish-language transcripts from the 113 families who initiated FCU4Health services. We evaluated the concurrent validity of the TF-IDF and BERT models using observer ratings of program sessions using the COACH measure of competent adherence. Following the Implementation Cascade model, we assessed predictive validity using multiple indicators of parent engagement, which have been demonstrated to predict improvements in parenting and child outcomes.

Results

Both TF-IDF and BERT ratings were significantly associated with observer ratings and engagement outcomes. Using mean squared error, results demonstrated improvement over baseline for observer ratings from a range of 0.83–1.02 to 0.62–0.76, resulting in an average improvement of 24%. Similarly, results demonstrated improvement over baseline for parent engagement indicators from a range of 0.81–27.3 to 0.62–19.50, resulting in an approximate average improvement of 18%.

Conclusions

These results demonstrate the potential for NLP methods to assess implementation in evidence-based parenting programs delivered at scale. Future directions are presented.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Disruptions to and Innovations in HPV Vaccination Strategies within Safety-Net Healthcare Settings Resulting from the COVID-19 Pandemic

Abstract:

Abstract

The COVID-19 pandemic disrupted healthcare delivery within safety-net settings. Barriers to and facilitators of human papillomavirus (HPV) vaccination during the pandemic can inform future HPV vaccine strategies for underserved communities. Qualitative interviews (n = 52) between December 2020 and January 2022 in Los Angeles and New Jersey were conducted with providers, clinic leaders, clinic staff, advocates, payers, and policy-level representatives involved in the HPV vaccine process. Using the updated Consolidated Framework for Implementation Research we identified (1) outer setting barriers (i.e., vaccine hesitancy driven by social media, political views during the pandemic) and facilitators (e.g., partnerships); (2) inner setting clinic facilitators (i.e., motivation-driven clinic metrics, patient outreach, vaccine outreach events); (3) individual characteristics such as patient barriers (i.e., less likely to utilize clinic services during the pandemic and therefore, additional outreach to address missed vaccine doses are needed); (4) innovations in HPV vaccination strategies (i.e., clinic workflow changes to minimize exposure to COVID-19, leveraging new community partnerships (e.g., with local schools)); and (5) implementation strategies (i.e., multisectoral commitment to HPV goals). Pandemic setbacks forced safety-net settings to develop new vaccine approaches and partnerships that may translate to new implementation strategies for HPV vaccination within local contexts and communities.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Public Health

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Reproductive Health

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the journal Addiction Science and Clinical Practice

Abstract:

Background

Methods

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Introduction

Methods

Results

Discussion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Digital Health

Abstract:

Background

Methods

Results

Conclusion

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Healthcare

Abstract:

Abstract