Open Access Archives - Page 22 of 35 - Implementation Science at UW

✪ Monitoring and evaluating the implementation of essential packages of health services

Abstract:

Essential packages of health services (EPHS) are a critical tool for achieving universal health coverage, especially in low-income and lower middle-income countries. However, there is a lack of guidance and standards for monitoring and evaluation (M&E) of EPHS implementation. This paper is the final in a series of papers reviewing experiences using evidence from the Disease Control Priorities, third edition publications in EPHS reforms in seven countries. We assess current approaches to EPHS M&E, including case studies of M&E approaches in Ethiopia and Pakistan. We propose a step-by-step process for developing a national EPHS M&E framework. Such a framework would start with a theory of change that links to the specific health system reforms the EPHS is trying to accomplish, including explicit statements about the ‘what’ and ‘for whom’ of M&E efforts. Monitoring frameworks need to consider the additional demands that could be placed on weak and already overstretched data systems, and they must ensure that processes are put in place to act quickly on emergent implementation challenges. Evaluation frameworks could learn from the field of implementation science; for example, by adapting the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to policy implementation. While each country will need to develop its own locally relevant M&E indicators, we encourage all countries to include a set of core indicators that are aligned with the Sustainable Development Goal 3 targets and indicators. Our paper concludes with a call to reprioritise M&E more generally and to use the EPHS process as an opportunity for strengthening national health information systems. We call for an international learning network on EPHS M&E to generate new evidence and exchange best practices.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Advancing Adolescent HIV Prevention and Care Through Implementation Science: An Agenda for Combating the Global AIDS Epidemic in Sub-Saharan Africa

Abstract:

AIDS continues to be a major driver of adolescent mortality in Sub-Saharan Africa. Despite evidence of efficacy in this population, many efforts to address adolescent HIV have had limited impact across the region because of difficulty with implementation. The field of implementation science holds promise for addressing these challenges. The Fogarty-led Adolescent HIV Prevention and Treatment Implementation Science Alliance (AHISA) creates a platform for bidirectional learning between researchers and the users of research evidence that promotes the use of implementation science to strengthen adolescent HIV prevention and care across Africa. The unique contributions of AHISA are reflected in this supplement’s articles which represent the collective learning of the Alliance; illustrate the value of implementation science in the context of adolescent HIV; and identify critical research gaps that should be addressed by implementation science in the future.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Management of Depression in Chronic Care Patients Using a Task-Sharing Approach in a Real-World Primary Health Care Setting in South Africa: Outcomes of a Cohort Study

Abstract:

Depressive symptoms are common in South African primary care patients with chronic medical conditions, but are usually unrecognised and untreated. This study evaluated an integrated, task-sharing collaborative approach to management of depression comorbid with chronic diseases in primary health care (PHC) patients in a real-world setting. Existing HIV clinic counsellors provided a manualised depression counselling intervention with stepped-up referral pathways to PHC doctors for initiation of anti-depressant medication and/ or referral to specialist mental health services. Using a comparative group cohort design, adult PHC patients in 10 PHC facilities were screened with the Patient Health Questionnaire-9 with those scoring above the validated cut-off enrolled. PHC nurses independently assessed, diagnosed and referred patients. Referral for treatment was independently associated with substantial improvements in depression symptoms three months later. The study confirms the viability of task-shared stepped-up collaborative care for depression treatment using co-located counselling in underserved real-world PHC settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementing Mailed Colorectal Cancer Fecal Screening Tests in Real-World Primary Care Settings: Promising Implementation Practices and Opportunities for Improvement

Abstract:

Colorectal cancer (CRC) screening reduces morbidity and mortality, but screening rates in the USA remain suboptimal. The Colorectal Cancer Control Program (CRCCP) was established in 2009 to increase screening among groups disproportionately affected. The CRCCP utilizes implementation science to support health system change as a strategy to reduce disparities in CRC screening by directing resources to primary care clinics to implement evidence-based interventions (EBIs) proven to increase CRC screening. As COVID-19 continues to impede in-person healthcare visits and compel the unpredictable redirection of clinic priorities, understanding clinics’ adoption and implementation of EBIs into routine care is crucial. Mailed fecal testing is an evidence-based screening approach that offers an alternative to in-person screening tests and represents a promising approach to reduce CRC screening disparities. However, little is known about how mailed fecal testing is implemented in real-world settings. In this retrospective, cross-sectional analysis, we assessed practices around mailed fecal testing implementation in 185 clinics across 62 US health systems. We sought to (1) determine whether clinics that do and do not implement mailed fecal testing differ with respect to characteristics (e.g., type, location, and proportion of uninsured patients) and (2) identify implementation practices among clinics that offer mailed fecal testing. Our findings revealed that over half (58%) of clinics implemented mailed fecal testing. These clinics were more likely to have a CRC screening policy than clinics that did not implement mailed fecal testing (p = 0.007) and to serve a larger patient population (p = 0.004), but less likely to have a large proportion of uninsured patients (p = 0.01). Clinics that implemented mailed fecal testing offered it in combination with EBIs, including patient reminders (92%), provider reminders (94%), and other activities to reduce structural barriers (95%). However, fewer clinics reported having the leadership support (58%) or funding stability (29%) to sustain mailed fecal testing. Mailed fecal testing was widely implemented alongside other EBIs in primary care clinics participating in the CRCCP, but multiple opportunities for enhancing its implementation exist. These include increasing the proportion of community health centers/federally qualified health centers offering mailed screening; increasing the proportion that provide pre-paid return mail supplies with the screening kit; increasing the proportion of clinics monitoring both screening kit distribution and return; ensuring patients with abnormal tests can obtain colonoscopy; and increasing sustainability planning and support.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Successful ingredients of effective Collaborative Care programs in low- and middle-income countries: A rapid review

Abstract:

Integrating mental health care in primary healthcare settings is a compelling strategy to address the mental health treatment gap in low- and middle-income countries (LMICs). Collaborative Care is the integrated care model with the most evidence supporting its effectiveness, but most research has been conducted in high-income countries. Efforts to implement this complex multi-component model at scale in LMICs will be enhanced by understanding the model components that have been effective in LMIC settings.

Following Cochrane Rapid Reviews Methods Group recommendations, we conducted a rapid review to identify studies of the effectiveness of Collaborative Care for priority adult mental disorders of mhGAP (mood and anxiety disorders, psychosis, substance use disorders and epilepsy) in outpatient medical settings in LMICs. Article screening and data extraction were performed using Covidence software. Data extraction by two authors utilized a checklist of key components of effective interventions. Information was aggregated to examine how frequently the components were applied.

Our search yielded 25 articles describing 20 Collaborative Care models that treated depression, anxiety, schizophrenia, alcohol use disorder or epilepsy in nine different LMICs. Fourteen of these models demonstrated statistically significantly improved clinical outcomes compared to comparison groups. Successful models shared key structural and process-of-care elements: a multi-disciplinary care team with structured communication; standardized protocols for evidence-based treatments; systematic identification of mental disorders, and a stepped-care approach to treatment intensification. There was substantial heterogeneity across studies with respect to the specifics of model components, and clear evidence of the importance of tailoring the model to the local context.

This review provides evidence that Collaborative Care is effective across a range of mental disorders in LMICs. More work is needed to demonstrate population-level and longer-term outcomes, and to identify strategies that will support successful and sustained implementation in routine clinical settings.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Optimizing naloxone distribution to prevent opioid overdose fatalities: results from piloting the Systems Analysis and Improvement Approach within syringe service programs

Abstract:

Background

Opioid overdose fatalities are preventable with timely administration of naloxone, an opioid antagonist, during an opioid overdose event. Syringe service programs have pioneered naloxone distribution for potential bystanders of opioid overdose. The objective of this study was to pilot test a multi-component implementation strategy—the systems analysis and improvement approach for naloxone (SAIA-Naloxone)—with the goal of improving naloxone distribution by syringe service programs.

Methods

Two syringe service programs participated in a 6-month pilot of SAIA-Naloxone, which included (1) analyzing program data to identify gaps in the naloxone delivery cascade, (2) flow mapping to identify causes of attrition and brainstorm programmatic changes for improvement, and (3) conducting continuous quality improvement to test and assess whether modifications improve the cascade. We conducted an interrupted time series analysis using 52 weeks of data before and 26 weeks of data after initiating SAIA-Naloxone. Poisson regression was used to evaluate the association between SAIA-Naloxone and the weekly number of participants receiving naloxone and number of naloxone doses distributed.

Results

Over the course of the study, 11,107 doses of naloxone were distributed to 6,071 participants. Through SAIA-Naloxone, syringe service programs prioritized testing programmatic modifications to improve data collection procedures, proactively screen and identify naloxone-naïve participants, streamline naloxone refill systems, and allow for secondary naloxone distribution. SAIA-Naloxone was associated with statistically significant increases in the average number of people receiving naloxone per week (37% more SPP participants; 95% CI, 12% to 67%) and average number of naloxone doses distributed per week (105% more naloxone doses; 95% CI, 79% to 136%) beyond the underlying pre-SAIA-Naloxone levels. These initial increases were extended by ongoing positive changes over time (1.6% more SSP participants received naloxone and 0.3% more naloxone doses were distributed in each subsequent week compared to the weekly trend in the pre-SAIA Naloxone period).

Conclusions

SAIA-Naloxone has strong potential for improving naloxone distribution from syringe service programs. These findings are encouraging in the face of the worsening opioid overdose crisis in the United States and support testing SAIA-Naloxone in a large-scale randomized trial within syringe service programs.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Time Utilization Among Immunization Clinics Using an Electronic Immunization Registry (Part 2): Time and Motion Study of Modified User Workflows

Abstract:

Background

Digital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries.

Objective

We conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual–data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs).

Methods

We tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient’s total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models.

Results

Our study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR’s performance and ability to connect to the internet were particularly insightful about potential causes of delays.

Conclusions

We were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Integration of a Digital Health Intervention Into Immunization Clinic Workflows in Kenya: Qualitative, Realist Evaluation of Technology Usability

Abstract:

Background

In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries.

Objective

In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry’s usability.

Methods

Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers.

Results

Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1—ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2—confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3—identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4—make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality.

Conclusions

We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users’ workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users’ needs and again after scale-up to ensure that interventions are suitable for all user settings."

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Impact of adverse events during community-wide mass drug administration for soil-transmitted helminths on subsequent participation–a Theory of Planned Behaviour analysis

Abstract:

Background

Experiencing adverse events (AEs) during mass drug administration (MDA) could affect participation in future MDAs. This study aims to understand the potential influence of AEs during a community-wide MDA (cMDA) trial for soil-transmitted helminths (STH) in India on intention to participate in future cMDAs.

Methods

This study was conducted using a multi-method quantitative and qualitative approach among 74 participants who experienced an AE during STH cMDA and the 12 participants who subsequently refused cMDA treatment of the ongoing DeWorm3 trial. Path analysis and thematic analysis guided by the Theory of Planned Behaviour, was used.

Principal findings

Among 74 individuals who reported an AE, 12% refused treatment in the cMDA immediately subsequent to their AE and 4% refused in all subsequent cMDAs. Of these 74 individuals, 59 (80%) completed a survey and eight participated in in-depth interviews. A positive attitude towards deworming and perceived ability to participate in cMDA (perceived behavioural control) were significant predictors of intention to participate in cMDA (p<0.05). A positive attitude towards cMDA was associated with caste (χ2 = 3.83, P = 0.05), particularly among the scheduled caste/scheduled tribe (SC/ST) (62%). Perceived behavioural control in cMDA participation was associated with occupation (χ2 = 5.02, P<0.05), with higher perceived control among those engaged in skilled occupations (78%). Intention to participate in subsequent cMDAs was associated with caste and family type (χ2 = 3.83, P = 0.05 and χ2 = 7.50, P<0.05 respectively) and was higher among SC/ST (62%) and those with extended families (67%). In-depth interviews demonstrated that perceived severe AEs may lead to treatment refusal in future, particularly if children were affected.

Conclusions

Intention to participate in future STH cMDAs was associated with caste (SC/ST) and family type (extended families). Therefore, community mobilization messages about potential AEs and their management may need to intentionally target non-SC/ST households, nuclear families, and those engaged in unskilled occupations to increase cMDA participation given the possibility of AEs occurring.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A sequential, multiple assignment randomized trial comparing web-based education to mobile video interpreter access for improving provider interpreter use in primary care clinics: the mVOCAL hybrid type 3 study protocol

Abstract:

Background

Individuals who use a language other than English for medical care are at risk for disparities related to healthcare safety, patient-centered care, and quality. Professional interpreter use decreases these disparities but remains underutilized, despite widespread access and legal mandates. In this study, we compare two discrete implementation strategies for improving interpreter use: (1) enhanced education targeting intrapersonal barriers to use delivered in a scalable format (interactive web-based educational modules) and (2) a strategy targeting system barriers to use in which mobile video interpreting is enabled on providers’ own mobile devices.

Methods

We will conduct a type 3 hybrid implementation-effectiveness study in 3–5 primary care organizations, using a sequential multiple assignment randomized trial (SMART) design. Our primary implementation outcome is interpreter use, calculated by matching clinic visits to interpreter invoices. Our secondary effectiveness outcome is patient comprehension, determined by comparing patient-reported to provider-documented visit diagnosis. Enrolled providers (n = 55) will be randomized to mobile video interpreting or educational modules, plus standard interpreter access. After 9 months, providers with high interpreter use will continue as assigned; those with lower use will be randomized to continue as before or add the alternative strategy. After another 9 months, both strategies will be available to enrolled providers for 9 more months. Providers will complete 2 surveys (beginning and end) and 3 in-depth interviews (beginning, middle, and end) to understand barriers to interpreter use, based on the Theoretical Domains Framework. Patients who use a language other than English will be surveyed (n = 648) and interviewed (n = 75) following visits with enrolled providers to understand their experiences with communication. Visits will be video recorded (n = 100) to assess fidelity to assigned strategies. We will explore strategy mechanism activation to refine causal pathway models using a quantitative plus qualitative approach. We will also determine the incremental cost-effectiveness of each implementation strategy from a healthcare organization perspective, using administrative and provider survey data.

Discussion

Determining how these two scalable strategies, alone and in sequence, perform for improving interpreter use, the mechanisms by which they do so, and at what cost, will provide critical insights for addressing a persistent cause of healthcare disparities.

Trial registration

NCT05591586

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal BMJ Global Health

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Community Mental Health Journal

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Prevention Science

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal Cambridge University Press

Abstract:

Authors:

✪ Open Access

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Formative Research

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal PLOS Neglected Tropical Diseases

Abstract:

Background

Methods

Principal findings

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Science

Abstract:

Background

Methods

Discussion

Trial registration