Skip to content

✪ Content validity of an item bank to assess intervention characteristic determinants of implementing evidence-based practices

Authors:

Salene MW Jones, Aditya Shrey & Bryan J Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Barriers and facilitators, collectively called determinants, of evidence-based practice implementation are key to identifying the best strategies for promoting implementation. Assessing determinants before implementation can help tailor strategies to those that would be most effective. Current measures of determinants are not comparable across implementation settings and implementation scientists and practitioners often have to create their own measures. This study was the first step in creating determinants item banks that are usable across settings and focused on intervention characteristics. We aimed to establish the content validity of the item bank.

Method

This study used a concurrent mixed methods approach. Items for assessing intervention characteristic determinants were first identified through systematic reviews. Implementation scientists then completed a survey where they provided both quantitative and qualitative feedback on the items. Finally, three experts with both clinical and implementation experience provided feedback on redundancy and representativeness.

Results

The systematic reviews identified over 1,959 items so subsequent steps were limited to focus on intervention characteristic determinants (271 items) such as adaptability of the practice. Based on feedback from thirty implementation scientists, the items were reduced to 92 but an additional 53 were added, most due to qualitative feedback. Items were also rewritten based on qualitative results. Three experts reviewed the remaining 145 items. Based on their feedback, the number of items was reduced to 109.

Conclusions

Creating a determinants item bank was feasible and the final items had content validity. The next steps include testing reliability and validity in a larger sample of clinicians implementing evidence-based practices.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementing point-of-care medical information systems into trauma and general surgeon practice in a middle-income country: a qualitative study utilizing the Consolidated Framework for Implementation Research

Authors:

Stephanie N. Wilson, Helen Noble, Willy Jesús Neumann Ordoñez, Gabriela Zavala Wong, Manuel J. Rodríguez, David Ortega Checa, Maria Warne, Kirsten Senturia & Lacey Nicole LaGrone

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Point-of-care medical information systems (POCMIS) can provide an efficient and effective means of strengthening health systems globally through their encouragement of continued medical education. Using the Consolidated Framework for Implementation Research (CFIR) as a guide, this research provides suggestions for improved implementation of POCMIS in low- and middle-income countries informed by an intervention implemented across public and military hospitals in Lima, Peru.

Methods

Analysis is based on qualitative interviews conducted with 12 Peruvian surgeons across eight public hospitals and one military hospital who received an intervention that provided free access to UpToDate and introduced Google Translate. The post-intervention interviews were transcribed, translated, and analyzed for themes overlapping with CFIR constructs to expose barriers to implementation and suggestions for improved implementation of future interventions.

Results

Barriers included a lack of seniority buy-in and engaged leadership, an overabundance of personal preferences for multiple POCMIS, and a culture of assumption that inhibited open communication regarding access to and use of POCMIS. Suggestions for improved implementation focused on the adaptation of the intervention. Namely, surgeons discussed regionally-specific adaptations as well as adaptations specific to their surgical specialty including visual, rather than written, representation of the information available via POCMIS.

Conclusions

Results indicate necessary adaptations for implementing interventions including POCMIS in LMICs, mimicking much of the implementation science literature on intervention adaptation. In addition to explicit suggestions provided by surgeons, we also suggest actionable steps to adapt to barriers identified in our data. Rapid assessment procedures (RAP) are one established methodological technique useful for assessing organization culture prior to implementation, allowing for necessary cultural adaptations. Dynamic adaption process (DAP) is another useful and established method that breaks implementation into four phases allowing for adaptations based on the initial assessment of the intervention site.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Conceptual Framework for Group Well-Child Care: A Tool to Guide Implementation, Evaluation, and Research

Authors:

Ashley Gresh, Deborah Wilson, Ada Fenick, Crystal L. Patil, Tumaini Coker, Sharon Schnidler Rising, Nancy Glass, & Rheanna Platt.

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2023

Read the full text in the open access Maternal and Child Health Journal

Abstract:

Objective

To use scoping review methods to construct a conceptual framework based on current evidence of group well-child care to guide future practice and research.

Methods

We conducted a scoping review using Arksey and O’Malley’s (2005) six stages. We used constructs from the Consolidated Framework for Implementation Research and the quadruple aim of health care improvement to guide the construction of the conceptual framework.

Results

The resulting conceptual framework is a synthesis of the key concepts of group well-child care, beginning with a call for a system redesign of well-child care to improve outcomes while acknowledging the theoretical antecedents structuring the rationale that supports the model. Inputs of group well-child care include health systems contexts; administration/logistics; clinical setting; group care clinic team; community/patient population; and curriculum development and training. The core components of group well-child care included structure (e.g., group size, facilitators), content (e.g., health assessments, service linkages). and process (e.g., interactive learning and community building). We found clinical outcomes in all four dimensions of the quadruple aim of healthcare.

Conclusion

Our conceptual framework can guide model implementation and identifies several outcomes that can be used to harmonize model evaluation and research. Future research and practice can use the conceptual framework as a tool to standardize model implementation and evaluation and generate evidence to inform future healthcare policy and practice.

Significance

What is already known on this subject? Group well-child care (GWCC) is associated with improved healthcare utilization (e.g., attendance, immunization rates), parent outcomes (e.g., psychological well-being, satisfaction), and clinician outcomes (e.g., self-efficacy).

What this study adds? Scoping review methodology was used to generate a conceptual framework of GWCC which can be used as a guide to standardize practices for implementation, evaluation, and research in GWCC.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Managers’ and providers’ perspectives on barriers and facilitators for the implementation of differentiated service delivery models for HIV treatment in Mozambique: a qualitative study

Authors:

Dorlim Moiana Uetela, Sarah Gimbel, Celso Inguane, Onei Uetela, Aneth Dinis, Aleny Couto, Irénio Gaspar, Eduardo S. Gudo, Sérgio Chicumbe, Sandra Gaveta, Orvalho Augusto & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal Journal of the International AIDS Society

Abstract:

Introduction

In 2018, Mozambique's Ministry of Health launched a guideline for a nationwide implementation of eight differentiated service delivery models to optimize HIV service delivery and achieve universal coverage of HIV care and treatment. The models were (1) Fast-track, (2) Three-month Antiretrovirals Dispensing, (3) Community Antiretroviral Therapy Groups, (4) Adherence Clubs, (5) Family-approach, and three one-stop shop models for (6) Tuberculosis, (7) Maternal and Child Health, and (8) Adolescent-friendly Health Services. This study identified drivers of implementation success and failure across these differentiated service delivery models.

Methods

Twenty in-depth individual interviews were conducted with managers and providers from the Ministry of Health and implementing partners from all levels of the health system between July and September 2021. National-level participants were based in the capital city of Maputo, and participants at provincial, district and health facility levels were from Sofala province, a purposively selected setting. The Consolidated Framework for Implementation Research (CFIR) guided data collection and thematic analysis. Deductively selected constructs were assessed while allowing for additional themes to emerge inductively.

Results

The CFIR constructs of Relative Advantage, Complexity, Patient Needs and Resources, and Reflecting and Evaluating were identified as drivers of implementation, whereas Available Resources and Access to Knowledge and Information were identified as barriers. Fast-track and Three-month Antiretrovirals Dispensing models were deemed easier to implement and more effective in reducing workload. Adherence Clubs and Community Antiretroviral Therapy Groups were believed to be less preferred by clients in urban settings. COVID-19 (an inductive theme) improved acceptance and uptake of individual differentiated service delivery models that reduced client visits, but it temporarily interrupted the implementation of group models.

Conclusions

This study described important determinants to be addressed or leveraged for the successful implementation of differentiated service delivery models in Mozambique. The models were considered advantageous overall for the health system and clients when compared with the standard of care. However, successful implementation requires resources and ongoing training for frontline providers. COVID-19 expedited individual models by loosening the inclusion criteria; this experience can be leveraged to optimize the design and implementation of differentiated service delivery models in Mozambique and other countries.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Evaluation of opportunities to implement community-wide mass drug administration for interrupting transmission of soil-transmitted helminths infections in India

Authors:

Kumudha Aruldas, Kim Dawson, Malvika Saxena, Angelin Titus, Jabaselvi Johnson, Marie-Claire Gwayi-Chore, Jayaprakash Muliyil, Gagandeep Kang, Judd L. Walson, Ajay Khera, Sitara S. R. Ajjampur & Arianna Rubin Means

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal PLOS Neglected Tropical Diseases

Abstract:

Background

The World Health Organization Neglected Tropical Disease (NTD) guidelines recommend control of soil transmitted helminth (STH)-associated morbidity with targeted deworming of preschool and school-aged children who are disproportionately affected by STH-associated morbidity. However, this strategy leaves many adults untreated and reinfection within communities perpetuates transmission even when mass drug administration (MDA) coverage of children is high. Evidence suggests that it may be possible to interrupt STH transmission by expanding MDA to a community-wide MDA (cMDA).

Methods

This multi-methods study of organizational readiness survey, key informant interviews, and program mapping, were conducted with government stakeholders in three Indian states, Goa, Sikkim, and Odisha, to assess readiness of the states for transitioning from school-based MDA to cMDA and identify opportunities to leverage existing infrastructure from other NTD programs like lymphatic filariasis (LF) for STH cMDA.

Principal findings

Overall, all three states indicated a highly favorable policy environment, effective leadership structure, adequate material resources, demonstrated technical capacity, and adequate community infrastructure needed to launch a STH cMDA program. The findings indicated a high-level of health system readiness to implement provided human resources and financial resources to deliver cMDA is strengthened. Areas with a significant overlap between LF and STH MDA platforms, particularly at the community-level, may be best primed for transitioning. Immunization, maternal child health, and non-communicable disease control programs were the other programs for possible integration of cMDA. States indicated having effective leadership structures in place at the state-level, however, engaging local leaders and community groups were considered crucial for successful implementation of cMDA. In-migration was a perceived challenge for estimating drug requirement and preventing possible stockouts.

Conclusions

Findings from this study are intended to proactively support government decision making, prioritization, and program planning across heterogenous implementation contexts in India to speed the translation of research findings into practice.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Barriers and Facilitators to Father’s Engagement in a Depression and Alcohol Use Intervention in Kenya: Father, Family, and Community Factors

Authors:

Ali Giusto, Florence Jaguga, Victor Pereira-Sanchez, Wilter Rono, Noah Triplett, Hani Rukh-E-Qamar, Mattea Parker & Milton L. Wainberg

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2023

Read the full text in the open access journal International Journal of Environmental Health

Abstract:

In Kenya, there is a treatment gap for depression and alcohol use that is especially large for fathers, which has consequences for families. While treatments exist, there are challenges to implementation. This study aimed to understand barriers and facilitators to implementing a treatment for fathers’ depression and alcohol use in Eldoret, Kenya. Guided by the Consolidated Framework for Implementation Research and the Integrated Sustainability Framework, we conducted 18 key informant interviews and 7 focus group discussions (31 total participants) with stakeholders in Eldoret (hospital leaders, policy makers, mental health providers, community leaders, fathers, lay providers, and patients previously engaged in treatment). Interviews were analyzed using the framework method; themes were matrixed by framework domains. Participants identified barriers and facilitators, and opportunities for implementation, in the following domains: innovation, outer setting, inner setting, individual, sustainability, and characteristics of systems. Barriers included a lack of resources, stigma, masculine norms, cost of services, and alcohol dependence. Facilitators included community buy-in, family support, providers with lived experience, government support, and relevant treatment content. Findings will inform implementation strategy development for an intervention for fathers with depression and alcohol use, and family problems with local relevance and scalable potential.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Barriers to and strategies for early implementation of pharmacy-delivered HIV PrEP services in Kenya: An analysis of routine data

Authors:

Hilma N. Nakambale, Stephanie D. Roche, Peter Mogere, Victor Omollo, Alexandra P. Kuo, Andy Stergachis, Jared M. Baeten, Elizabeth Bukusi, Kenneth Ngure, Melissa Latigo Mugambi & Katrina F. Ortblad

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2023

Read the full text in the open access journal Frontiers in Reproductive Health

Abstract:

Background

For individuals who face challenges accessing clinic-based HIV pre-exposure prophylaxis (PrEP), differentiated service delivery models are needed to expand access and reach. During a pilot study testing a novel pharmacy-delivered oral PrEP model in Kenya, we used routine programmatic data to identify early implementation barriers and actions that providers and study staff took in response to the barriers.

Methods

We trained pharmacy providers at five private pharmacies in Kisumu and Kiambu Counties to initiate and continue clients at risk of HIV acquisition on PrEP for a fee of 300 KES per visit (∼$3 USD) using a prescribing checklist with remote clinician oversight. Research assistants stationed at the pharmacies completed weekly observation reports of pharmacy-delivered PrEP services using a structured template. We analyzed reports from the first 6 month of implementation using content analysis and identified multi-level early implementation barriers and actions taken to address these. We then organized the identified barriers and actions according to the Consolidated Framework for Implementation Research (CFIR).

Results

From November 2020 to May 2021, research assistants completed 74 observation reports (∼18/pharmacy). During this period, pharmacy providers screened 496 potential PrEP clients, identified 425 as eligible for pharmacy-delivered PrEP services, and initiated 230 (54%) on PrEP; 125 of 197 (63%) clients eligible for PrEP continuation refilled PrEP. We identified the following early implementation barriers to pharmacy-delivered PrEP services (by CFIR domain): high costs to clients (intervention characteristics), client discomfort discussing sexual behaviors and HIV testing with providers (outer setting), provider frustrations that PrEP delivery was time-consuming and disruptive to their workflow (inner setting), and provider hesitancy to deliver PrEP due to concerns about encouraging sexual promiscuity (characteristics of individuals). To help address these, pharmacy providers implemented a self-screening option for behavioral HIV risk assessment for prospective PrEP clients, allowed flexible appointment scheduling, and conducted pharmacy PrEP trainings for newly hired staff.

Conclusion

Our study provides insight into early barriers to implementing pharmacy-delivered PrEP services in Kenya and potential actions to mitigate these barriers. It also demonstrates how routine programmatic data can be used to understand the early implementation process.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Applying the Consolidated Framework for Implementation Research to Identify Implementation Determinants for the Integrated District Evidence-to-Action Program, Mozambique

Authors:

Celso Inguane, Caroline Soi, Sarah Gimbel, Nélia Manaca, Isaías Ramiro, Florência Floriano, Georgina de Castro, Orvalho Augusto, Stélio Tembe, James Pfeiffer, Quinhas Fernandes, and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2022

Read the full text in the open access journal Global Health: Science and Practice

Abstract

Introduction

The Integrated District Evidence-to-Action program is an audit and feedback intervention introduced in 2017 in Manica and Sofala provinces, Mozambique, to reduce mortality in children younger than 5 years. We describe barriers and facilitators to early-stage effectiveness of that intervention.

Method

We embedded the Consolidated Framework for Implementation Research (CFIR) into an extended case study design to inform sampling, data collection, analysis, and interpretation. We collected data in 4 districts in Manica and Sofala Provinces in November 2018. Data collection included document review, 22 in-depth individual interviews, and 2 focus group discussions (FGDs) with 19 provincial, district, and facility managers and nurses. Most participants (70.2%) were nurses and facility managers and the majority were women (87.8%). We audio-recorded all but 2 interviews and FGDs and conducted a consensus-based iterative analysis.

Results

Facilitators of effective intervention implementation included: implementation of the core intervention components of audit and feedback meetings, supportive supervision and mentorship, and small grants as originally planned; positive pressure from district managers and study nurses on health facility staff to strive for excellence; and easy access to knowledge and information about the intervention. Implementation barriers were the intervention’s lack of compatibility in not addressing the scarcity of human and financial resources and inadequate infrastructures for maternal and child health services at district and facility levels and; the intervention’s lack of adaptability in having little flexibility in the design and decision making about the use of intervention funds and data collection tools.

Discussion

Our comprehensive and systematic use of the CFIR within an extended case study design generated granular evidence on CFIR’s contribution to implementation science efforts to describe determinants of early-stage intervention implementation. It also provided baseline findings to assess subsequent implementation phases, considering similarities and differences in barriers and facilitators across study districts and facilities. Sharing preliminary findings with stakeholders promoted timely decision making about intervention implementation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A pragmatic approach to identifying implementation barriers and facilitators for a novel pre-exposure prophylaxis (PrEP) delivery model at public facilities in urban Uganda

Authors:

Dorothy Thomas, Andrew Mujugira, Katrina Ortblad, Sylvia Namanda, Joseph Kibuuka, Mai Nakitende, Florence Nambi, Lylianne Nakabugo, Caitlin Scoville, Timothy Muwonge, Renee Heffron

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: January 2022

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Scalable HIV pre-exposure prophylaxis (PrEP) delivery models for resource-limited settings are critical for improving PrEP coverage and interrupting HIV transmission. This research uses technical assistance (TA) reports to evaluate implementation barriers and facilitators for a novel delivery model integrating PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples in public health facilities in Kampala, Uganda.

Methods

We used data from the Partners PrEP Program (PPP)—a stepped-wedge cluster randomized trial that is launching PrEP delivery through an integrated model of oral PrEP and antiretroviral therapy (ART) delivery for HIV sero-different couples at public health facilities in Kampala and Wakiso, Uganda (NCT03586128). Technical assistance teams, comprised of PPP program staff, conducted monthly TA visits to implementing facilities where they identified and addressed implementation challenges in collaboration with health facility staff. Findings were recorded in TA reports, a standardized form structured using the Consolidated Framework for Implementation Research (CFIR). We used a conceptual content analysis approach to evaluate TA reports completed from January to December 2019 and identify implementation barriers and facilitators.

Results

Among 39 reports from the 8 implementing facilities (~ 5 per facility), we identified 11 CFIR constructs. Key implementation facilitators included sensitizing and educating facility staff about PrEP (knowledge and beliefs about the innovation); establishing formal and informal feedback and accountability mechanisms (reflecting and evaluating); and empowering facility staff to address implementation challenges (self-efficacy). Key implementation barriers were related to ineffective recruitment and referral of sero-different couples to and from nearby facilities (cosmopolitanism) as well as stockouts of laboratory resources and testing supplies (available resources).

Conclusions

This analysis featured a robust implementation science framework to assess the relationship between early implementation determinants and outcomes of this innovative PrEP delivery model. Further, we have provided important descriptions of early implementation barriers and facilitators that will inform scale-up efforts for PrEP delivery within and beyond Uganda. Future work will refine the analysis of pragmatic program data, qualitatively investigate the identified key themes, and explore strategies for addressing implementation barriers.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Factors Affecting the Initiation of a Shared Decision Making Program in Obstetric Practices

Authors:

Deborah J. Bowen, Ann M. Nguyen, Cynthia LeRouge, Erin LePoire, & Tao Sheng Kwan-Gett

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2021

Read the full text in the open access journal Healthcare

Abstract:

As healthcare systems progress toward initiatives that increase patient engagement, stakeholder hopes are that shared decision making (SDM) will become routine practice. Yet, there is limited empirical evidence to guide such SDM program implementations, particularly in obstetric practices. The first stage of any project implementation is the "initiation stage", in which project leaders define a project's purpose and stakeholders and structures are put in place to support the new initiative.

Our study's objective was to identify factors affecting the initiation stage of an SDM program implementation project for TOLAC, trial of labor after Cesarean. We conducted a multiple-case study of an SDM program implementation in three obstetric settings in Washington State. The research design and analysis were guided by implementation science frameworks and project management literature. Data sources included interviews with key informants from the State, SDM tool vendors, and three project sites, as well as implementation documents.

The study results provide insight into how the identified project implementation factors provide an essential foundation for informing project planning, execution, and reflection/evaluation. In this study, the State's decision aid certification program pressured the project sites to shape the project purpose and engage stakeholders that would meet immediate project requirements (specifically, state requirements).

The study reveals that external demands may not be in perfect alignment with the internal necessities required for an SDM program's long-term viability and sustainability. Findings may be used by implementers and researchers to model and strategize the early stages of SDM program implementation projects, particularly in the obstetric setting.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**