Skip to content

✪ ‘I understood the texting process well’ – Participant perspectives on usability and acceptability of SMS-based telehealth follow-up after voluntary medical male circumcision in South Africa

Authors:

Jacqueline Pienaar, Sarah Day, Geoffrey Setswe, Beatrice Wasunna, Vuyolwethu Ncube, Felex Ndebele, Femi Oni, Evelyn Waweru, Calsile Khumalo, Hannock Tweya, Kenneth Sherr, Yanfang Su, and Caryl Feldacker

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Digital Health

Abstract:

Background

Voluntary medical male circumcision (MC) is a biomedical HIV prevention method that requires post-operative follow-up for healing confirmation. Recent research found that a two-way texting (2wT) app providing SMS-based telehealth for MC patients was safe and reduced provider workload. We evaluated 2wT usability among MC clients in South Africa assigned the 2wT intervention within a larger randomized controlled trial (RCT) of 2wT safety and workload.

Methods

This quantitative usability study is within an RCT where 547 men used 2wT to interact with an MC provider via SMS. The sub-study involved the first 100 men assigned to 2wT who completed a usability survey 14 days after surgery. Acceptability was assessed through 2wT response rates of the 547 men. Regression models analyzed associations between age, wage, location, potential adverse events (AEs), and 2wT responses.

Results

Men assigned to 2wT found it safe, comfortable, and convenient, reporting time and cost savings. High response rates (88%) to daily messages indicated acceptability. Age, wage, and location didn't affect text responses or potential AEs.

Conclusion

2wT for post-MC follow-up was highly usable and acceptable, suggesting its viability as an alternative to in-person visits. It enhanced confidence in wound self-management. This SMS-based telehealth can enhance MC care quality and be adapted to similar contexts for independent healing support, particularly for men.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Disruptions to and Innovations in HPV Vaccination Strategies within Safety-Net Healthcare Settings Resulting from the COVID-19 Pandemic

Authors:

Samantha Garcia, Michelle Shin, Kylie Sloan, Emily Dang, Carlos Orellana Garcia, Lourdes Baezconde-Garbanati, Lawrence A. Palinkas, Benjamin F. Crabtree, and Jennifer Tsui

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published:August 2023

Read the full text in the open access journal Healthcare

Abstract:

Abstract

The COVID-19 pandemic disrupted healthcare delivery within safety-net settings. Barriers to and facilitators of human papillomavirus (HPV) vaccination during the pandemic can inform future HPV vaccine strategies for underserved communities. Qualitative interviews (n = 52) between December 2020 and January 2022 in Los Angeles and New Jersey were conducted with providers, clinic leaders, clinic staff, advocates, payers, and policy-level representatives involved in the HPV vaccine process. Using the updated Consolidated Framework for Implementation Research we identified (1) outer setting barriers (i.e., vaccine hesitancy driven by social media, political views during the pandemic) and facilitators (e.g., partnerships); (2) inner setting clinic facilitators (i.e., motivation-driven clinic metrics, patient outreach, vaccine outreach events); (3) individual characteristics such as patient barriers (i.e., less likely to utilize clinic services during the pandemic and therefore, additional outreach to address missed vaccine doses are needed); (4) innovations in HPV vaccination strategies (i.e., clinic workflow changes to minimize exposure to COVID-19, leveraging new community partnerships (e.g., with local schools)); and (5) implementation strategies (i.e., multisectoral commitment to HPV goals). Pandemic setbacks forced safety-net settings to develop new vaccine approaches and partnerships that may translate to new implementation strategies for HPV vaccination within local contexts and communities.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Organizational contexts, implementation processes, and capacity outcomes of multicultural, multilingual Home-Based Programs in public initiatives: A Mixed-Methods study

Authors:

Eunjung Kim, Doris M. Boutain, Sungwon Lim, Sanithia Parker, Di Wang, Rebekah Maldonado Nofziger, & Byran J. Weiner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access Journal of Advanced Nursing

Abstract:

Aims

The study aim was to examine the impact of a home-based programme intervention on organizational contexts, implementation processes and organizational capacity outcomes from multicultural, multilingual participants working at community-based organizations.

Design

This was a sequential exploratory, mixed-methods longitudinal study using community-based participatory research principles.

Sample

Twenty participants from nine multicultural, multilingual community-based organizations were in this public health initiative's intervention to develop community-designed, home-based programmes.

Methods

Capacity building providers delivered the intervention selected by the funders. Workshop outcomes were descriptively measured in April/May 2019. In April/May and November 2019, participants completed surveys about organizational contexts, implementation processes and organizational capacity outcomes, which were analysed with t-tests using the organization as the unit of analysis. Qualitative data were analysed using content analysis.

Results

Seven programmes were new and two were modified. As workshop outcomes, 59% of participants reported increased overall implementation knowledge and 74% reported capacity building providers as the most helpful resource. After 6 to 7 months, no statistically significant changes were noted in organizational contexts, implementation processes or organizational capacity outcomes. Participants benefited from capacity building because they had programmes developed, formed partnerships with capacity building providers, gained implementation knowledge, and engaged in networking.

Conclusion

Participants reported excellent individual and organizational strengths. Many Initiative factors contributed to no statistical changes. Namely, there was no opportunity for baseline data; limited community-based organization engagement in the intervention model selection, timeline and processes; the Initiative's timeline did not fit participants' timeline; insufficient time to develop culturally and linguistically appropriate programmes; late literature review abstracts; lack of adequate, planful and paid capacity building time; and a contract requirement to have the programme due when it was not implementable. These Initiative design factors, as reported by participants, limited the Initiative's home-based programme development.

Impact

This study highlights the strengths of participants, community-based organizations and capacity building providers. Model selection, timeline and budget were identified as key factors for equitable implementation in multicultural, multilingual organizations.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Selecting implementation strategies to improve implementation of integrated PrEP for pregnant and postpartum populations in Kenya: a sequential explanatory mixed methods analysis

Authors:

Sarah Hicks, Ben Odhiambo, Felix Abuna, Julia C. Dettinger, Nancy Ngumbau, Laurén Gómez, Joseph Sila, George Oketch, Enock Sifuna, Bryan J. Weiner, Grace John-Stewart, John Kinuthia & Anjuli D. Wagner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

There is a higher risk for HIV acquisition during pregnancy and postpartum. Pre-exposure prophylaxis (PrEP) is recommended during this period for those at high risk of infection; integrated delivery in maternal and child health (MCH) clinics is feasible and acceptable but requires implementation optimization.

Methods

The PrEP in Pregnancy, Accelerating Reach and Efficiency study (PrEPARE; NCT04712994) engaged stakeholders to prioritize determinants of PrEP delivery (using Likert scores) and prioritize PrEP delivery implementation strategies. Using a sequential explanatory mixed methods design, we conducted quantitative surveys with healthcare workers at 55 facilities in Western Kenya and a stakeholder workshop (including nurses, pharmacists, counselors, and county and national policymakers), yielding visual plots of stakeholders’ perceived feasibility and effectiveness of the strategies. A stepwise elimination process was used to identify seven strategies for empirical testing. Facilitator debriefing reports from the workshop were used to qualitatively assess the decision-making process.

Results

Among 146 healthcare workers, the strongest reported barriers to PrEP delivery were insufficient providers and inadequate training, insufficient space, and high volume of patients. Sixteen strategies were assessed, 14 of which were included in the final analysis. Among rankings from 182 healthcare workers and 44 PrEP policymakers and implementers, seven strategies were eliminated based on low post-workshop ranking scores (bottom 50th percentile) or being perceived as low feasibility or low effectiveness for at least 50% of the workshop groups. The top seven strategies included delivering PrEP within MCH clinics instead of pharmacies, fast-tracking PrEP clients to reduce waiting time, delivering PrEP-related health talks in waiting bays, task shifting PrEP counseling, task shifting PrEP risk assessments, training different providers to deliver PrEP, and retraining providers on PrEP delivery. All top seven ranked strategies were grouped into bundles for subsequent testing. Facilitator debriefing reports generally aligned with rankings but noted how stakeholders’ decision-making changed when considering the impact of strategies on facility staff and non-PrEP clients.

Conclusions

The most impactful barriers to integrated PrEP delivery in MCH clinics were insufficient staffing and space. Implementation strategies prioritized through multiple methods of stakeholder input focused on co-location of services and increasing clinic efficiency. Future testing of these stakeholder-prioritized strategy bundles will be conducted to assess the effectiveness and implementation outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Characterizing provider-led adaptations to mobile phone delivery of the Adolescent Transition Package (ATP) in Kenya using the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS): a mixed methods approach

Authors:

Dorothy Imbuka Mangale, Alvin Onyango, Cyrus Mugo, Caren Mburu, Nok Chhun, Dalton Wamalwa, Irene Njuguna, Arianna Rubin Means, Grace John-Stewart, Bryan J. Weiner & Kristin Beima-Sofie

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

The COVID-19 pandemic resulted in disruptions to routine HIV services for youth living with HIV (YLH), provoking rapid adaptation to mitigate interruptions in care. The Adolescent Transition to Adult Care for HIV-infected adolescents (ATTACH) study (NCT03574129) was a hybrid I cluster randomized trial testing the effectiveness of a healthcare worker (HCW)-delivered disclosure and transition intervention — the Adolescent Transition Package (ATP). During the pandemic, HCWs leveraged phone delivery of the ATP and were supported to make adaptations. We characterized real-time, provider-driven adaptations made to support phone delivery of the ATP.

Methods

We conducted continuous quality improvement (CQI) meetings with HCWs involved in phone delivery of the ATP at 10 intervention sites. CQI meetings used plan-do-study-act (PDSA) cycles and were audio-recorded. Adaptations were coded by two-independent coders using the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS). Adaptation testing outcomes (adopt, retest, or abandon) and provider experience implementing the adaptations were also recorded. We summarized adaptation characteristics, provider experience, and outcomes.

Results

We identified 72 adaptations, 32 were unique. Overall, adaptations included modification to context (53%, n = 38), content (49%, n = 35), and evaluation processes (13%, n = 9). Context adaptations primarily featured changes to personnel, format, and setting, while content and evaluation adaptations were frequently achieved by simple additions, repetition, and tailoring/refining of the phone delivery strategy. Nine adaptations involved abandoning, then returning to phone delivery. HCWs sought to increase reach, improve fidelity, and intervention fit within their context. Most adaptations (96%, n = 69) were perceived to increase the feasibility of phone delivery when compared to before the changes were introduced, and HCWs felt 83% (n = 60) of adaptations made phone delivery easier. Most adaptations were either incorporated into routine workflows (47%) or tested again (47%).

Conclusion

Adaptation of phone delivery was a feasible and effective way of addressing challenges with continuity of care for YLH during the COVID-19 pandemic. Adaptations were primarily context adaptions. While FRAME-IS was apt for characterizing adaptations, more use cases are needed to explore the range of its utility.

Trial registration

Trial registered on ClinicalTrial.gov as NCT03574129.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Econometric evaluation of implementing a behavioral health integration intervention in primary care settings

Authors:

Zsolt Nagykaldi, Benjamin Littenberg, Levi Bonnell, Ryan Breshears, Jessica Clifton, Abigail Crocker, Juvena Hitt, Rodger Kessler, Brenda Mollis, Robin E S Miyamoto, and Constance van Eeghen

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Translational Behavioral Medicine

Abstract:

Integrated behavioral health (IBH) is an approach to patient care that brings medical and behavioral health providers (BHPs) together to address both behavioral and medical needs within primary care settings. A large, pragmatic, national study aimed to test the effectiveness and measure the implementation costs of an intervention to improve IBH integration within primary care practices (IBH-PC). Assess the time and cost to practices of implementing a comprehensive practice-level intervention designed from the perspective of clinic owners to move behavioral service integration from co-location toward full integration as part of the IBH-PC study. IBH-PC program implementation costs were estimated in a representative sample of 8 practices using standard micro-econometric evaluation of activities outlined in the implementation workbook, including program implementation tasks, remote quality improvement coaching services, educational curricula, and learning community activities, over a 24-month period. The total median cost of implementing the IBH-PC program across all stages was $20,726 (range: $12,381 - $60,427). The median cost of the Planning Stage was $10,258 (range: $4,625 - $14,840), while the median cost of the Implementation Stage was $9,208 (range: $6,017 – 49,993). There were no statistically significant differences in practice or patient characteristics between the 8 selected practices and the larger IBH-PC practice sample (N=34). This study aimed to quantify the relative costs associated with integrating behavioral health into primary care. Although the cost assessment approach did not include all costs (fixed, variable, operational, and opportunity costs), the study aimed to develop a replicable and pragmatic measurement process with flexibility to adapt to emerging developments in each practice environment, providing a reasonable ballpark estimate of costs associated with implementation to help guide future executive decisions.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ HPV vaccination in Kenya: a study protocol to assess stakeholders’ perspectives on implementation drivers of HPV vaccination and the acceptability of the reduced dose strategy among providers

Authors:

Grace Umutesi, Lynda Oluoch, Bryan J. Weiner, Elizabeth Bukusi, Maricianah Onono, Betty Njoroge, Lucy Mecca, Kenneth Ngure, Nelly R. Mugo, & Ruanne V. Barnabas

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2023

Read the full text in the open access journal Frontiers in Health Services

Abstract:

Background:

Cervical cancer is the leading cause of cancer-related deaths among Kenyan women. Persistent infection with high-risk oncogenic Human papillomavirus (HPV) genotypes is a necessary cause of cervical cancer. HPV vaccines are safe, durable, and efficacious in preventing incident HPV infections. In Kenya, despite efforts to increase HPV vaccination, coverage remains low. We sought to assess: (1) barriers and facilitators of HPV vaccination from the perspective of adolescent girls and young women (AGYW), their guardians as well as stakeholders involved in HPV vaccine delivery, and (2) the acceptability of the single dose of the HPV vaccination among healthcare providers (HCPs).

Methods:

Our study is nested within the KENya Single-dose HPV-vaccine Efficacy study (KEN SHE) that sought to test the efficacy of single-dose bivalent (HPV 16/18) and single-dose nonavalent (HPV 16/18/31/33/45/52/58/6/11) vaccination. We are conducting this study in Kiambu, Nairobi, and Kisumu counties. In these counties, we are interviewing stakeholders (n = ∼25), selected based on their role in HPV vaccination at the county and national levels. Interviews are audio recorded and conducted in English or Swahili. The semi-structured interview guides were designed based on: (1) the Theoretical Domains Framework (TDF) for AGYW and guardians and (2) the Consolidated Framework for Implementation Research (CFIR) for other stakeholders. The Theoretical Framework of Acceptability (TFA) was leveraged to design the survey administered to HCPs (n = ∼309) involved in HPV vaccination. We will develop a codebook based on emerging codes from the transcripts and constructs from the TDF and CFIR. Emerging themes will be summarized highlighting similarities and differences between and within the different stakeholder groups and counties. Descriptive statistics and a χ2 test will be used to assess the distribution of responses between the different sites and regression analysis will be used to assess factors associated with high acceptability of the single-dose strategy while controlling for confounding variables.

Discussion:

Our study will describe key barriers and facilitators that affect HPV vaccination from the perspective of multiple stakeholders as well as insights on the perspective of HCPs towards the single-dose strategy to inform the designing of strategies to increase HPV vaccination uptake in Kenya and comparable settings.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Assessing drivers of implementing “Scaling-up the Systems Analysis and Improvement Approach” for Prevention of Mother-to-Child HIV Transmission in Mozambique (SAIA-SCALE) over implementation waves

Authors:

Celso Inguane, Sarah Gimbel, Caroline Soi, Esperança Tavede, Filipe Murgorgo, Xavier Isidoro, Yaesh Sidat, Regina Nassiaca, Joana Coutinho, Maria Cruz, Mery Agostinho, Fernando Amaral, Aneth Dinis, Kristjana Ásbjörnsdóttir, Jonny Crocker, Nélia Manaca, Isaias Ramiro, James Pfeiffer, Maria de Fátima Cuembelo, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2023

Read the full text in the open access journal Implementation Science Communication

Abstract:

Background

The Systems Analysis and Improvement Approach (SAIA) is an evidence-based package of systems engineering tools originally designed to improve patient flow through the prevention of Mother-to-Child transmission of HIV (PMTCT) cascade. SAIA is a potentially scalable model for maximizing the benefits of universal antiretroviral therapy (ART) for mothers and their babies. SAIA-SCALE was a stepped wedge trial implemented in Manica Province, Mozambique, to evaluate SAIA’s effectiveness when led by district health managers, rather than by study nurses. We present the results of a qualitative assessment of implementation determinants of the SAIA-SCALE strategy during two intensive and one maintenance phases.

Methods

We used an extended case study design that embedded the Consolidated Framework for Implementation Research (CFIR) to guide data collection, analysis, and interpretation. From March 2019 to April 2020, we conducted in-depth individual interviews (IDIs) and focus group discussions (FGDs) with district managers, health facility maternal and child health (MCH) managers, and frontline nurses at 21 health facilities and seven districts of Manica Province (Chimoio, Báruè, Gondola, Macate, Manica, Sussundenga, and Vanduzi).

Results

We included 85 participants: 50 through IDIs and 35 from three FGDs. Most study participants were women (98%), frontline nurses (49.4%), and MCH health facility managers (32.5%). An identified facilitator of successful intervention implementation (regardless of intervention phase) was related to SAIA’s compatibility with organizational structures, processes, and priorities of Mozambique’s health system at the district and health facility levels. Identified barriers to successful implementation included (a) inadequate health facility and road infrastructure preventing mothers from accessing MCH/PMTCT services at study health facilities and preventing nurses from dedicating time to improving service provision, and (b) challenges in managing intervention funds.

Conclusions

The SAIA-SCALE qualitative evaluation suggests that the scalability of SAIA for PMTCT is enhanced by its fit within organizational structures, processes, and priorities at the primary level of healthcare delivery and health system management in Mozambique. Barriers to implementation that impact the scalability of SAIA include district-level financial management capabilities and lack of infrastructure at the health facility level. SAIA cannot be successfully scaled up to adequately address PMTCT needs without leveraging central-level resources and priorities.

Trial registration

ClinicalTrials.gov, NCT03425136. Registered on 02/06/2018.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Educators’ experiences and reflections on the implementation of evidence-based practices for autistic students in public schools during the COVID-19 pandemic

Authors:

Alyssa M Hernandez, Olivia Michael, Gabriella Canning, Mahima Joshi, Anthony Osuna & Jill Locke

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2023

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Introduction

In 2020, the COVID-19 pandemic forced many schools to close their doors and transition to remote learning, disrupting how autistic students received school-based services and support. While school structure changes were challenging for all students, autistic students were uniquely affected, considering their reliance on predictability and routine; moreover, education settings are where most autistic children receive services. Much has been studied regarding the use of evidence-based practices (EBPs) for autistic students in traditional school settings, yet little is known about how educators use EBPs in remote learning environments in the wake of the COVID-19 pandemic.

Method

In this study, we explore educators’ experiences with EBP implementation at the height of the pandemic and educators’ reflections of its impact on autistic students and their school systems. Qualitative data were collected from 81 educators (general educators, special educators, and paraeducators) in semi-structured interviews regarding EBP use at the onset of the pandemic.

Results

Four themes emerged from interviews: (1) pandemic and remote learning environment challenges to inclusion and EBP use; (2) EBP use adaptations for remote learning environments; (3) pandemic and remote learning environment benefits for EBP use; and (4) considerations for EBP use beyond the pandemic.

Conclusion

These findings elucidate educators’ experiences using EBPs during the COVID-19 pandemic and highlight important areas of consideration for autism-focused EBP implementation as remote instruction continues to be a learning format. More research is needed to understand how to best implement EBPs for autistic students in this emerging instruction context.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Comparison of methods to engage diverse stakeholder populations in prioritizing PrEP implementation strategies for testing in resource-limited settings: a cross-sectional study

Authors:

Sarah Hicks, Felix Abuna, Ben Odhiambo, Julia C. Dettinger, Nancy Ngumbau, Laurén Gómez, Joseph Sila, George Oketch, Enock Sifuna, Bryan J. Weiner, Grace C. John-Stewart, John Kinuthia & Anjuli D. Wagner

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2023

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

There is a lack of consensus about how to prioritize potential implementation strategies for HIV pre-exposure prophylaxis (PrEP) delivery. We compared several prioritization methods for their agreement and pragmatism in practice in a resource-limited setting.

Methods

We engaged diverse stakeholders with clinical PrEP delivery and PrEP decision-making experience across 55 facilities in Kenya to prioritize 16 PrEP delivery strategies. We compared four strategy prioritization methods: (1) “past experience surveys” with experienced practitioners reflecting on implementation experience (N = 182); (2 and 3) “pre- and post-small-group ranking” surveys before and after group discussion (N = 44 and 40); (4) “go-zone” quadrant plots of perceived effectiveness vs feasibility. Kendall’s correlation analysis was used to compare strategy prioritization using the four methods. Additionally, participants were requested to group strategies into three bundles with up to four strategies/bundle by phone and online survey.

Results

The strategy ranking correlation was strongest between the pre- and post-small-group rankings (Tau: 0.648; p < 0.001). There was moderate correlation between go-zone plots and post-small-group rankings (Tau: 0.363; p = 0.079) and between past-experience surveys and post-small-group rankings (Tau: 0.385; p = 0.062). For strategy bundling, participants primarily chose bundles of strategies in the order in which they were listed, reflecting option ordering bias. Neither the phone nor online approach was effective in selecting strategy bundles. Participants agreed that the strategy ranking activities conducted during the workshop were useful in prioritizing a final set of strategies.

Conclusions

Both experienced and inexperienced stakeholder participants’ strategy rankings tended to prioritize strategies perceived as feasible. Small group discussions focused on feasibility and effectiveness revealed moderately different priorities than individual rankings. The strategy bundling approach, though less time- and resource-intensive, was not effective. Future research should further compare the relative effectiveness and pragmatism of methodologies to prioritize implementation strategies.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**