Mixed-Methods Archives - Page 2 of 8 - Implementation Science at UW

✪ School-Partnered Collaborative Care (SPACE) for Pediatric Type 1 Diabetes: Development and Usability Study of a Virtual Intervention With Multisystem Community Partners

Abstract:

Background

School-partnered interventions may improve health outcomes for children with type 1 diabetes, though there is limited evidence to support their effectiveness and sustainability. Family, school, or health system factors may interfere with intervention usability and implementation.

Objective

To identify and address potential implementation barriers during intervention development, we combined methods in user-centered design and implementation science to adapt an evidence-based psychosocial intervention, the collaborative care model, to a virtual school-partnered collaborative care (SPACE) model for type 1 diabetes between schools and diabetes medical teams.

Methods

We recruited patient, family, school, and health system partners (n=20) to cocreate SPACE through iterative, web-based design sessions using a digital whiteboard (phase 1). User-centered design methods included independent and group activities for idea generation, visual voting, and structured critique of the evolving SPACE prototype. In phase 2, the prototype was evaluated with the usability evaluation for evidence-based psychosocial interventions methods. School nurses reviewed the prototype and tasks in cognitive walkthroughs and completed the Intervention Usability Scale (IUS). Two members of the research team independently identified and prioritized (1-3 rating) discrete usability concerns. We evaluated the relationship between prioritization and the percentage of nurses reporting each usability issue with Spearman correlation. Differences in IUS scores by school nurse characteristics were assessed with ANOVA.

Results

In the design phase, the partners generated over 90 unique ideas for SPACE, prioritizing elements pertaining to intervention adaptability, team-based communication, and multidimensional outcome tracking. Following three iterations of prototype development, cognitive walkthroughs were completed with 10 school nurses (n=10, 100% female; mean age 48.5, SD 9.5 years) representing different districts and years of experience. Nurses identified 16 discrete usability issues (each reported by 10%-60% of participants). Two issues receiving the highest priority (3.0): ability to access a virtual platform (n=3, 30% of participants) and data-sharing mechanisms between nurses and providers (n=6, 60% of participants). There was a moderate correlation between priority rating and the percentage of nurses reporting each issue (ρ=0.63; P=.01). Average IUS ratings (77.8, SD 11.1; 100-point scale) indicated appropriate usability. There was no difference in IUS ratings by school nurse experience (P=.54), student caseload (P=.12), number of schools covered (P=.90), or prior experience with type 1 diabetes (P=.83), suggesting that other factors may influence usability. The design team recommended strategies for SPACE implementation to overcome high-priority issues, including training users on videoconferencing applications, establishing secure forms for school data reporting, and sharing glucose data in real-time during SPACE meetings.

Conclusions

Cross-sector interventions are complex, and perceived usability is a potential barrier to implementation. Using web-based cocreation methods with community partners promoted high-quality intervention design that is aligned with end-user priorities. Quantitative and qualitative assessments indicated appropriate degree of usability to move forward with pilot-testing.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Usability, Acceptability, and Barriers to Implementation of a Collaborative Agenda-Setting Intervention (CASI) to Promote Person-Centered Ovarian Cancer Care: Development Study

Abstract:

Background

People with advanced ovarian cancer and their caregivers report unmet supportive care needs. We developed a Collaborative Agenda-Setting Intervention (CASI) to elicit patients’ and caregivers’ needs through the patient portal before a clinic visit and to communicate these needs to clinicians using the electronic health record.

Objective

We aimed to assess the usability and acceptability of the CASI and identify barriers to and facilitators of its implementation.

Methods

We recruited English- and Spanish-speaking patients, caregivers, and clinicians from the gynecologic oncology program at a comprehensive cancer center. Participants used the CASI prototype and then completed individual cognitive interviews and surveys. We assessed usability with the System Usability Scale (scores range 0‐100, scores ≥70 indicate acceptable usability) and acceptability with the Acceptability of Intervention Measure and Intervention Appropriateness Measure (scores for both measures range from 1 to 5, higher scores indicate greater acceptability). Interviews were audio recorded, transcribed, and analyzed using directed content analysis. Domains and constructs from the Consolidated Framework for Implementation Research comprised the initial codebook. We analyzed survey data using descriptive statistics and compared usability and acceptability scores across patients, caregivers, and clinicians using analyses of variance.

Results

We enrolled 15 participants (5 patients, 5 caregivers, and 5 clinicians). The mean System Usability Scale score was 72 (SD 16). The mean Acceptability of Intervention Measure and Intervention Appropriateness Measure scores were 3.9 (SD 1.0) and 4.1 (SD 0.8), respectively. Participants viewed the CASI content and format positively overall. Several participants appreciated the CASI’s integration into the clinical workflow and its potential to increase attention to psychosocial concerns. Suggestions to refine the CASI included removing redundant items, simplifying item language, and adding options to request a conversation or opt out of supportive care referrals. Key barriers to implementing the CASI include its complexity and limited resources available to address patients’ and caregivers’ needs.

Conclusions

The CASI is usable and acceptable to patients with advanced ovarian cancer, caregivers, and clinicians. We identified several barriers to and facilitators of implementing the CASI. In future research, we will apply these insights to a pilot randomized controlled trial to assess the feasibility of comparing the CASI to usual care in a parallel group-randomized efficacy trial.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Usability of a cross-system housing stability program for juvenile courts: A multimethod study of probation counselor perspectives

Abstract:

Background

Youth in contact with the juvenile legal system experience disproportionate rates of homelessness. While system contact is a critical intervening point, juvenile courts do not typically offer housing services. One solution is to refer youth to evidence-based, community-based services to meet housing-related needs, but a myriad of individual and organizational factors often impede court staff from making such referrals. Housing Stability for Youth in Courts (HSYNC) is a novel, cross-system service linkage model for court-involved youth facing housing instability. HSYNC was developed using codesign as a strategy to improve usability and incorporated evidence on juvenile court linkage strategies effective at increasing service referrals and improving outcomes.

Method

The current study utilized a multimethod approach to evaluate the usability of HSYNC from the perspective of juvenile probation counselors (JPCs) as one group of end-users. As part of the pilot implementation study, survey (N = 15) and semi-structured interview (N = 20) data were obtained from JPCs from four juvenile courts in one northwestern state.

Results

Survey results indicated good usability for HSYNC (mean implementation strategy usability scale score of 80). Themes from the interviews complemented survey findings, pointing to HSYNC as a value-added program that integrated well with existing probation practices. The housing navigator's approach was highlighted as a strong facilitator of program usability. Themes also provided greater insight into implementation barriers (i.e., individual and contextual factors) and areas for improvement (e.g., eligibility screening process).

Conclusions

Drivers of program usability and implications for program improvement to address identified implementation challenges to ensure the HSYNC model is effective and sustainable long-term are discussed.

Plain Language Summary

A study examining the key factors impacting successful implementation of a novel housing stability program to address homelessness risk for court-involved youth and their families.
Court-involved youth experience disproportionate rates of homelessness, yet housing services are not traditionally offered by juvenile courts. Court staff, such as probation staff, can refer youth to community-based services to meet their housing needs. Unfortunately, many factors complicate whether these referrals are made, including staff feeling overburdened by other work obligations and uncertainty about whether referring youth to community services fits within their job responsibilities. In this study, we surveyed and interviewed probation staff who were responsible for implementing a new referral-based housing stability program—Housing Stability for Youth in Courts (HSYNC)—to understand whether the program addressed previously identified barriers to referral-making. A unique feature of HSYNC is that there is a dedicated housing navigator, who works as a “linkage specialist” to support probation staff in making referrals while working directly with youth and families to access housing-related services in the community. Our findings suggest that, from the perspective of probation staff, HSYNC is considered to be a user-friendly program that is well-aligned with existing court practices. The housing navigator and their unique approach to working with probation staff, youth, and families was perceived as the strongest facilitator of implementation success; meanwhile, screening for program eligibility was the biggest barrier, pointing to the need for improvement before HSYNC is widely implemented. The persistent intersection of youth housing instability and court involvement calls for better coordination between juvenile courts and community agencies providing housing-related services. From the probation perspective, HSYNC offers a viable solution to meeting youths’ housing needs without creating additional workload burden for court staff.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

The difference-making role of staff support in implementing nurse care management for opioid use disorder treatment: A configurational analysis

Authors:

Theresa E Matson, Amy K Lee, Edward J Miech, Paige D Wartko, Rebecca C Phillps, Mary Shea, Andrea Altschuler, Aimee N C Campbell, Colleen T Labelle, Julia H Arnsten, Jordan M Braciszewski, Joseph E Glass, Viviana E Horigian, Mark T Murphy, Mohammad Zare-Mehrjerdi, and Katharine A Bradley

^{University of Washington affiliated authors are displayed in bold.}

Subscription Required for Full Text Access

Published: February 2025

Read the full text in the subscription access Journal of Substance Use and Addiction Treatment

Treating seizures faster: The quality improvement in time to treat status epilepticus (QuITT-SE) multicenter randomized stepped wedge clinical trial protocol

✪ Implementation Outcomes From a Pilot Study of Mindful Awareness in Body-Oriented Therapy (MABT) as a Chronic Pain Treatment Modality in an Integrative Health Clinic

Abstract:

Background

As regulation of opioid prescribing evolves, primary care and pain clinics are shifting to provide non-pharmacological and interdisciplinary chronic pain care. An under-utilized but growing area of health care for chronic pain is complementary and integrative health (CIH). However, there is limited availability of CIH approaches within the health care system. Mindful Awareness in Body-Oriented Therapy (MABT) is an evidence-based mind-body therapy, with a manualized protocol, that focuses on developing interoceptive sensibility for improved self-awareness and nervous system regulation. Prior MABT research shows MABT improves self-report and physiological indicators of interoception as well as mental and physical symptoms of distress.

Methods

This pilot single-group study used a hybrid implementation-effectiveness design and mixed methods to study implementation strategies and outcomes for bringing MABT into an integrative chronic pain clinic. Administrative data, staff surveys, and focus groups were used to understand the implementation process and outcomes (see Additional files 2, 3, and 4). Descriptive statistics were used to analyze survey and administrative data. A content analysis approach was used to analyze qualitative data from focus groups.

Results

7 staff surveys were administered over the 24-month study period and showed high acceptability and appropriateness that increased over time. Adoption, feasibility, and sustainability were also high. Clinicians made 70 referrals to MABT, 56 patients scheduled a session, 41 patients completed at least one session, and 71% of these completed the protocol. Focus groups identified MABT as a therapy that filled a gap in services, particularly for patients with a lack of body awareness and high emotion dysregulation.

Conclusion

Implementation of MABT was highly successful in an integrative health clinic focused on chronic pain treatment.

ClinicalTrials.gov registration

NCT05289024 Registered March 11, 2022

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Pilot Testing a Digital Transdiagnostic Mental Health Intervention for Use Among Immigrant and Refugee Youth in the USA: A Mixed Methods Evaluation of Clinical and Implementation Outcomes

✪ Healthcare provider perspectives on integrating HIV care into cancer centers in Malawi, South Africa, Uganda, and Zimbabwe

Abstract:

Background

In East and Southern Africa, treatment of people with concomitant cancer and HIV is complicated by siloed service delivery pathways, which exacerbate barriers to care and impact clinical decision-making. Integrating HIV care into cancer treatment centers may improve service delivery and overall patient outcomes.

Methods

We administered a questionnaire to clinicians and support staff at tertiary cancer referral centers in Malawi, Zimbabwe, Uganda, and South Africa to assess level of concern about clinical management of people with HIV (PWH) and cancer, barriers to integrating HIV service delivery into cancer treatment delivery, and beliefs related to HIV, antiretroviral therapy (ART), and integrated care.

Results

Of 195 clinician and support staff participants, 165 (85 %) were direct providers of cancer-associated care. Over 50 % indicated that they held concerns about survival, treatment complications, co-morbidities, and drug-drug interactions in PWH compared to patients without HIV. Over 80 % agreed that knowing cancer patients’ HIV status, ART status, and ART regimen would facilitate better care and should be considered in cancer care decision-making. Overall, respondents were optimistic that HIV-related care could be easily integrated into cancer care provision. The most-frequently endorsed barriers to integrated care were workspace limitations, disruptions to workflow, availability of staff, and cost to the hospital and to patients.

Conclusions

Cancer clinicians and support staff report overall positive attitudes toward integrating HIV and cancer service delivery. Research to elucidate service delivery pathways and contextualize system-based barriers to integrating care are critical next steps to optimize linked HIV and cancer care delivery.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ Implementation research logic model in the design and execution of eHealth innovations for maternal and newborn healthcare in Ethiopia

Abstract:

Background

The use of eHealth innovations is becoming increasingly important in improving health outcomes, especially for maternal and newborn health. However, planning and executing these innovations can be challenging due to their complex nature. To provide guidance and clarity on implementation approaches, researchers need to use implementation research (IR) tools. We conducted IR to recognize the challenges in implementing eHealth innovations in the context of maternal and newborn healthcare using the implementation research logic model (IRLM). Therefore, this paper aims to describe the practical application of IRLM to design, execute and evaluate eHealth innovations that improve maternal and newborn care in public facilities in Ethiopia.

Methods

We employed rapid review, formative assessment and process evaluation of an eHealth innovation in selected healthcare facilities serving maternal and newborn care. The eHealth innovation we developed and deployed was named ‘ADHERE’ (Antenatal Care, ChilDbirtH CarE and Postnatal CaRE), representing the continuum of maternal care. The rapid review was conducted as an initial step using the Consolidated Framework for Implementation Research (CFIR). We employed a mix of data collection methods: interview/discussion, eHealth system or document review and direct observation. Furthermore, we executed various stakeholder engagement activities: two co-creation workshops and on-site iterative discussions. We applied the Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) to capture ongoing implementation learnings.

Results

We developed IRLM of the eHealth innovation implementation for three contexts: urban, peri-urban and remote public healthcare facilities. The model depicted the mechanism of interaction between implementation determinants and implementation strategies to produce the intended implementation outcomes. The IRLM helped to identify more than 35 implementation barriers or facilitators for eHealth interventions and to develop over 17 mitigation strategies for the study contexts. The initial IRLM was refined through ongoing implementation learnings and the mitigation strategies that were executed.

Conclusions

The IRLM is a comprehensive and effective guiding tool for the development, implementation and evaluation of innovations in various low- and middle-income contexts. Researchers and implementing partners should adapt and use it.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

✪ A Team Coaching Intervention for Dementia Care: Acceptability and Feasibility Study in Care Communities

Abstract:

Objectives

In 2018, the Alzheimer's Association published the Dementia Care Practice Recommendations (DCPR) to provide guidance on quality care for professionals. This study aimed to examine the feasibility and acceptability of a consultative coaching program to increase adoption of the DCPR.

Design

A single-group pre-post design was employed. A 6-month team coaching intervention was implemented to make organization-wide and measurable changes in the areas of (1) policies and procedures, (2) education and training, or (3) care practices to increase person-centered care practices.

Setting and Participants

A total of 36 care communities in Washington and Montana states were enrolled in this program.

Methods

Focus groups were conducted with participants to explore the acceptability and feasibility of the program. A 35-item employees satisfaction survey was administered both before and after the program.

Results

The findings offer preliminary evidence that implementing a coaching program is desired by care community staff and has a positive impact on staff job satisfaction and the use of person-centered care. The coaching model was received by staff as a supportive and affirming program.

Conclusions and Implications

The team coaching intervention, designed to improve person-centered care and employee satisfaction, is acceptable. However, its efficacy needs to be tested with a larger sample using a randomized controlled design.

^{**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**}

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Diabetes

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal JMIR Cancer

Abstract:

Background

Objective

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text in the open access journal Implementation Research and Practice

Abstract:

Background

Method

Results

Conclusions

Plain Language Summary

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access Journal of Substance Use and Addiction Treatment

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access journal Contemporary Clinical Trials

Authors:

✪ Open Access

Read the full text in the open access journal Integrative Medicine & Health

Abstract:

Background

Methods

Results

Conclusion

ClinicalTrials.gov registration

Authors:

Subscription Required for Full Text Access

Read the full text in the subscription access Journal of Technology in Behavioral Science

Authors:

✪ Open Access

Read the full text open access in the journal Translational Oncology

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the journal Health Research Policy and Systems

Abstract:

Background

Methods

Results

Conclusions

Authors:

✪ Open Access

Read the full text open access in the Journal of the American Medical Directors Association

Abstract:

Objectives

Design

Setting and Participants

Methods

Results

Conclusions and Implications