Skip to content
Implementation Science at UW

Keywords: Organizational Readiness

✪ Can audit and feedback improve health service readiness and delivery outcomes in a low-resource setting? Effectiveness results of the IDEAs strategy from central Mozambique

Authors:

Aneth Dinis, Orvalho Augusto, Quinhas Fernandes, Ermyas Birru, Ruth Etzioni, Sarah Gimbel, Stephen Gloyd, Isaías Ramiro, Artur Gremu, Grace John-Stewart, Bradley H. Wagenaar, Bryan J. Weiner, Sérgio Chicumbe, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: May 2025

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Limited evidence exists on audit and feedback (A&F) in low-resource contexts. We tested the Integrated District Evidence-to-Action (IDEAs), a multicomponent A&F strategy in Mozambique’s maternal and child health (MCH) services. IDEAs include A&F meetings, readiness assessments, and facility support. We report the effectiveness results. IDEAs were implemented in 2016–2020 across two provinces, 12 districts, and 154 primary health facilities in Mozambique. We assessed 1) ten service delivery outcomes across antenatal, maternity, postpartum, childcare, and reproductive health services and 2) five service readiness outcomes (medicines, infrastructure, equipment, care, and staffing availability). We used propensity score matching to minimize bias and a controlled interrupted time series with a negative binomial mixed effects model for service delivery analysis, presenting incidence rate ratios (IRR) with 95% confidence intervals (95% CI). For service readiness outcomes, we created composite scores for each domain and a difference-in-difference analysis using an ordinal mixed effects model, reporting odds ratios (OR) and 95% CI. Significant associations were found with first at-risk child appointments (IRR = 1.06 [1.04, 1.07]), first polymerase chain reaction tests for HIV-exposed children (IRR = 1.02 [1.01, 1.03]), new contraceptive users (IRR = 0.95 [0.94, 0.96]), women starting long-lasting contraceptives (IRR = 0.94 [0.93, 0.95]), availability of infrastructure (OR = 5.84 [1.32, 25.88]) and essential care (OR = 0.13 [0.03, 0.54]). No significant associations were found between IDEAs and six of 10 service delivery outcomes (women with a fourth dose of preventive malaria treatment; women protected with tetanus vaccine; women with four+ antenatal visits; deliveries with active management of the third stage of labor; first postpartum consultations and fully vaccinated children) and on medicine, equipment, and staffing availability. We observed mixed effectiveness in implementing IDEAs, with null and sub-optimal effects suggesting the need to refine and adapt strategy components to more effectively address clinical and readiness outcomes.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Team Coaching Intervention for Dementia Care: Acceptability and Feasibility Study in Care Communities

Authors:

Jessica Welsch, Boeun Kim, Lorna Prophater, Basia Belza, & Sam Fazio

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2024

Read the full text open access in the Journal of the American Medical Directors Association

Abstract:

Objectives

In 2018, the Alzheimer's Association published the Dementia Care Practice Recommendations (DCPR) to provide guidance on quality care for professionals. This study aimed to examine the feasibility and acceptability of a consultative coaching program to increase adoption of the DCPR.

Design

A single-group pre-post design was employed. A 6-month team coaching intervention was implemented to make organization-wide and measurable changes in the areas of (1) policies and procedures, (2) education and training, or (3) care practices to increase person-centered care practices.

Setting and Participants

A total of 36 care communities in Washington and Montana states were enrolled in this program.

Methods

Focus groups were conducted with participants to explore the acceptability and feasibility of the program. A 35-item employees satisfaction survey was administered both before and after the program.

Results

The findings offer preliminary evidence that implementing a coaching program is desired by care community staff and has a positive impact on staff job satisfaction and the use of person-centered care. The coaching model was received by staff as a supportive and affirming program.

Conclusions and Implications

The team coaching intervention, designed to improve person-centered care and employee satisfaction, is acceptable. However, its efficacy needs to be tested with a larger sample using a randomized controlled design.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Strengthening integrated depression services within routine primary health care using the RE-AIM framework in South Africa

Authors:

Inge Petersen, Christopher G. Kemp, Deepa Rao, Bradley H. Wagenaar, Max Bachmann, Kenneth Sherr, Tasneem Kathree, Zamasomi Luvuno, André Van Rensburg, Sithabisile Gugulethu Gigaba, Londiwe Mthethwa, Merridy Grant, One Selohilwe, Nikiwe Hongo, Gillian Faris, Christy-Joy Ras, Lara Fairall, Sanah Bucibo, & Arvin Bhana

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2023

Read the full text in the open access journal PLOS Global Public Health

Abstract:

Integration of mental health into routine primary health care (PHC) services in low-and middle-income countries is globally accepted to improve health outcomes of other conditions and narrow the mental health treatment gap. Yet implementation remains a challenge. The aim of this study was to identify implementation strategies that improve implementation outcomes of an evidence-based depression care collaborative implementation model integrated with routine PHC clinic services in South Africa. An iterative, quasi-experimental, observational implementation research design, incorporating the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework, was applied to evaluate implementation outcomes of a strengthened package of implementation strategies (stage two) compared with an initial evaluation of the model (stage one). The first stage package was implemented and evaluated in 10 PHC clinics and the second stage strengthened package in 19 PHC clinics (inclusive of the initial 10 clinics) in one resource-scarce district in the province of KwaZulu-Natal, South Africa. Diagnosed service users were more likely to be referred for counselling treatment in the second stage compared with stage one (OR 23.15, SE = 18.03, z = 4.04, 95%CI [5.03–106.49], p < .001). Training in and use of a validated, mandated mental health screening tool, including on-site educational outreach and technical support visits, was an important promoter of nurse-level diagnosis rates (OR 3.75, 95% CI [1.19, 11.80], p = 0.02). Nurses who perceived the integrated care model as acceptable were also more likely to successfully diagnose patients (OR 2.57, 95% CI [1.03–6.40], p = 0.043). Consistent availability of a clinic counsellor was associated with a greater probability of referral (OR 5.9, 95%CI [1.29–27.75], p = 0.022). Treatment uptake among referred service users remained a concern across both stages, with inconsistent co-located counselling services associated with poor uptake. The importance of implementation research for strengthening implementation strategies along the cascade of care for integrating depression care within routine PHC services is highlighted.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Enhancing the Introduction and Scale Up of Self-Administered Injectable Contraception (DMPA-SC) in Health Systems (the EASIER Project): Protocol for Embedded Implementation Research

Authors:

Colin Baynes, Petrus S Steyn, Kenneth Sherr, and James Kiarie

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published:August 2023

Read the full text in the open access journal JMIR Research Protocols

Abstract:

Background

The introduction of self-administered injectable contraception presents an opportunity to address the unmet need for family planning. As ministries of health scale up self-administered injectable contraception, there is a scarcity of knowledge on the implementation practices and contextual conditions that help and hinder these efforts. The World Health Organization has launched the “enhancing self-administered family planning through embedded research project” (EASIER) to address this challenge.

Objective

EASIER’s objectives are to: (1) assess the coverage of self-injectable contraception, and the readiness of health systems to integrate it into the contraceptive method mix; (2) document strategies used to introduce and scale up self-injectable contraception and understand practices that have led to success and challenges; (3) identify the contextual factors that affect the adoption and implementation of self-injectable contraception throughout health systems; (4) understand whether implementation addresses users’ preferences and needs; (5) strengthen collaboration between decision makers, researchers, and implementers; support and build capacity to use evidence.

Methods

EASIER developed a global protocol that implementation research (IR) teams in Burkina Faso, Ghana, and Kenya adapted into country-level embedded IR projects. In all countries (1) at the national level, IR teams evaluate the policy environment for scaling up by conducting a desk review and in-depth interviews; (2) at the local level, IR teams implement quantitative questionnaires on structural and organizational readiness to integrate self-injection into the method mix; (3) in “case study” localities, IR teams conduct in-depth interviews and focus group discussions with implementers, method users, and community members; and (4) IR teams use participatory action research to elicit stakeholder participation and translate findings into programmatic decisions.

Results

EASIER has been launched in all 3 countries. Preliminary findings are available from Burkina Faso and Kenya. In Burkina Faso, IR teams identified the need to strengthen health worker training approaches to ensure that family planning providers at primary health care facilities are adequately oriented to depo-medroxyprogesterone acetate subcutaneous (DMPA-SC) and self-injection and capacitated to initiate women to the method. In addition, they report the need for service communication strategies that reach potential users of the method with knowledge about self-injection and how to initiate the practice. In Kenya, the findings illuminate the need for practice guidelines that county health teams can use to coordinate the rollout of self-administered DMPA-SC. In addition, Kenya’s findings underscore the importance of addressing logistical bottlenecks to help avoid stock-outs.

Conclusions

EASIER presents a strategy to embed IR in contraceptive method introduction and scale-up, address local knowledge needs, devise ways to maximize the impact of new technologies in health systems, and build capacity for using evidence in programmatic decisions. Adaptation and implementation of country-level IR studies will advance the use of IR to strengthen family planning programs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Structural readiness to implement community-wide mass drug administration programs for soil-transmitted helminth elimination: results from a three-country hybrid study

Authors:

Arianna Rubin Means, Elizabeth Orlan, Marie-Claire Gwayi-Chore, Angelin Titus, Saravanakumar Puthupalayam Kaliappan, Comlanvi Innocent Togbevi, Félicien Chabi, Katherine E. Halliday, Providence Nindi, Euripide Avokpaho, Khumbo Kalua, Moudachirou Ibikounlé, Sitara S. R. Ajjampur, Bryan J. Weiner, Judd L. Walson, & Kumudha Aruldas

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: July 2021

Read the full text in the open access journal Implementation Science Communications
BACK TO THE ARCHIVE

Abstract:

Background

Current soil-transmitted helminth (STH) control programs target pre-school and school-age children with mass drug administration (MDA) of deworming medications, reducing morbidity without interrupting ongoing transmission. However, evidence suggests that STH elimination may be possible if MDA is delivered to all community members. Such a change to the STH standard-of-care would require substantial systems redesign. We measured baseline structural readiness to launch community-wide MDA for STH in Benin, India, and Malawi.

Methods

After field piloting and adaptation, the structural readiness survey included two constructs: Organizational Readiness for Implementing Change and Organizational Capacity for Change. Sub-constructs of organizational readiness include change commitment and change efficacy. Sub-constructs of organizational capacity include flexibility, organizational structure, and demonstrated capacity. Survey items were also separately organized into seven implementation domains. Surveys were administered to policymakers, mid-level managers, and implementers in each country using a five-point Likert scale. Item, sub-construct, construct, and domain-level medians and interquartile ranges were calculated for each stakeholder level within each country.

Results

Median organizational readiness for change scores were highest in Malawi (5.0 for all stakeholder groups). In India, scores were 5.0, 4.0, and 5.0 while in Benin, scores were 4.0, 3.0, and 4.0 for policymakers, mid-level managers, and implementers, respectively. Median change commitment was equal to or higher than median change efficacy across all countries and stakeholder groups.

Median organizational capacity for change was highest in India, with a median of 4.5 for policymakers and mid-level managers and 5.0 for implementers. In Malawi, the median capacity was 4.0 for policymakers and implementers, and 3.5 for mid-level managers. In Benin, the median capacity was 4.0 for policymakers and 3.0 for mid-level managers and implementers. Median sub-construct scores varied by stakeholder and country.

Across countries, items reflective of the implementation domain ‘policy environment’ were highest while items reflective of the ‘human resource’ domain were consistently lower.

Conclusion

Across all countries, stakeholders valued community-wide MDA for STH but had less confidence in their collective ability to effectively implement it. Perceived capacity varied by stakeholder group, highlighting the importance of accounting for multi-level stakeholder perspectives when determining organizational preparedness to launch new public health initiatives.

Trial registration

NCT03014167

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Mapping the organizational readiness to change assessment to the Consolidated Framework for Implementation Research

Authors:

Jennifer Kononowech, Hildi Hagedorn, Carmen Hall, Christian D. Helfrich, Anne C. Lambert-Kerzner, Susan C. Miller, Anne E. Sales, & Laura Damschroder

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2021

Read the full text in the open access journal Implementation Science Communications

Abstract:

Background

Implementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.

Methods

Two distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.

Results

ORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.

Conclusions

Mapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Implementing Goals-of-Care Conversations: Lessons From High- and Low-Performing Sites From a VA National Initiative

Authors:

Cati Brown-Johnson, Marie C Haverfield, Karleen F Giannitrapani, Natalie Lo, Jill S Lowery, Mary Beth Foglia, Anne M Walling, David B Bekelman, Scott T Shreve, Lisa Soleymani Lehmann, Karl A Lorenz

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: February 2020

Read the full text in the subscription access Journal of Pain and Symptom Management

✪ Systems analysis and improvement approach to optimize the hypertension diagnosis and care cascade for PLHIV individuals (SAIA-HTN): A hybrid type III cluster randomized trial

Authors:

Sarah Gimbel, Ana Olga Mocumbi, Kristjana Ásbjörnsdóttir, Joana Coutinho, Leonel Andela, Bonifacio Cebola, Heidi Craine, Jonny Crocker, Leecreesha Hicks, Sarah Holte, Rodrigues Hossieke, Edgar Itai, Carol Levin, Nelia Manaca, Filipe Murgorgo, Miguel Nhumba, James Pfeiffer, Isaias Ramiro, Keshet Ronen, Nona Sotoodehnia, Onei Uetela, Anjuli Wagner, Bryan J. Weiner, & Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal Implementation Science

Abstract:

Background

Across sub-Saharan Africa, evidence-based clinical guidelines to screen and manage hypertension exist; however, country level application is low due to lack of service readiness, uneven health worker motivation, weak accountability of health worker performance, and poor integration of hypertension screening and management with chronic care services. The systems analysis and improvement approach (SAIA) is an evidence-based implementation strategy that combines systems engineering tools into a five-step, facility-level package to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). As hypertension screening and management are integrated into chronic care services in sub-Saharan Africa, an opportunity exists to test whether SAIA interventions shown to be effective in improving efficiency and coverage of HIV services can be effective when applied to the non-communicable disease services that leverage the same platform. We hypothesize that SAIA-hypertension (SAIA-HTN) will be effective as an adaptable, scalable model for broad implementation.

Methods

We will deploy a hybrid type III cluster randomized trial to evaluate the impact of SAIA-HTN on hypertension management in eight intervention and eight control facilities in central Mozambique. Effectiveness outcomes include hypertension cascade flow measures (screening, diagnosis, management, control), as well as hypertension and HIV clinical outcomes among people living with HIV. Cost-effectiveness will be estimated as the incremental costs per additional patient passing through the hypertension cascade steps and the cost per additional disability-adjusted life year averted, from the payer perspective (Ministry of Health). SAIA-HTN implementation fidelity will be measured, and the Consolidated Framework for Implementation Research will guide qualitative evaluation of the implementation process in high- and low-performing facilities to identify determinants of intervention success and failure, and define core and adaptable components of the SAIA-HTN intervention. The Organizational Readiness for Implementing Change scale will measure facility-level readiness for adopting SAIA-HTN.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by front-line health workers to identify low-cost, contextually appropriate chronic care improvement strategies. By integrating SAIA into routine hypertension screening and management structures, this pragmatic trial is designed to test a model for national scale-up.

Trial registration

Registered 09/13/2019; NCT04088656).

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**