Skip to content

Identifying challenges and recommendations for advancing global mental health implementation research: A key informant study of the National Institute of Mental Health Scale-Up Hubs

Authors:

John A.Naslund, Jasmine Kalha, Juliana L. Restivo, Ishmael Amarreh, Tamora Callands, Hongtu Chen, Carlos Gomez-Restrepo, Hesham M. Hamoda, Arjun Kapoor, Sue Levkoff, Jones Masiye, Maria A. Oquendo, Vikram Patel, Inge Petersen, Ozge Sensoy Bahar, Laura Shields-Zeeman, Fred M. Ssewamala, Deepak Tugnawat, José Miguel Uribe-Restrepo, Lakshmi Vijayakumar, Bradley H. Wagenaar, Milton L.Wainberg, Larry Wissow, Haja Ramatulai Wurie, Chifundo Zimba, & Soumitra Pathare

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: January 2021

Read the full text in the subscription access journal Asian Journal of Psychiatry

Optimizing treatment cascades for mental healthcare in Mozambique: Preliminary effectiveness of the Systems Analysis and Improvement Approach for Mental Health (SAIA-MH)

Authors:

Katrin E. Fabian, Alberto Muanido, Vasco F. J. Cumbe, Nelia Manaca, Leecreesha Hicks, Bryan J. Weiner, Kenneth Sherr, Bradley H. Wagenaar

University of Washington affiliated authors are displayed in bold.

Subscription Required for Full Text Access

Published: November 2020

Read the full text in the subscription access journal Health Policy and Planning

✪ How to evaluate the implementation of complex health programmes in low-income settings: the approach of the Gavi Full Country Evaluations

Authors:

Caroline Soi, Jessica C Shearer, Ashwin Budden, Emily Carnahan, Nicole Salisbury, Gilbert Asiimwe, Baltazar Chilundo, Haribondhu Sarma, Sarah Gimbel, Moses Simuyemba, Jasim Uddin, Felix Masiye, Moses Kamya, Dai Hozumi, Julie K Rajaratnam, and Stephen S Lim

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: November 2020

Read the full text in the open access journal Health Policy and Planning

Abstract:

Vaccination, like most other public health services, relies on a complex package of intervention components, functioning systems and committed actors to achieve universal coverage. Despite significant investment in immunization programmes, national coverage trends have slowed and equity gaps have grown. This paper describes the design and implementation of the Gavi Full Country Evaluations, a multi-country, prospective, mixed-methods approach whose goal was to monitor and evaluate processes, inputs, outputs and outcomes of immunization programmes in Bangladesh, Mozambique, Uganda and Zambia.

We implemented the Full Country Evaluations from 2013 to 2018 with the goal of identifying the drivers of immunization programme improvement to support programme implementation and increase equitable immunization coverage. The framework supported methodological and paradigmatic flexibility to respond to a broad range of evaluation and implementation research questions at global, national and cross-country levels, but was primarily underpinned by a focus on evaluating processes and identifying the root causes of implementation breakdowns. Process evaluation was driven by theories of change for each Gavi funding stream (e.g. Health Systems Strengthening) or activity, ranging from global policy development to district-level programme implementation.

Mixing of methods increased in relevance and rigour over time as we learned to build multiple methods into increasingly tailored evaluation questions. Evaluation teams in country-based research institutes increasingly strengthened their level of embeddedness with immunization programmes as the emphasis shifted over time to focus more heavily on the use of findings for programme learning and adaptation. Based on our experiences implementing this approach, we recommend it for the evaluation of other complex interventions, health programmes or development assistance.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ HIV-exposed infant follow-up in Mozambique: Formative research findings for the design of a cluster randomized controlled trial to improve testing and ART initiation

Authors:

Lúcia Vieira, Arlete Miloque Mahumane, Manuel Napua, Falume Chale, João Luís Manuel, Jessica Greenberg Cowan, Kenneth Sherr, Rachel R. Chapman & James T. Pfeiffer

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: March 2020

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Early infant diagnosis (EID) of HIV-exposed and initiation of HIV-positive infants on anti-retroviral therapy (ART) requires a well-coordinated cascade of care. Loss-to-follow-up (LTFU) can occur at multiple steps and effective EID is impeded by human resource constraints, difficulty with patient tracking, and long waiting periods. The objective of this research was to conduct formative research to guide the development of an intervention to improve the pediatric HIV care cascade in central Mozambique. The study was conducted in Manica and Sofala Provinces where the adult HIV burden is higher than the national average. The research focused on 3 large clinics in each province, along the highly populated Beira corridor.

Methods

The research was conducted in 2014 over 3 months at six facilities and consisted of 1) patient flow mapping and collection of health systems data from postpartum, child-at-risk, and ART service registries, 2) measurement of clinic waiting times, and 3) patient and health worker focus groups.

Results

HIV testing and ART initiation coverage for mothers tends to be high, but EID and pediatric ART initiation are hampered by lack of patient tracking, long waiting times, and inadequate counseling to navigate the care cascade. About 76% of HIV-positive infants were LTFU and did not initiate ART.

Conclusions

Effective interventions to reduce LTFU in EID and improve pediatric ART initiation should focus on patient tracking, active follow-up of defaulting patients, reduction in EID turn-around times for PCR results, and initiation of ART by nurses in child-at-risk services.

Trial registration

Retrospectively registered, ISRCTN67747315, July 24, 2019.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

Cascade Analysis: An Adaptable Implementation Strategy Across HIV and Non-HIV Delivery Platforms

Anjuli D. Wagner, Sarah Gimbel, Kristjana H. Ásbjörnsdóttir, Peter Cherutich, Joana Coutinho, Jonny Crocker, Emiliae Cruz, Fatima Cuembelo, Vasco Cumbe, McKenna Eastment, Jennifer Einberg, Florencia Floriano, Douglas Gaitho, Brandon L. Guthrie, Grace John-Stewart, Alex H. Kral, Barrot H. Lambdin, Shan Liu, Martin Bcom Maina, Nelia Manaca, Mika Matsuzaki, Loris Mattox, Nancy Mburu, R. Scott McClelland, Mark A. Micek, Ana Olga Mocumbi, Albertoe Muanido, Ruth Nduati, Irene N. Njuguna, Geoffrey Oluoch, Laura B. Oyiengo, Keshet Ronen, Caroline Soi, Bradley H. Wagenaar, George Wanje, Lynn D. Wenger, and Kenneth Sherr

University of Washington affiliated authors are displayed in bold.

Published: December 2019

Read the full text in the subscription access JAIDS: Journal of Acquired Immune Deficiency Syndromes

✪ Implementation strategy and cost of Mozambique’s HPV vaccine demonstration project

Authors:

Caroline Soi, Joseph B. Babigumira, Baltazar Chilundo, Vasco Muchanga, Luisa Matsinhe, Sarah Gimbel, Orvalho Augusto & Kenneth Sherr
University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: October 2019

Read the full text in the open access journal BMC Public Health

Abstract:

Background

Cost is an important determinant of health program implementation. In this study, we conducted a comprehensive evaluation of the implementation strategy of Mozambique’s school-based HPV vaccine demonstration project. We sought to estimate the total costs for the program, cost per fully immunized girl (FIG), and compute projections for the total cost of implementing a similar national level vaccination program.

Methods

We collected primary data through document review, participatory observation, and key informant interviews at all levels of the national health system and Ministry of Education. We used a combination of micro-costing methods—identification and measurement of resource quantities and valuation by application of unit costs, and gross costing—for consideration of resource bundles as they apply to the number of vaccinated girls. We extrapolated the cost per FIG to the HPV-vaccine-eligible population of Mozambique, to demonstrate the projected total annual cost for two scenarios of a similarly executed HPV vaccine program.

Results

The total cost of the Mozambique HPV vaccine demonstration project was $523,602. The mean cost per FIG was $72 (Credibility Intervals (CI): $62 - $83) in year one, $38 (CI: $37 - $40) in year two, and $54 CI: $49 - $61) for years one and two. The mean cost per FIG with the third HPV vaccine dose excluded from consideration was $60 (CI: $50 - $72) in year one, $38 (CI: $31 - $46) in year two, and $48 (CI: $42 - $55) for years one and two. The mean cost per FIG when only one HPV vaccine dose is considered was $30 (CI: $27 - $33)) in year one, $19 (CI: $15–$23) in year two, and $24 (CI: $22–$27) for both years. The projected annual cost of a two-and one-dose vaccine program targeting all 10-year-old girls in the country was $18.2 m (CI: $15.9 m - $20.7 m) and $9 m (CI: $8 m - $10 m) respectively.

Conclusion

National adaptation and scale-up of Mozambique’s school-based HPV vaccine strategy may result in substantial costs depending on dosing. For sustainability, stakeholders will need to negotiate vaccine price and achieve higher efficiency in startup activities and demand creation.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Development and Implementation of a Mobile Phone–Based Prevention of Mother-To-Child Transmission of HIV Cascade Analysis Tool: Usability and Feasibility Testing in Kenya and Mozambique

Authors:

Nami Kawakyu, Ruth Nduati, Khátia Munguambe, Joana Coutinho, Nancy Mburu, Georgina DeCastro, Celso Inguane, Andrew Zunt, Neil Abburi, Kenneth Sherr, & Sarah Gimbel

University of Washington affiliated authors are displayed in bold.

Published: March 2019

Read the full text in the open access journal JMIR mHealth and uHealth

Abstract:

Background

Prevention of mother-to-child HIV transmission (PMTCT) care cascade failures drive pediatric HIV infections in sub-Saharan Africa. As nurses’ clinical and management role in PMTCT expand, decision-support tools for nurses are needed to facilitate identification of cascade inefficiencies and solutions. The mobile phone–based PMTCT cascade analysis tool (mPCAT) provides health facility staff a quick summary of the number of patients and percentage drop-off at each step of the PMCTC care cascade, as well as how many women-infant pairs would be retained if a step was optimized.

Objective

The objective of this study was to understand and improve the mPCAT’s core usability factors and assess the health workers’ experience with using the mPCAT.

Methods

Overall, 2 rounds of usability testing were conducted with health workers from 4 clinics and leading experts in maternal and child health in Kenya and Mozambique using videotaped think aloud assessment techniques. Semistructured group interviews gauged the understanding of mPCAT’s core usability factors, based on the Nielsen Usability Framework, followed by development of cognitive demand tables describing the needed mPCAT updates. Post adaptation, feasibility was assessed in 3 high volume clinics over 12 weeks. Participants completed a 5-point Likert questionnaire designed to measure ease of use, convenience of integration into work, and future intention to use the mPCAT. Focus group discussions with nurse participants at each facility and in-depth interviews with nurse managers were also conducted to assess the acceptability, use, and recommendations for adaptations of the mPCAT.

Results

Usability testing with software engineers enabled real-time feedback to build a tool following empathic design principles. The revised mPCAT had improved navigation and simplified data entry interface, with only 1 data entry field per page. Improvements to the results page included a data visualization feature and the ability to share results through WhatsApp. Coding was simplified to enable future revisions by nontechnical staff—critical for context-specific adaptations for scale-up. Health care workers and facility managers found the tool easy to use (mean=4.3), used the tool very often (mean=4.1), and definitely intended to continue to use the tool (mean=4.8). Ease of use was the most common theme identified, with emphasis on how the tool readily informed system improvement decision making.

Conclusions

The mPCAT was well accepted by frontline health workers and facility managers. The collaborative process between software developer and user led to the development of a more user-friendly, context-specific tool that could be easily integrated into routine clinical practice and workflow. The mPCAT gave frontline health workers and facility managers an immediate, direct, and tangible way to use their clinical documentation and routinely reported data for decision making for their own clinical practice and facility-level improvements.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Scaling-up the Systems Analysis and Improvement Approach for prevention of mother-to-child HIV transmission in Mozambique (SAIA-SCALE): a stepped-wedge cluster randomized trial

Authors:

Kenneth Sherr, Kristjana Ásbjörnsdóttir, Jonny Crocker, Joana Coutinho, Maria de Fatima Cuembelo, Esperança Tavede, Nélia Manaca, Keshet Ronen, Felipe Murgorgo, Ruanne Barnabas, Grace John-Stewart, Sarah Holte, Bryan J. Weiner, James Pfeiffer & Sarah Gimbel

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: April 2019

Read the full text in the open access journal Implementation Science

Abstract:

Background

The introduction of option B+ — rapid initiation of lifelong antiretroviral therapy regardless of disease status for HIV-infected pregnant and breastfeeding women — can dramatically reduce HIV transmission during pregnancy, birth, and breastfeeding. Despite significant investments to scale-up Option B+, results have been mixed, with high rates of loss to follow-up, sub-optimal viral suppression, continued pediatric HIV transmission, and HIV-associated maternal morbidity. The Systems Analysis and Improvement Approach (SAIA) cluster randomized trial demonstrated that a package of systems engineering tools improved flow through the prevention of mother-to-child HIV transmission (PMTCT) cascade. This five-step, facility-level intervention is designed to improve understanding of gaps (cascade analysis), guide identification and prioritization of low-cost workflow modifications (process mapping), and iteratively test and redesign these modifications (continuous quality improvement). This protocol describes a novel model for SAIA delivery (SAIA-SCALE) led by district nurse supervisors (rather than research nurses), and evaluation procedures, to serve as a foundation for national scale-up.

Methods

The SAIA-SCALE stepped wedge trial includes three implementation waves, each 12 months in duration. Districts are the unit of assignment, with four districts randomly assigned per wave, covering all 12 districts in Manica province, Mozambique. In each district, the three highest volume health facilities will receive the SAIA-SCALE intervention (totaling 36 intervention facilities). The RE-AIM framework will guide SAIA-SCALE’s evaluation. Reach describes the proportion of clinics and population in Manica province reached, and sub-groups not reached. Effectiveness assesses impact on PMTCT process measures and patient-level outcomes. Adoption describes the proportion of districts/clinics adopting SAIA-SCALE, and determinants of adoption using the Organizational Readiness for Implementing Change (ORIC) tool. Implementation will identify SAIA-SCALE core elements and determinants of successful implementation using the Consolidated Framework for Implementation Research (CFIR). Maintenance describes the proportion of districts sustaining the intervention. We will also estimate the budget and program impact from the payer perspective for national scale-up.

Discussion

SAIA packages user-friendly systems engineering tools to guide decision-making by frontline health workers, and to identify low-cost, contextually appropriate PMTCT improvement strategies. By integrating SAIA delivery into routine management structures, this pragmatic trial is designed to test a model for national intervention scale-up.

Trial Registration

ClinicalTrials.gov NCT03425136 (registered 02/06/2018).

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Implementation science and stigma reduction interventions in low- and middle-income countries: A systematic review

Authors:

Christopher G. Kemp, Brooke A. Jarrett, Churl-Su Kwon, Lanxin Song, Nathalie Jetté, Jaime C. Sapag, Judith Bass, Laura Murray, Deepa Rao & Stefan Baral

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: February 2019

Read the full text in the open access journal BMC Medicine

Abstract:

Background

Interventions to alleviate stigma are demonstrating effectiveness across a range of conditions, though few move beyond the pilot phase, especially in low- and middle-income countries (LMICs). Implementation science offers tools to study complex interventions, understand barriers to implementation, and generate evidence of affordability, scalability, and sustainability. Such evidence could be used to convince policy-makers and donors to invest in implementation. However, the utility of implementation research depends on its rigor and replicability. Our objectives were to systematically review implementation studies of health-related stigma reduction interventions in LMICs and critically assess the reporting of implementation outcomes and intervention descriptions.

Methods

PubMed, CINAHL, PsycINFO, and EMBASE were searched for evaluations of stigma reduction interventions in LMICs reporting at least one implementation outcome. Study- and intervention-level characteristics were abstracted. The quality of reporting of implementation outcomes was assessed using a five-item rubric, and the comprehensiveness of intervention description and specification was assessed using the 12-item Template for Intervention Description and Replication (TIDieR).

Results

A total of 35 eligible studies published between 2003 and 2017 were identified; of these, 20 (57%) used qualitative methods, 32 (91%) were type 1 hybrid effectiveness-implementation studies, and 29 (83%) were evaluations of once-off or pilot implementations. No studies adopted a formal theoretical framework for implementation research. Acceptability (20, 57%) and feasibility (14, 40%) were the most frequently reported implementation outcomes. The quality of reporting of implementation outcomes was low. The 35 studies evaluated 29 different interventions, of which 18 (62%) were implemented across sub-Saharan Africa, 20 (69%) focused on stigma related to HIV/AIDS, and 28 (97%) used information or education to reduce stigma. Intervention specification and description was uneven.

Conclusion

Implementation science could support the dissemination of stigma reduction interventions in LMICs, though usage to date has been limited. Theoretical frameworks and validated measures have not been used, key implementation outcomes like cost and sustainability have rarely been assessed, and intervention processes have not been presented in detail. Adapted frameworks, new measures, and increased LMIC-based implementation research capacity could promote the rigor of future stigma implementation research, helping the field deliver on the promise of stigma reduction interventions worldwide.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ Mentorship and coaching to support strengthening healthcare systems: lessons learned across the five Population Health Implementation and Training partnership projects in sub-Saharan Africa

Authors:

Anatole Manzi, Lisa R. Hirschhorn, Kenneth Sherr, Cindy Chirwa, Colin Baynes, John Koku Awoonor-Williams and the AHI PHIT Partnership Collaborative

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: December 2017

Read the full text in the open access journal BMC Health Services Research

Abstract:

Background

Despite global efforts to increase health workforce capacity through training and guidelines, challenges remain in bridging the gap between knowledge and quality clinical practice and addressing health system deficiencies preventing health workers from providing high quality care. In many developing countries, supervision activities focus on data collection, auditing and report completion rather than catalyzing learning and supporting system quality improvement. To address this gap, mentorship and coaching interventions were implemented in projects in five African countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia) as components of health systems strengthening (HSS) strategies funded through the Doris Duke Charitable Foundation’s African Health Initiative. We report on lessons learned from a cross-country evaluation.

Methods

The evaluation was designed based on a conceptual model derived from the project-specific interventions. Semi-structured interviews were administered to key informants to capture data in six categories: 1) mentorship and coaching goals, 2) selection and training of mentors and coaches, 3) integration with the existing systems, 4) monitoring and evaluation, 5) reported outcomes, and 6) challenges and successes. A review of project-published articles and technical reports from the individual projects supplemented interview information.

Results

Although there was heterogeneity in the approaches to mentorship and coaching and targeted areas of the country projects, all led to improvements in core health system areas, including quality of clinical care, data-driven decision making, leadership and accountability, and staff satisfaction. Adaptation of approaches to reflect local context encouraged their adoption and improved their effectiveness and sustainability.

Conclusion

We found that incorporating mentorship and coaching activities into HSS strategies was associated with improvements in quality of care and health systems, and mentorship and coaching represents an important component of HSS activities designed to improve not just coverage, but even further effective coverage, in achieving Universal Health Care.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**