Skip to content
Implementation Science at UW

Keywords: Methodology

Health Information Technologies — Academic and Commercial Evaluation (HIT-ACE) methodology: Description and application to clinical feedback systems

Authors:

Aaron R. Lyon, Cara C. Lewis, Abigail Melvin, Meredith Boyd, Semret Nicodimos, Freda F. Liu, Nathaniel Jungbluth

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: September 2016

Read the full text in the open access journal Implementation Science

Abstract:

Background

Health information technologies (HIT) have become nearly ubiquitous in the contemporary healthcare landscape, but information about HIT development, functionality, and implementation readiness is frequently siloed. Theory-driven methods of compiling, evaluating, and integrating information from the academic and commercial sectors are necessary to guide stakeholder decision-making surrounding HIT adoption and to develop pragmatic HIT research agendas. This article presents the Health Information Technologies—Academic and Commercial Evaluation (HIT-ACE) methodology, a structured, theory-driven method for compiling and evaluating information from multiple sectors. As an example demonstration of the methodology, we apply HIT-ACE to mental and behavioral health measurement feedback systems (MFS). MFS are a specific class of HIT that support the implementation of routine outcome monitoring, an evidence-based practice.

Results

HIT-ACE is guided by theories and frameworks related to user-centered design and implementation science. The methodology involves four phases: (1) coding academic and commercial materials, (2) developer/purveyor interviews, (3) linking putative implementation mechanisms to hit capabilities, and (4) experimental testing of capabilities and mechanisms. In the current demonstration, phase 1 included a systematic process to identify MFS in mental and behavioral health using academic literature and commercial websites. Using user-centered design, implementation science, and feedback frameworks, the HIT-ACE coding system was developed, piloted, and used to review each identified system for the presence of 38 capabilities and 18 additional characteristics via a consensus coding process. Bibliometic data were also collected to examine the representation of the systems in the scientific literature. As an example, results are presented for the application of HIT-ACE phase 1 to MFS wherein 49 separate MFS were identified, reflecting a diverse array of characteristics and capabilities.

Conclusions

Preliminary findings demonstrate the utility of HIT-ACE to represent the scope and diversity of a given class of HIT beyond what can be identified in the academic literature. Phase 2 data collection is expected to confirm and expand the information presented and phases 3 and 4 will provide more nuanced information about the impact of specific HIT capabilities. In all, HIT-ACE is expected to support adoption decisions and additional HIT development and implementation research.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**

✪ A Cost-Effectiveness Tool to Guide the Prioritization of Interventions for Rheumatic Fever and Rheumatic Heart Disease Control in African Nations

Authors:

David Watkins, Solomon J. Lubinga, Bongani Mayosi, Joseph B. Babigumira

University of Washington affiliated authors are displayed in bold.

✪ Open Access

Published: August 2016

Read the full text in the open access journal PLOS Neglected Tropical Diseases

Abstract:

Background

Rheumatic heart disease (RHD) prevalence and mortality rates remain especially high in many parts of Africa. While effective prevention and treatment exist, coverage rates of the various interventions are low. Little is known about the comparative cost-effectiveness of different RHD interventions in limited resource settings. We developed an economic evaluation tool to assist ministries of health in allocating resources and planning RHD control programs.

Methodology/Principal Findings

We constructed a Markov model of the natural history of acute rheumatic fever (ARF) and RHD, taking transition probabilities and intervention effectiveness data from previously published studies and expert opinion. Our model estimates the incremental cost-effectiveness of scaling up coverage of primary prevention (PP), secondary prevention (SP) and heart valve surgery (VS) interventions for RHD. We take a healthcare system perspective on costs and measure outcomes as disability-adjusted life-years (DALYs), discounting both at 3%. Univariate and probabilistic sensitivity analyses are also built into the modeling tool. We illustrate the use of this model in a hypothetical low-income African country, drawing on available disease burden and cost data. We found that, in our hypothetical country, PP would be cost saving and SP would be very cost-effective. International referral for VS (e.g., to a country like India that has existing surgical capacity) would be cost-effective, but building in-country VS services would not be cost-effective at typical low-income country thresholds.

Conclusions/Significance

Our cost-effectiveness analysis tool is designed to inform priorities for ARF/RHD control programs in Africa at the national or subnational level. In contrast to previous literature, our preliminary findings suggest PP could be the most efficient and cheapest approach in poor countries. We provide our model for public use in the form of a Supplementary File. Our research has immediate policy relevance and calls for renewed efforts to scale up RHD prevention.

Author Summary

Rheumatic heart disease is a major cause of cardiovascular morbidity and mortality in Africa. Although there are effective medications and surgical procedures for rheumatic heart disease, they are under-used. What is more, these interventions can be expensive—even if they are feasible and effective. Unfortunately, there are currently very few economic studies on rheumatic heart disease, leaving ministries of health with little guidance on how to choose among various interventions and allocate resources to control programs. Our study describes the methods and data we used to develop a cost-effectiveness analysis tool that was intended specifically for decision-making in African countries. In our study, we also illustrate, in a hypothetical low-income African country, how the tool could be used. In our illustrative example, a prevention-oriented approach would save money in the long term, although other interventions could be cost-effective and feasible if enough financial resources were present. These findings contrast with previous studies and make a strong case that rheumatic heart disease prevention could be a high-priority intervention in Africa. We are making our tool publicly available and anticipate that ministries of health will use it as they develop or expand their rheumatic heart disease control programs.

**This abstract is posted with permission under the Creative Commons Attribution 4.0 International License**