[Skip to Content]
[Skip to Content Landing]

How Should Economic Evaluation Be Used to Measure Value and Set Priorities in Health Care?

Learning Objectives
1. Explain a new or unfamiliar viewpoint on a topic of ethical or professional conduct
2. Evaluate the usefulness of this information for health care practice, teaching, or conduct
3. Decide whether and when to apply the new information to health care practice, teaching, or conduct
1 Credit CME
Abstract

Novel interventions that are effective and safe but costly suggest the importance of questions about value, accessibility, and affordability. Economic evaluation is one useful tool that health care systems draw upon to help make investment decisions and set priorities. But translating results from economic evaluations into actionable insights about a novel intervention's value remains elusive, given ethical and practical complexities. This article illuminates 5 key factors to consider in interpretating economic evaluations of novel interventions: the health care decision problem, the design and structure of the mathematical model, characterization of uncertainty, awareness of health outcome measure limitations, and the contrast between optimal decision-making conditions and real-world decision-making conditions.

Economic Evaluation in Health Care

In 2019, the US Food and Drug Administration approved the drug tafamidis as a breakthrough therapy for transthyretin amyloid cardiomyopathy (ATTR-CM) based on a pivotal clinical trial that reported a reduction in all-cause mortality and cardiovascular-associated hospitalizations in patients taking the drug once daily compared with patients who received a placebo over a 30-month follow-up period.1 However, the manufacturer's wholesale acquisition cost of tafamidis was $225 000 for 1 year of therapy, making it the most expensive cardiovascular disease drug launched in the United States.1 Considering the expected substantial clinical benefit of tafamidis, a key question is if it's worth paying this price. Which principles and methods decision makers adhere to in answering this question and in allocating health care resources depends on their preferences about efficiency, equity, universality, and choice.

Economic evaluation is one tool that is widely used to help answer this question.2 In essence, economic evaluation aims to characterize the efficiency of health care interventions: How can finite resources be used to maximize the health gains obtained from them?3 It provides a structured approach to measuring and comparing the health outcomes and costs of competing alternative interventions over time and across populations4; to accounting for individual, payer, or societal preferences; and to characterizing the inherent uncertainty in model choices and in the precision of model inputs. The results of economic analyses inform decision makers of interventions that could improve the return on resources expended in health care.

An independent economic evaluation estimated that lifetime treatment with tafamidis compared to usual care for ATTR-CM had an incremental cost-effectiveness ratio (ICER) of $880 000 per quality-adjusted life-year (QALY) gained. The price would have to be reduced by 92% to make it cost-effective at the conventional $100 000 per QALY threshold.5 How does this conclusion translate into actionable insights on value and priority setting in health care? To understand this process, we will illustrate 5 key factors that should be considered when interpreting economic evaluations to support decision making in health care. First, economic evaluations are based on underlying value judgments about the goal of resource allocation, which determine how such evaluations can be used to address health care decision-making problems. Second, the design and structure of the economic model used will significantly influence the results. Third, the structure of the model and inputs used to populate it create uncertainty that should be characterized. Fourth, generic measures of health, such as QALYs, have limitations that should be understood when used as an outcome measure. Fifth, there are other factors relevant to health care not accounted for in economic evaluations that should be considered by decision makers.

Understanding the Decision Problem

Quiz Ref IDThe theoretical foundation of economic evaluation stems from economic welfare theory, which posits that resource allocation decisions should be assessed based on whether net social welfare is increased.6 Applied to health care, this measure of efficiency—known as allocative efficiency—assesses whether the mix of resources being allocated to health care vs the rest of the economy maximizes benefit.7 Cost-benefit analysis (CBA) can be used to determine whether an intervention provides an overall net welfare gain and to compare this net gain with that from alternative interventions (see Table), including in other sectors of the economy; implementing the intervention with the greatest net gain will increase efficiency.3 However, CBA is not widely used in health care due to conceptual difficulties in placing monetary value on health or life. Quiz Ref IDThe methods widely used in economic evaluation in health care are cost-effectiveness analysis (CEA) and cost-utility analysis (CUA) (see Table), which help assess interventions' productive efficiency in terms of health outcomes gained for a given cost. When interpreting the results from a CEA or CUA, it is important to keep in mind that these analyses cannot indicate whether the amount of health benefits gained from an intervention truly aligns with societal preferences because they cannot compare health care interventions to interventions in other sectors of the economy. In CEA or CUA, a new intervention that is cheaper and more effective than alternatives is deemed more efficient. However, like tafamidis, new interventions that are more effective than alternatives generally cost more, in which case, the decision maker must consider the trade-off between health gained and higher cost compared to alternative interventions. The acceptability of this trade-off, given competing priorities, is a core problem faced by decision makers.

Table. Methods of Economic Evaluation

MethodDescription
Cost-benefit analysisComparison of the costs and outcomes of interventions in monetary terms
Cost-effectiveness analysisComparison of the costs of interventions with a chosen primary outcome (eg, cost per case detected)
Cost-utility analysisComparison of the costs of interventions with quality-adjusted life-years as the outcome measure
Structuring the Decision

The intuition behind using models to inform economic evaluation is that the consequences of diseases might affect people over several years before manifesting as health outcomes, during which time costs of care accrue. For example, an individual diagnosed with heart failure may experience declining quality of life and hospitalizations and die from cardiovascular or noncardiovascular-related causes. A decision maker would be keen to understand how an intervention, such as tafamidis, would alter these disease events and their cost implications, although some stakeholders, such as insurers, might not be interested in long-term outcomes due to a greater focus on short-term budgetary impact assessment. Modeling enables evidence of the consequences and costs of a disease to be combined and extrapolated over time—often the entire lifetime of a person.8

Models, however, are limited by modelers' choices and by data availability. In designing the model, key considerations include the clinical pathways to be included in the model, the availability of data (eg, about the natural history of the disease), and the requisite computational complexity. In addition, the types of health benefits and costs included in the model should be appropriate to the perspective required by the decision maker—eg, the health care system or society. Finally, an important consideration is the representativeness of the clinical data regarding health outcomes. There is evidence to suggest that people of color, women, people with disabilities, and marginalized groups are underrepresented in clinical trials, raising concerns about the applicability of trial findings to these populations.9 In addition, caution should be exercised when models are used to extrapolate outcomes beyond the period of a clinical trial. The evidence used should be appropriate and systematically chosen.

Characterizing Uncertainty

Uncertainty in economic evaluation stems from 2 sources: uncertainty relating to decisions about, and assumptions inherent in, the structure of the model and uncertainty concerning the precision of the inputs used in the model, such as costs, outcomes, and probabilities of disease events.10 Structural uncertainty can be explored by examining how alternative scenarios, such as other plausible disease states, events, and pathways affect the results. Quiz Ref IDParameter uncertainty could be characterized using one-way sensitivity analysis, which involves varying each parameter estimate independently and individually assessing the impact on model results. Additionally, multiway sensitivity analysis could be performed by simultaneously varying more than one parameter (eg, to evaluate model results in a best- or worst-case scenario). More advanced probabilistic approaches such as probabilistic sensitivity analysis (PSA), in which uncertainty is characterized by randomly sampling model input parameters (eg, costs and treatment effects) using Monte Carlo simulations,11 are now standard practice in health economic evaluation. Characterizing uncertainty in this manner, rather than relying on a single point-estimate of cost-effectiveness, helps make economic evaluation more reliable. However, it is important that the full scope of the PSA be reported, such that all the relevant input parameters are assessed and made accessible to stakeholders.

Basing Decisions on QALYs

CUA, wherein the QALY is used as the health outcome measure, is the most widely used method of health economic evaluation. Quiz Ref IDThe QALY combines the quantity of life with health-related quality of life in a single generic composite measure to enable health outcomes to be compared across a range of diseases.12

There are ethical problems in using QALYs that require careful consideration. One central criticism in using QALYs to measure health outcomes is that life-years gained by people in full health through a preventive intervention will be considered more valuable than life-years gained by a person who is chronically ill or disabled, with the result that the cost-effectiveness of an intervention may not align with societal preferences.13 In addition, common instruments used to measure health-related quality of life, such as the EQ-5D questionnaire, may not adequately characterize the nuanced and complex aspects of disabled health states.14 Alternative metrics to address some of the limitations of QALYs have been developed, such as health years in total.15

Perhaps the most controversial aspect of CEA and CUA is the use of the willingness-to-pay (WTP) threshold—a predefined cost per QALY gained above which the intervention would not be considered cost-effective. In practice, it is difficult to accurately identify the outcomes and costs of all interventions in the health care system, so a customary WTP threshold for an additional QALY is assumed as a simplified decision rule. As a result, WTP threshold values have historically lacked an empirical foundation, although implicit thresholds are apparent from the approval decisions of health technology assessment (HTA) bodies.16,17 For example, the HTA body in England does not officially identify a WTP threshold above which it would not recommend an intervention, but an intervention with an ICER per QALY gained above £30 000 is generally unlikely to be recommended unless there are other compelling reasons to do so.18 Similarly, the American College of Cardiology considers an intervention to be of high value if the ICER is less than $50 000 per QALY gained and of low value if the ICER is greater than $150 000 per QALY gained.19Quiz Ref IDTherefore, thresholds should be considered as indicators of efficiency rather than prescriptive rules. There is likely to be broad consensus that an intervention that costs less than $50 000 per QALY gained will be reasonably efficient, but one that costs more than $150 000 will be less so, with exceptions depending on the specific circumstances of the intervention and target population.

Context

Economic evaluation should be viewed as one tool in a decision maker's toolkit to aid pragmatic decision making. Maximizing health gained from available resources should not be the sole objective of a health care system. Other factors that a decision maker must take into account include equity concerns in the allocation of health care resources, need, and societal values.20 For example, although the inverse association between socioeconomic status and health outcomes is well-known,21 economic evaluations generally do not provide information about trade-offs between cost-effectiveness and equity. Even within economic evaluation, countries differ in whether they accept QALYs as a measure of heath gain.22 Economic evaluation should be used and interpreted with a clear understanding of how it can help decision making. It inherently involves generalizations and simplifications, but these assumptions should be made transparent and explicit to ensure that the model used aligns with the requirements of the health care system, which ultimately should aid decision making that reflects societal values and shared priorities for health care.

Sign in to take quiz and track your certificates

The AMA Journal of Ethics exists to help medical students, physicians and all health care professionals navigate ethical decisions in service to patients and society. The journal publishes cases and expert commentary, medical education articles, policy discussions, peer-reviewed articles for journal-based, video CME, audio CME, visuals, and more. Learn more

Article Information

AMA Journal of Ethics

AMA J Ethics. 2021;23(8):E613-618.

AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this journal-based CME activity for a maximum of 1.0 AMA PRA Category 1 Credit™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships.

Conflict of Interest Disclosure: The author(s) had no conflicts of interest to disclose.

The viewpoints expressed in this article are those of the author(s) and do not necessarily reflect the views and policies of the AMA.

Author Information:

  • Sahan Jayawardana, MSc is a health economist in the Department of Health Policy at the London School of Economics and Political Science in England. He has research interests in health care prioritization and financing; Elias Mossialos, MD, PhD is a professor of health policy and the director of LSE Health at the London School of Economics and Political Science in England. He is also a professor of health policy and management at Imperial College London. His research interests include health systems and policy, addressing questions related to health reforms, financing health care, pharmaceutical policies, and the impact of European Union law on health care systems.

References
1.
Gurwitz  JH, Maurer  MS.  Tafamidis—a pricey therapy for a not-so-rare condition.  JAMA Cardiol. 2020;5(3):247–248.Google ScholarCrossref
2.
Hjelmgren  J, Berggren  F, Andersson  F.  Health economic guidelines—similarities, differences and some implications.  Value Health. 2001;4(3):225–250.Google ScholarCrossref
3.
Gray  AM, Clarke  PM, Wolstenholme  JL, Wordsworth  S.  Applied Methods of Cost-Effectiveness Analysis in Health Care. Oxford University Press; 2011.
4.
Weinstein  MC, O'Brien  B, Hornberger  J,  et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices—Modeling Studies.  Value Health. 2003;6(1):9–17.Google ScholarCrossref
5.
Kazi  DS, Bellows  BK, Baron  SJ,  et al.  Cost-effectiveness of tafamidis therapy for transthyretin amyloid cardiomyopathy.  Circulation. 2020;141(15):1214–1224.Google ScholarCrossref
6.
Pearce  DW, Nash  C.  The Social Appraisal of Projects: A Text in Cost-Benefit Analysis. John Wiley & Sons; 1981.
7.
Palmer  S, Torgerson  DJ.  Definitions of efficiency.  BMJ. 1999;318(7191):1136.Google ScholarCrossref
8.
Brennan  A, Chick  SE, Davies  R.  A taxonomy of model structures for economic evaluation of health technologies.  Health Econ. 2006;15(12):1295–1310.Google ScholarCrossref
9.
Geller  SE, Koch  A, Pellettieri  B, Carnes  M.  Inclusion, analysis, and reporting of sex and race/ethnicity in clinical trials: have we made progress?  J Womens Health. 2011;20(3):315–320.Google ScholarCrossref
10.
Bojke  L, Claxton  K, Sculpher  M, Palmer  S.  Characterizing structural uncertainty in decision analytic models: a review and application of methods.  Value Health. 2009;12(5):739–749.Google ScholarCrossref
11.
Hatswell  AJ, Bullement  A, Briggs  A, Paulden  M, Stevenson  MD.  Probabilistic sensitivity analysis in cost-effectiveness models: determining model convergence in cohort models.  Pharmacoeconomics. 2018;36(12):1421–1426.Google ScholarCrossref
12.
MacKillop  E, Sheard  S.  Quantifying life: understanding the history of quality-adjusted life-years (QALYs).  Soc Sci Med. 2018;211:359–366.Google ScholarCrossref
13.
Nord  E, Daniels  N, Kamlet  M.  QALYs: some challenges.  Value Health. 2009;12(suppl 1):S10–S15.Google Scholar
14.
National Council on Disability.  Quality-Adjusted Life Years and the Devaluation of Life With Disability. November 6 , 2019. Accessed January 26, 2021. https://ncd.gov/sites/default/files/NCD_Quality_Adjusted_Life_Report_508.pdf
15.
Basu  A, Carlson  J, Veenstra  D.  Health years in total: a new health objective function for cost-effectiveness analysis.  Value Health. 2020;23(1):96–103.Google ScholarCrossref
16.
Shiroiwa  T, Sung  YK, Fukuda  T, Lang  HC, Bae  SC, Tsutani  K.  International survey on willingness-to-pay (WTP) for one additional QALY gained: what is the threshold of cost effectiveness?  Health Econ. 2010;19(4):422–437.Google ScholarCrossref
17.
Edney  LC, Haji Ali Afzali  H, Cheng  TC, Karnon  J.  Estimating the reference incremental cost-effectiveness ratio for the Australian health system.  Pharmacoeconomics. 2018;36(2):239–252.Google ScholarCrossref
18.
National Institute for Health and Care Excellence.  Guide to the Methods of Technology Appraisal 2013. April 4 , 2013. Accessed April 29, 2021. https://www.nice.org.uk/process/pmg9/resources/guide-to-the-methods-of-technology-appraisal-2013-pdf-2007975843781
19.
Anderson  JL, Heidenreich  PA, Barnett  PG,  et al; ACC/AHA Task Force on Performance Measures; ACC/AHA Task Force on Practice Guidelines.  ACC/AHA statement on cost/value methodology in clinical practice guidelines and performance measures: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures and Task Force on Practice Guidelines.  Circulation. 2014;129(22):2329–2345.Google ScholarCrossref
20.
Dolan  P, Shaw  R, Tsuchiya  A, Williams  A.  QALY maximisation and people's preferences: a methodological review of the literature.  Health Econ. 2005;14(2):197–208.Google ScholarCrossref
21.
Kivimäki  M, Batty  GD, Pentti  J,  et al.  Association between socioeconomic status and the development of mental and physical health conditions in adulthood: a multi-cohort study.  Lancet Public Health. 2020;5(3):e140–e149.Google ScholarCrossref
22.
Torbica  A, Tarricone  R, Drummond  M.  Does the approach to economic evaluation in health care depend on culture, values, and institutional context?  Eur J Health Econ. 2018;19(6):769–774.Google ScholarCrossref
AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this Journal-based CME activity activity for a maximum of 1.00  AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

Successful completion of this CME activity, which includes participation in the evaluation component, enables the participant to earn up to:

  • 1.00 Medical Knowledge MOC points in the American Board of Internal Medicine's (ABIM) Maintenance of Certification (MOC) program;;
  • 1.00 Self-Assessment points in the American Board of Otolaryngology – Head and Neck Surgery’s (ABOHNS) Continuing Certification program;
  • 1.00 MOC points in the American Board of Pediatrics’ (ABP) Maintenance of Certification (MOC) program;
  • 1.00 Lifelong Learning points in the American Board of Pathology’s (ABPath) Continuing Certification program; and
  • 1.00 credit toward the CME [and Self-Assessment requirements] of the American Board of Surgery’s Continuous Certification program

It is the CME activity provider's responsibility to submit participant completion information to ACCME for the purpose of granting MOC credit.

Close
Close
Close
Close

Name Your Search

Save Search
Close
Close

Lookup An Activity

or

My Saved Searches

You currently have no searches saved.

Close

My Saved Courses

You currently have no courses saved.

Close