Cost-Effectiveness Analysis and Health Care Decisions | Guidelines | AMA Journal of Ethics | AMA Ed Hub [Skip to Content]
[Skip to Content Landing]

How Does Cost-Effectiveness Analysis Inform Health Care Decisions?

Learning Objectives
1. Explain a new or unfamiliar viewpoint on a topic of ethical or professional conduct
2. Evaluate the usefulness of this information for his or her practice, teaching, or conduct
3. Decide whether and when to apply the new information to his or her practice, teaching, or conduct
1 Credit CME
Abstract

Cost-effectiveness analysis (CEA) provides a formal assessment of trade-offs involving benefits, harms, and costs inherent in alternative options. CEA has been increasingly used to inform public and private organizations' reimbursement decisions, benefit designs, and price negotiations worldwide. Despite the lack of centralized efforts to promote CEA in the United States, the demand for CEA is growing. This article briefly reviews the history of CEA in the United States, highlights advances in practice guidelines, and discusses CEA's ethical challenges. It also offers a way forward to inform health care decisions.

Background

Decision makers in health care often face challenging questions. Should clinicians check every adult's blood pressure? Should a health plan's drug formularies cover a new and expensive drug? How should vaccines or treatments be priced in a pandemic? Answers to these questions require careful examination of potential trade-offs involving benefits, harms, and costs associated with policies or health interventions to determine the optimal choice.1

Quiz Ref IDOne approach to aid such decisions is to conduct a cost-effectiveness analysis (CEA) that explicitly quantifies the relative costs and benefits of alternative interventions.2,3 It aims to illuminate the potential trade-offs and inform discussions of whether the additional resources demanded by an intervention (over an alternative) are worth the additional gain in health produced by it.4 A CEA expresses this trade-off using a metric called the incremental cost-effectiveness ratio (ICER).5Quiz Ref IDThe ICER can be regarded as a “price” for an additional unit of health gained through an intervention. Like lower prices, a smaller ratio is more favorable because it implies that an intervention can produce an incremental health gain at a lower cost. ICERs are often compared to a range of predetermined threshold values that reflect the willingness to pay for an additional unit of health gain from the perspective taken. For example, the willingness-to-pay threshold usually ranges from $100 000 to $150 000 per additional unit of health gain measured by quality-adjusted life-years (QALYs) in the United States.68 It implies that if the ICER for the intervention lies below the chosen threshold, it is deemed cost-effective.

Since the 1990s, the number of CEAs has grown substantially, covering a wide range of diseases and interventions.911 In the United States and abroad, many public and private organizations have formally adopted a health technology assessment (HTA) process that uses ICERs to inform reimbursement decisions, benefit designs, and price negotiations.12,13 The rest of this article offers a brief on the use of CEA in US health care, highlights advances in CEA practice guidelines, discusses ethical challenges of using CEA for health care decisions, and suggests a way forward.

Cost-Effectiveness Analysis in the United States

Unlike many other developed countries where CEA has been incorporated into the formal HTA process,11,13 the United States has resisted following suit. Quiz Ref IDOne exception is the use of cost-effectiveness evidence by the Centers for Disease Control and Prevention's Advisory Committee on Immunization Practices to inform national recommendations on immunization policy.14 However, a growing concern about inefficient health care spending has led to the incorporation of value (typically measured by ICERs using QALY as the measure of health gain) into organizations' health care decisions and practice guidelines.15,16 For example, the Institute for Clinical and Economic Review (ironically, with the moniker ICER), a US-based nonprofit organization, applies systematic and evidence-based approaches—including CEAs—to assess the value of various health technologies.7 Medical professional societies and other organizations have also developed practice guidelines incorporating value measured by ICERs, for example.17

Nevertheless, the use of cost-effectiveness evidence to inform health care decisions faces challenges and opposition from policymakers, the drug industry, and patient advocates. Our fragmented health care system with its various key players diminishes the incentive to consider the broader implication of resource allocation decisions.18 Some resistance to CEA pertains to Americans' aversion to rationing and unwillingness to accept limits in the delivery of health care.19,20 Methodological challenges—often based on incomplete evidence (eg, the need to extrapolate clinical trial data beyond follow-up periods), CEA's limited applicability in assessing effectiveness in the real-world setting, and judgment calls made by the analyst—have contributed to the mistrust of results.2022Quiz Ref IDAlthough how well and how widely CEA will be accepted and implemented in the United States remains to be seen, CEA methods have been substantially improved to meet some of these challenges.

Advances in Cost-Effectiveness Analysis

In 1996, the US Public Health Service's Panel on Cost-Effectiveness in Health and Medicine established a reference case analysis, a set of standard methodologies to improve the quality and comparability of CEAs that emphasized using QALY as a health outcome measure and applying a societal perspective.2 A QALY measures the value of health gains as a function of both being alive and the quality of health captured by health-related quality-of-life weight.23 QALYs enable comparison of well-being related to health across patients, diseases, and treatments—a necessary step to inform resource allocation decisions. The panel also endorsed a broader societal perspective because considering everyone affected and counting all benefits and costs, regardless of who gains or loses, can provide the basis for fair decisions in the public interest.2,24 The societal perspective accounts for disease and intervention-related nonhealth impact, including patient time, patient transportation, unpaid caregiver time, productivity loss, and spillover impact on other sectors, such as education.10

Twenty years later, the Second Panel on Cost-Effectiveness in Health and Medicine was convened to provide an updated guideline reflecting methodological advances in evidence synthesis, modeling, uncertainty analysis, and consideration of ethical and distributional issues.3 The table summarizes reference case analyses of the field's major guidelines. One of the second panel's significant updates was the recommendation of 2 reference case analyses: one from a health care sector perspective and another from a societal perspective.25 The second panel recognized that the use of a societal perspective had declined since 2000 while a narrower health care sector or payer perspective persists in most published CEAs.10 The failure to apply a societal perspective might reflect (1) difficulties in defining nonhealth impact (eg, lost productivity or reductions in resource consumption) associated with a particular disease or an intervention, (2) absence of available data to quantify nonhealth impact, and (3) international guidelines that endorse a narrower health care sector or payer perspective, which may better represent the interests of particular budget holders who are not generally concerned about nonhealth impact that falls outside of their budget.

Table. Comparisons of Reference Case Analyses in Cost-Effectiveness Analysis Guidelines

Reference Case Analyses
Elements of analyses1st US Panel (1996)UK NICE reference case (2013)Gates/iDSI reference case (2014)2nd US Panel (2016)ICER value assessment framework (2020)
PerspectiveSocietalNational Health ServiceHealth care sectorSocietal & health care sectorSocietala & health care sectorb
ComparatorsAvailable & feasible options (including existing practice and a do-nothing option, as appropriate)
Measurement of health effectsQALYs gainedQALYs gainedDALYs avertedQALYs gainedQALYs gained & equal value life-years gained
Time horizonLong enough to capture all relevant future consequences (eg, lifetime)
Discountingc3.0%3.5%3.0%3.0%3.0%
EvidenceUse of all relevant evidence (eg, systematic and transparent approach)
Nonhealth impactdShould be includedIf relevant, should be identified and reported separatelyIf relevant, should be identified & reported separatelyShould be includedShould be included in scenario analysis for its modified societal perspective

Nevertheless, the second panel recognized the importance of capturing nonhealth impact that matters to the broader society, recommending that analysts attempt to quantify nonhealth impact and include it in estimates of value (eg, ICER) unless the effect is likely negligible.25 The second panel advised the use of an “impact inventory,” a structured table listing an intervention's health and nonhealth impact, to improve analyses conducted from a societal perspective.25 The structured table can signal to audiences which health and nonhealth effects have been included in or excluded from analyses and whether analyses are likely to under- or overestimate the value of an intervention. For example, when analyzing policy and health interventions related to the COVID-19 pandemic, accounting for nonhealth impact is essential for generating reliable and comprehensive estimates of an intervention's full value.28

Ethical Considerations

There have been a few criticisms on ethical grounds of CEA's use for decision making. These include (1) controversies associated with the use of QALYs, (2) distributive justice, and (3) incomplete valuation. We discuss each of them in detail here. However, it is worth pointing out that cost-effectiveness evidence is only one of many factors considered in resource allocation decisions. We have found that none of the international HTA bodies bases its decisions solely on cost-effectiveness evidence. Therefore, much of CEA's criticisms, fair or not, can be addressed through deliberative processes.29

QALYs.Quiz Ref IDThe lower health utility, or health-related quality of life, assigned to patients with worse health (because of more severe disease, disability, age, and so on) raises distributional issues in using QALYs for resource allocation decisions. For example, because patients with disabilities have a lower overall health utility weight, any extension of their lives by reducing the health burden from one disease “would not generate as many QALYs as a similar extension of life for otherwise healthy people.”30 This distributional limitation arises because of the multiplicative nature of QALYs, which are a product of life-years and health utility weight. Consequently, the National Council on Disability has strongly denounced the use of QALYs.31

Alternatives to QALYs have been proposed. The Institute for Clinical and Economic Review has started using the equal value of life-years gained metric,32 a modified version of the equal value of life (EVL) metric,33 to supplement QALYs. In EVL calculations, any life-year gained is valued at a weight of 1 QALY, irrespective of individuals' health status during the extra year.34 EVL, however, “has had limited traction among academics and decision-making bodies” because it undervalues interventions that extend life-years by the same amount as other interventions but that substantially improve quality of life.30 More recently, a health-years-in-total metric was proposed to overcome the limitations of both QALYs and EVL, but more work is needed to fully understand its theoretical foundations.30

Distributive justice. The second criticism pertains to the fundamental notion that “a QALY is a QALY is a QALY no matter who gets it.”35 Because of this egalitarian notion, the question of whose values shall count for how much raises some ethical issues. For example, should large benefits to a small number of people receive priority over smaller but greater aggregate benefits to a large number of people? Or when should society give priority to treating the sickest or worst off?3640 However, CEA was not meant to address such distributional considerations directly. The Second Panel on Cost-Effectiveness in Health and Medicine emphasized that such distributive considerations also matter to decision makers and are often part of deliberative processes.3,4 Areas of ongoing research include the development of equity weights, which assign numerical values based on considerations other than QALYs (eg, the severity or rarity of the disease), and incorporating social distributions of health (eg, by income or ethnicity) into CEA.4143

Incomplete valuation. The third criticism relates to CEA's consideration (or lack thereof) of certain value elements. Many HTA bodies around the world use CEA from a health care sector perspective and do not incorporate value elements such as productivity, time costs, caregivers' costs, and spillover to other sectors of the society.10 Even in the United States, ICER has not considered these elements formally, although more recently it has allowed for a modified societal perspective as a secondary analysis.7 The Second Panel on Cost-Effectiveness in Health and Medicine, which recommends analyses using both the health care sector perspective and the societal perspective, has laid out the methods for incorporating such value elements.3 Often, lack of data (eg, the effect of a treatment on productive time) precludes analysts from including some of these value elements in the analysis, even though they are generally believed to be important to patients and their caregivers. Although recent advances in measuring these value elements have provided a set of useful resources,44,45 more work is needed to readily incorporate these elements into standard CEA.

Informing Decision Making

Resources to improve health are always limited. It is impossible to provide all the interventions that offer health benefits without sacrificing resources that could be used for other desirable and important goals, such as education. Consequently, whether explicitly or implicitly, some form of prioritization or rationing is unavoidable. Without considering opportunity cost, we would not know whether better use of those resources was possible; choosing an intervention in ignorance of opportunity costs cannot be deemed ethical, either. Although it does not capture all relevant concerns, CEA is a systematic and explicit way of assessing a given decision's opportunity cost.

In the United States, a step forward would be the establishment of a national HTA agency that formally incorporates cost-effectiveness evidence along with other contextual elements, such as distributional concerns and budget impact. With a transparent, scientifically rigorous, and deliberative process of assessing trade-offs among alternative health policies or interventions, such an agency could provide valuable information to better inform resource allocation decisions in health care, including value-based prices for price negotiations.

Sign in to take quiz and track your certificates

The AMA Journal of Ethics exists to help medical students, physicians and all health care professionals navigate ethical decisions in service to patients and society. The journal publishes cases and expert commentary, medical education articles, policy discussions, peer-reviewed articles for journal-based, video CME, audio CME, visuals, and more. Learn more

Successful completion of this CME activity, which includes participation in the evaluation component, enables the participant to earn up to:

1 Medical Knowledge MOC points in the American Board of Internal Medicine's (ABIM) Maintenance of Certification (MOC) program;

1 Self-Assessment points in the American Board of Otolaryngology – Head and Neck Surgery’s (ABOHNS) Continuing Certification program;

1 MOC points in the American Board of Pediatrics’ (ABP) Maintenance of Certification (MOC) program; and

1 Lifelong Learning points in the American Board of Pathology’s (ABPath) Continuing Certification program;

It is the CME activity provider's responsibility to submit participant completion information to ACCME for the purpose of granting MOC credit.

Article Information

AMA Journal of Ethics

AMA J Ethics. 2021;23(8):E639-647.

AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this journal-based CME activity for a maximum of 1.0 AMA PRA Category 1 Credit™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

CME Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships.

If applicable, all relevant financial relationships have been mitigated.

Conflict of Interest Disclosure: Dr Basu received consulting fees through Salutis Consulting, LLC on other projects. No funds were received for the current work. Dr Kim had no conflicts of interest to disclose.

The viewpoints expressed in this article are those of the author(s) and do not necessarily reflect the views and policies of the AMA.

Author Information:

  • David D. Kim, PhD is an assistant professor of medicine at Tufts University School of Medicine and the program director of the Cost-Effectiveness Analysis Registry at Center for the Evaluation of Value and Risk in Health at Tufts Medical Center in Boston, Massachusetts. His research focuses on generating the best available evidence to inform health care decisions and public health policies through policy simulation modeling, cost-effectiveness analyses, and econometric analyses; Anirban Basu, PhD is a professor of health economics and the Stergachis Family Endowed Director of the Comparative Health Outcomes, Policy, and Economics (CHOICE) Institute at the University of Washington in Seattle. His research focuses on understanding the economic value of health care through applied economic theory, comparative and cost-effectiveness analyses, causal inference methods, program evaluation, and outcomes research.

References
1.
Weinstein  MC, Stason  WB.  Foundations of cost-effectiveness analysis for health and medical practices.  N Engl J Med. 1977;296(13):716–721.Google ScholarCrossref
2.
Gold  MR, Siegel  JE, Russell  LB, Weinstein  MC.  Cost-Effectiveness in Health and Medicine. Oxford University Press; 1996.
3.
Neumann  PJ, Sanders  GD, Russell  LB, Siegel  JE, Ganiats  TG.  Cost-Effectiveness in Health and Medicine. 2nd ed. Oxford University Press; 2016.
4.
Neumann  PJ, Sanders  GD.  Cost-effectiveness analysis 2.0.  N Engl J Med. 2017;376(3):203–205.Google ScholarCrossref
5.
Sanders  GD, Maciejewski  ML, Basu  A.  Overview of cost-effectiveness analysis.  JAMA. 2019;321(14):1400–1401.Google ScholarCrossref
6.
Neumann  PJ, Cohen  JT, Weinstein  MC.  Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold.  N Engl J Med. 2014;371(9):796–797.Google ScholarCrossref
7.
Institute for Clinical and Economic Review (ICER).  2020-2023 Value Assessment Framework. January 31 , 2020. Updated October 23, 2020. Accessed June 10, 2021. https://icer.org/wp-content/uploads/2021/03/ICER_2020_2023_VAF_013120-4-2.pdf
8.
Vanness  DJ, Lomas  J, Ahn  H.  A health opportunity cost threshold for cost-effectiveness analysis in the United States.  Ann Intern Med. 2021;174(1):25–32.Google ScholarCrossref
9.
Neumann  PJ, Thorat  T, Shi  J, Saret  CJ, Cohen  JT.  The changing face of the cost-utility literature, 1990-2012.  Value Health. 2015;18(2):271–277.Google ScholarCrossref
10.
Kim  DD, Silver  MC, Kunst  N, Cohen  JT, Ollendorf  DA, Neumann  PJ.  Perspective and costing in cost-effectiveness analysis, 1974-2018.  Pharmacoeconomics. 2020;38(10):1135–1145.Google ScholarCrossref
11.
Pharmacoeconomic guidelines around the world. International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Accessed February 10, 2021. https://tools.ispor.org/peguidelines/
12.
World Health Organization. 2015 global survey on health technology assessment by national authorities. World Health Organization; 2015. Accessed June 10, 2021. https://www.who.int/health-technology-assessment/MD_HTA_oct2015_final_web2.pdf
13.
Kristensen  FB.  Mapping of HTA Methodologies in EU and Norway. Directorate-General for Health and Food Safety, European Commission; June 2017. Accessed June 10, 2021. https://ec.europa.eu/health/sites/default/files/technology_assessment/docs/2018_mapping_methodologies_en.pdf
14.
Leidner  AJ, Chesson  HW, Meltzer  MI, Messonnier  ML, Lee  GM, Prosser  LA. Guidance for health economics studies presented to the Advisory Committee on Immunization Practices (ACIP), 2019 update. Centers for Disease Control and Prevention; 2019. Accessed September 30, 2020. https://www.cdc.gov/vaccines/acip/committee/downloads/Economics-Guidance-for-ACIP-2019.pdf
15.
Garrison  LP  Jr, Neumann  PJ, Willke  RJ,  et al.  A health economics approach to US value assessment frameworks—summary and recommendations of the ISPOR Special Task Force report [7].  Value Health. 2018;21(2):161–165.Google ScholarCrossref
16.
Neumann  PJ, Willke  RJ, Garrison  LP  Jr.  A health economics approach to US value assessment frameworks—introduction: an ISPOR Special Task Force report [1].  Value Health. 2018;21(2):119–123.Google ScholarCrossref
17.
Neumann  PJ, Cohen  JT.  Measuring the value of prescription drugs.  N Engl J Med. 2015;373(27):2595–2597.Google ScholarCrossref
18.
Neumann  PJ.  American exceptionalism and American health care: implications for the US debate on cost-effectiveness analysis. Office of Health Economics briefing 47; March 2019. Accessed July 20, 2021. https://www.ohe.org/system/files/private/publications/321%20-%20Briefing_Neumann.pdf?download=1
19.
Gold  MR, Sofaer  S, Siegelberg  T.  Medicare and cost-effectiveness analysis: time to ask the taxpayers.  Health Aff (Millwood). 2007;26(5):1399–1406.Google ScholarCrossref
20.
Neumann  PJ.  Why don't Americans use cost-effectiveness analysis?  Am J Manag Care. 2004;10(5):308–312.Google Scholar
21.
Eddy  DM.  Clinical decision making: from theory to practice. Cost-effectiveness analysis. Is it up to the task?  JAMA. 1992;267(24):3342–3348.Google ScholarCrossref
22.
Rennie  D, Luft  HS.  Pharmacoeconomic analyses: making them transparent, making them credible.  JAMA. 2000;283(16):2158–2160.Google ScholarCrossref
23.
Neumann  PJ, Cohen  JT.  QALYs in 2018—advantages and concerns.  JAMA. 2018;319(24):2473–2474.Google ScholarCrossref
24.
Russell  LB, Fryback  DG, Sonnenberg  FA.  Is the societal perspective in cost-effectiveness analysis useful for decision makers?  Jt Comm J Qual Improv. 1999;25(9):447–454.Google Scholar
25.
Sanders  GD, Neumann  PJ, Basu  A,  et al.  Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: Second Panel on Cost-Effectiveness in Health and Medicine.  JAMA. 2016;316(10):1093–1103.Google ScholarCrossref
26.
National Institute for Health and Care Excellence.  Guide to the Methods of Technology Appraisal 2013. April 4 , 2013. Accessed October 3, 2020. https://www.nice.org.uk/process/pmg9/resources/guide-to-the-methods-of-technology-appraisal-2013-pdf-2007975843781
27.
Wilkinson  T, Sculpher  MJ, Claxton  K,  et al.  The International Decision Support Initiative reference case for economic evaluation: an aid to thought.  Value Health. 2016;19(8):921–928.Google ScholarCrossref
28.
Kim  DD, Neumann  PJ.  Analyzing the cost effectiveness of policy responses for COVID-19: the importance of capturing social consequences.  Med Decis Making. 2020;40(3):251–253.Google ScholarCrossref
29.
Bond  K, Stiffell  R, Ollendorf  DA.  Principles for deliberative processes in health technology assessment.  Int J Technol Assess Health Care. Published online August 4 , 2020.Google Scholar
30.
Basu  A, Carlson  J, Veenstra  D.  Health years in total: a new health objective function for cost-effectiveness analysis.  Value Health. 2020;23(1):96–103.Google ScholarCrossref
31.
National Council on Disability.  Quality-Adjusted Life Years and the Devaluation of Life With Disability. November 6 , 2019. Accessed February 16, 2021. https://ncd.gov/sites/default/files/NCD_Quality_Adjusted_Life_Report_508.pdf
32.
Institute for Clinical and Economic Review (ICER).  The QALY: rewarding the care that most improves patients' lives.  December 2018. Accessed October 8, 2020. https://icer.org/wp-content/uploads/2020/12/QALY_evLYG_FINAL.pdf
33.
Johannesson  M.  Should we aggregate relative or absolute changes in QALYs?  Health Econ. 2001;10(7):573–577.Google ScholarCrossref
34.
Nord  E, Pinto  JL, Richardson  J, Menzel  P, Ubel  P.  Incorporating societal concerns for fairness in numerical valuations of health programmes.  Health Econ. 1999;8(1):25–39.Google ScholarCrossref
35.
Williams  A.  Cost-effectiveness analysis: is it ethical?  J Med Ethics. 1992;18(1):7–11.Google ScholarCrossref
36.
Brock  DW. Priority to the worse off in health care resource prioritization. In: Rhodes  R, Battin  MP, Silvers  A, eds.  Medicine and Social Justice: Essays on the Distribution of Health Care. Oxford University Press; 2002:362–372.
37.
Rawls  J.  A Theory of Justice. Harvard University Press; 2009.
38.
Nord  E, Johansen  R.  Concerns for severity in priority setting in health care: a review of trade-off data in preference studies and implications for societal willingness to pay for a QALY.  Health Policy. 2014;116(2-3):281–288.Google ScholarCrossref
39.
Nord  E.  The trade-off between severity of illness and treatment effect in cost-value analysis of health care.  Health Policy. 1993;24(3):227–238.Google ScholarCrossref
40.
Kamm  FM.  Morality, Mortality Volume 1: Death and Whom to Save From It. Oxford University Press; 1993.
41.
Asaria  M, Griffin  S, Cookson  R, Whyte  S, Tappenden  P.  Distributional cost-effectiveness analysis of health care programmes—a methodological case study of the UK Bowel Cancer Screening Programme.  Health Econ. 2015;24(6):742–754.Google ScholarCrossref
42.
Verguet  S, Laxminarayan  R, Jamison  DT.  Universal public finance of tuberculosis treatment in India: an extended cost-effectiveness analysis.  Health Econ. 2015;24(3):318–332.Google ScholarCrossref
43.
Cookson  R, Griffin  S, Norheim  OF, Culyer  AJ.  Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs. Oxford University Press; 2020.
44.
Prosser  LA, Wittenberg  E.  Advances in methods and novel applications for measuring family spillover effects of illness.  Pharmacoeconomics. 2019;37(4):447–450.Google ScholarCrossref
45.
Grosse  SD, Pike  J, Soelaeman  R, Tilford  JM.  Quantifying family spillover effects in economic evaluations: measurement and valuation of informal care time.  Pharmacoeconomics. 2019;37(4):461–473.Google ScholarCrossref
Close

Name Your Search

Save Search
Close
Close

Lookup An Activity

or

Close

My Saved Searches

You currently have no searches saved.

Close
Close