Cost-effectiveness analysis for clinicians
© Hill; licensee BioMed Central Ltd. 2012
Received: 12 October 2011
Accepted: 1 February 2012
Published: 1 February 2012
In a climate of economic uncertainty, cost effectiveness analysis is a potentially important tool for making choices about health care interventions. Methods for such analyses are well established, but the results need to be interpreted carefully and are subject to bias. Making decisions based on results of cost-effectiveness analyses can involve setting thresholds, but for individual patients, there needs to be disaggregation of benefits and harms included in a quality adjusted life year to ensure appropriate consideration of benefits and harms as well as personal preferences and circumstances.
The current economic news is bad. Expenditure on health care is under scrutiny in every country and with predictions of another economic crash comes pressure on the funding of health care systems - systems that, according to the World Health Organization http://www.who.int/topics/health_systems/en/ are meant to deliver quality service to all people, when and where they need them.
At the same time, new products - pharmaceuticals, diagnostic tests, new technologies - continue to be developed and launched. Health care systems are under pressure to pay for all of the potential hope that these provide, sometimes with good reason, sometimes without. This is where cost-effectiveness analysis comes in.
In 1990, Detsky and Naglie  published one of the first guides to cost-effectiveness analysis for clinicians. As they described it, cost-effectiveness analyses compare the costs and outcomes for a new intervention with an existing alternative treatment, strategy or intervention. The two questions such analyses aim to answer are: how much does the new intervention cost compared with current practice and is it more effective, and if so, how much more? The results of these analyses are presented as additional cost per additional benefit, that is, additional dollars per unit benefit gained. This is the incremental cost effectiveness ratio (ICER). Benefits can be expressed as different outcomes: as change in a physiological or biological unit of measurement (for example, change in glycated hemoglobin (HbA1c)), difference in lives gained (Life Year Gained, LYG), or differences in quality adjusted life years (QALY). The choice of the outcome depends on what data exist that can be used in the evaluation and whether a mathematical model can be developed that simulates the course of the disease or condition and its effect on the quality of life. Inputs into these models are usually derived from multiple sources, including clinical trials, observational studies and routine databases, to name just a few. The degree of uncertainty associated with the primary source of information will contribute to the uncertainty about the results from the model.
The results of cost-effectiveness analyses should provide the same information as that used for making decisions about any purchasing choice in every day life. If a new strategy or potential purchase is more effective and costs less than the currently available option, it is almost certainly worth doing. Likewise, if the new strategy is less effective and more expensive, no one is likely to buy it. However, the more usual outcome of a cost effectiveness analysis of a health technology is that the new technology may be more effective, but costs more. The judgment that then needs to be made is whether the benefit obtained is worth the cost and how certain we can be about that assessment.
A quick literature search suggests that if the number of publications is an indicator of public interest, then answering these questions is a key concern of health care policy makers. A random selection of topics for such analyses range from the evaluation of different strategies for lipid lowering  to the use (or not) of radiological evaluation of bronchiolitis in children ; from the use of surgical options in the treatment of chronic back problems  to the use of pharmacogenetic tests to manage anticoagulation . Health technology assessment authorities, organizations making coverage decisions, and clinical guideline producers are the 'consumers' of these publications. There has been considerable debate about the reliability of the versions published in journals. Udvarhelyi et al.  published one of the first critiques of published cost-effectiveness analyses in 1992, pointing out the problems with published analyses compared to optimal methods and since then many authors have identified problems with bias in evaluations [7–10]. As the analyses are often conducted by commercial entities, the results may favor the product owned by the sponsor [11–15] but there are also more simple problems regarding the calculations. Translating a change in blood pressure into survival gains and then quality adjusting them requires translation, extrapolation and mathematical modeling and can go wrong anywhere in the equations. In the end, the estimate of the size of the effect of the intervention, however expressed, is one of the main determinants of the outcome of the model, so it needs to be examined closely.
To ensure robust analyses and reliable results, those interested in conducting them have defined methods and checklists that specify the gold standard for methods for cost-effectiveness evaluations [16–18]. However, there are still challenges in applying the results of an analysis to decisions. For decisions that apply to a public health care sector, 'thresholds' for 'acceptable' cost-effectiveness estimates, that is, a specified value for the ICER, have been suggested by the World Health Organization (WHO) and used by organizations such as the National Institute for Health and Clinical Excellence (NICE) in the UK, and have also been hotly debated [19–22]. One crucial problem with thresholds is how to set them and how to apply them. Values and preferences of communities are much more difficult to determine or quantify, but may have greater weight in choices about health care, particularly in tax-payer-funded systems.
One challenge in interpreting and applying the results from cost-effectiveness analyses is the difference between the value of an intervention for the population and the value for an individual patient. For a clinician, the response and cost and benefit from a particular intervention for an individual patient may not be well represented by a cost-effectiveness ratio from a population. Ioannidis and Garber  point out that cost-effectiveness estimates, particularly those that express the results as incremental cost per QALY, combine several different outcomes in the 'QALY', including estimates of benefits and harms that may mean quite different things for different individuals. Differences in background health, a person's aversion to risk, or their personal circumstances are likely to have a significant effect on how an individual interprets the tradeoff between benefits, harms and costs, and thus chooses between treatment strategies. The solution suggested by Ioannidis and Garber is to 'individualize' the ICER by presenting a per person benefit in QALYs expressed as days, a 'per person cost' as well as evaluating subgroup responses within populations to allow estimates of variance within the 'average' ICER, to match an individual to a population that may be more or less likely to benefit. It would be interesting to test this approach in real life - personalized medicine based on personalized health economics. A new discipline to develop, to satisfy the needs of individual patients and clinicians, as well as payers and politicians simultaneously!
Methods for cost effectiveness analysis are well established, but published analyses need to be interpreted carefully. For clinicians, disaggregating the benefits and harms incorporated into estimates of QALY may inform judgments about use of health interventions for individual patients.
The author was a staff member of the World Health Organization and is now Chair of the Australian Pharmaceutical Benefits Advisory Committee. She alone is responsible for the views expressed in this publication and they do not necessarily represent the decisions, policy or views of the World Health Organization or the Department of Health and Aging, Australia.
incremental cost effectiveness ratio
life year gained
National Institute for Health and Clinical Excellence
quality adjusted life year
World Health Organization.
- Detsky AS, Naglie IG: A clinician's guide to cost-effectiveness analysis. Ann Intern Med. 1990, 113: 147-154.View ArticlePubMedGoogle Scholar
- Pletcher MJ, Lazar L, Bibbins-Domingo K, Moran A, Rodondi N, Coxson P, Lightwood J, Williams L, Goldman L: Comparing impact and cost-effectiveness of primary prevention: strategies for lipid-lowering. Ann Intern Med. 2009, 150: 243-254.View ArticlePubMedGoogle Scholar
- Yong JHE, Schuh S, Rashidi R, Vanderby S, Lau R, Laporte A, Nauenberg E, Ungar WJ: A cost effectiveness analysis of omitting radiography in diagnosis of acute bronchiolitis. Pediatr Pulmonol. 2009, 44: 122-127. 10.1002/ppul.20948.View ArticlePubMedGoogle Scholar
- North RB, Kidd D, Shipley J, Taylor RS: Spinal cord stimulation versus reoperation for failed back surgery syndrome: a cost effectiveness and cost utility analysis based on a randomized, controlled trial. Neurosurgery. 2007, 61: 361-369. 10.1227/01.NEU.0000255522.42579.EA.View ArticlePubMedGoogle Scholar
- Eckman MH, Rosand J, Greenberg SM, Gage BF: Cost-Effectiveness of using pharmacogenetic information in warfarin dosing for patients with nonvalvular atrial fibrillation. Ann Intern Med. 2009, 150: 73-83.View ArticlePubMedGoogle Scholar
- Udvarhelyi IS, Colditz GA, Rai A, Epstein AM: Cost-effectiveness and cost-benefit analyses in the medical literature. Are the methods being used correctly?. Ann Intern Med. 1992, 116: 238-244.View ArticlePubMedGoogle Scholar
- Friedberg M, Saffran B, Stinson TJ, Nelson W, Bennett CL: Evaluation of conflict of interest in economic analyses of new drugs used in oncology. JAMA. 1999, 282: 1453-1457. 10.1001/jama.282.15.1453.View ArticlePubMedGoogle Scholar
- Hill SR, Mitchell AS, Henry DA: Problems in the conduct of pharmacoeconomic evaluations. JAMA. 2000, 283: 2116-2121. 10.1001/jama.283.16.2116.View ArticlePubMedGoogle Scholar
- Baker CB, Johnsrud MT, Crismon ML, Rosenheck RA, Woods SW: Quantitative analysis of sponsorship bias in economic studies of antidepressants. Br J Psychiatry. 2003, 183: 498-506. 10.1192/bjp.183.6.498.View ArticlePubMedGoogle Scholar
- Garattini L, Koleva D, Casadei G: Modeling in pharmacoeconomic studies: funding sources and outcomes. Int J Technol Assess Health Care. 2010, 26: 330-333. 10.1017/S0266462310000322.View ArticlePubMedGoogle Scholar
- Hartmann M, Knoth H, Schulz D, Knoth S: Industry-sponsored economic studies in oncology vs studies sponsored by nonprofit organisations. Br J Cancer. 2003, 89: 1405-1408. 10.1038/sj.bjc.6601308.PubMed CentralView ArticlePubMedGoogle Scholar
- Garattini L, De Compadri P, Clemente R, Cornago D: Economic evaluations in Italy: a review of the literature. Int J Technol Assess Health Care. 2003, 19: 685-691.View ArticlePubMedGoogle Scholar
- Jang S, Chae YK, Haddad T, Majhail NS: Conflict of interest in economic analyses of aromatase inhibitors in breast cancer: a systematic review. Breast Cancer Res Treat. 2010, 121: 273-279. 10.1007/s10549-010-0870-7.View ArticlePubMedGoogle Scholar
- Polyzos NP, Valachis A, Mauri D, Ioannidis JP: Industry involvement and baseline assumptions of cost-effectiveness analyses: diagnostic accuracy of the Papanicolaou test. CMAJ. 2011, 183: E337-343. 10.1503/cmaj.101506.PubMed CentralView ArticlePubMedGoogle Scholar
- Peura PK, Martikainen JA, Purmonen TT, Turunen JH: Sponsorship-related outcome selection bias in published economic studies of triptans: systematic review. Med Decis Making. 2011.Google Scholar
- Clemens K, Townsend R, Luscombe F, Mauskopf J, Osterhaus J, Bobula J: Methodological and conduct principles for pharmacoeconomic research Pharmaceutical Research and Manufacturers of America. Pharmacoeconomics. 1995, 8: 169-174. 10.2165/00019053-199508020-00008.View ArticlePubMedGoogle Scholar
- Drummond M, Brown R, Fendrick AM, Fullerton P, Neumann P, Taylor R, Barbieri M, ISPOR Task Force: Use of pharmacoeconomics information--report of the ISPOR Task Force on use of pharmacoeconomic/health economic information in health-care decision making. Value Health. 2003, 6: 407-416. 10.1046/j.1524-4733.2003.64245.x.View ArticlePubMedGoogle Scholar
- Drummond MF, Schwartz JS, Jönsson B, Luce BR, Neumann PJ, Siebert U, Sullivan SD: Key principles for the improved conduct of health technology assessments for resource allocation decisions. Int J Technol Assess Health Care. 2008, 24: 244-258. discussion 362-368PubMedGoogle Scholar
- Commission on Macroeconomics and Health. Macroeconomics and health: investing in health for economic development. 2001, Geneva: WHO
- Pearson SD, Rawlins MD: Quality, innovation, and value for money: NICE and the British National Health Service. JAMA. 2005, 294: 2618-2622. 10.1001/jama.294.20.2618.View ArticlePubMedGoogle Scholar
- Appleby J, Devlin N, Parkin D, Buxton M, Chalkidou K: Searching for cost effectiveness thresholds in the NHS. Health Policy. 2009, 91: 239-245. 10.1016/j.healthpol.2008.12.010.View ArticlePubMedGoogle Scholar
- Simoens S, Dooms M: How much is the life of a cancer patient worth? A pharmaco-economic perspective. J Clin Pharm Ther. 2011, 36: 249-256. 10.1111/j.1365-2710.2010.01181.x.View ArticlePubMedGoogle Scholar
- Ioannidis JPA, Garber AM: Individualized cost-effectiveness analysis. PloS Med. 2011, 8: e1001058-10.1371/journal.pmed.1001058.PubMed CentralView ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/10/10/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.