This article has Open Peer Review reports available.
Benefit-harm analysis and charts for individualized and preference-sensitive prevention: example of low dose aspirin for primary prevention of cardiovascular disease and cancer
© Puhan et al. 2015
Received: 3 February 2015
Accepted: 17 September 2015
Published: 1 October 2015
Clinical practice guidelines provide separate recommendations for different diseases that may be prevented or treated by the same intervention. Also, they commonly provide recommendations for entire populations but not for individuals. To address these two limitations, our aim was to conduct benefit-harm analyses for a wide range of individuals using the example of low dose aspirin for primary prevention of cardiovascular disease and cancer and to develop Benefit-Harm Charts that show the overall benefit-harm balance for individuals.
We used quantitative benefit-harm modeling that included 16 outcomes to estimate the probability that low dose aspirin provides more benefits than harms for a wide range of men and women between 45 and 84 years of age and without a previous myocardial infarction, severe ischemic stroke, or cancer. We repeated the quantitative benefit-harm modeling for different combinations of age, sex, and outcome risks for severe ischemic and hemorrhagic stroke, myocardial infarction, cancers, and severe gastrointestinal bleeds. The analyses considered weights for the outcomes, statistical uncertainty of the effects of aspirin, and death as a competing risk. We constructed Benefit-Harm Charts that show the benefit-harm balance for different combinations of outcome risks.
The Benefit-Harm Charts (http://www.benefit-harm-balance.com) we have created show that the benefit-harm balance differs largely across a primary prevention population. Low dose aspirin is likely to provide more benefits than harms in men, elderly people, and in those at low risk for severe gastrointestinal bleeds. Individual preferences have a major impact on the benefit-harm balance. If, for example, it is a high priority for individuals to prevent stroke and severe cancers while severe gastrointestinal bleeds are deemed to be of little importance, the benefit-harm balance is likely to favor low dose aspirin for most individuals. Instead, if severe gastrointestinal bleeds are judged to be similarly important compared to the benefit outcomes, low dose aspirin is unlikely to provide more benefits than harms.
Benefit-Harm Charts support individualized benefit-harm assessments and decision making. Similarly, individualized benefit-harm assessments may allow guideline developers to issue more finely granulated recommendations that reduce the risk of over- and underuse of interventions. The example of low dose aspirin for primary prevention of cardiovascular disease and cancer shows that it may be time for guideline developers to provide combined recommendations for different diseases that may be prevented or treated by the same intervention.
Consider a 60-year-old woman who comes to her general practitioner’s office and asks if she should take a low dose aspirin to prevent myocardial infarction (MI) or cancer. She has never had a cardiovascular event or cancer before, eats vegetables regularly, and is physically active. But she is a smoker, takes antihypertensive medication (current systolic blood pressure of 145 mmHg), has total cholesterol of 170 mg/dL, and HDL cholesterol of 55 mg/dL. The general practitioner determines the 10-year risks for both an MI  and stroke to be around 6 %  and for colorectal cancer to be around 2 % . Uncertain about what to recommend to the patient, the general practitioner consults some guidelines on primary prevention of cardiovascular disease (CVD) and cancer.
Selected recommendations on low dose aspirin for primary prevention of CVD and colorectal cancer
Recommendation and assumptions made
European Society of Cardiology 
Aspirin or clopidogrel cannot be recommended in individuals without cardiovascular or cerebrovascular disease due to the increased risk of major bleeding. (Class of recommendation III = is not recommended; level of evidence weak)
No details on assumptions or on how benefit-harm assessment was done
World Health Organization 
− Coronary heart disease 10-year risk <10 %. For individuals in this risk category, the harm caused by aspirin treatment outweighs the benefits. Aspirin should not be given to individuals in this low-risk category. (1++, A)
− Coronary heart disease 10-year risk 10 to <20 %. For individuals in this risk category, the benefits of aspirin treatment are balanced by the harm caused. Aspirin should not be given to individuals in this risk category. (1++, A)
− Coronary heart disease 10-year risk 20 to <30 %. For individuals in this risk category, the balance of benefits and harm from aspirin treatment is not clear. Aspirin should probably not be given to individuals in this risk category. (1++, A)
− Coronary heart disease 10-year risk ≥30 %. Individuals in this risk category should be given low dose aspirin. (1++, A)
No details on assumptions or on how benefit-harm assessment was done.
US Preventive Services Task Force 
Encourage men age 45 to 79 years to use aspirin when the potential benefit of a reduction in MI outweighs the potential harm of an increase in gastrointestinal hemorrhage. (“A” recommendation)
The reduction in MI outweighs the potential harm of an increase in gastrointestinal hemorrhage:
− 45–59 year old if ≥4 % 10-year risk of coronary heart disease
− 60–69 year old if ≥9 % 10-year risk of coronary heart disease
− 70–79 year old if ≥12 % 10-year risk of coronary heart disease
Assumptions for benefit-harm assessment:
− Equal weights given to coronary heart disease, gastrointestinal hemorrhage, and hemorrhagic stroke
− 10-year risk for coronary heart disease considered from 0–20 %
− Average risk per age category considered gastrointestinal hemorrhage and hemorrhagic stroke
− Ischemic stroke not considered
− No competing risks considered
US Preventive Services Task Force 
The USPSTF recommends against the routine use of aspirin and nonsteroidal anti-inflammatory drugs to prevent colorectal cancer in individuals at average risk for colorectal cancer.
This vignette illustrates the challenge of making (preventive) treatment recommendations for individuals and the disagreement among guidelines. In recent years, advancements were made in the development of evidence-based clinical practice guidelines. Major guideline developers and groups like the USPSTF or the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group strongly advocate to first systematically review the evidence on the benefits and harms of interventions and, in a second and separate step, to develop recommendations in a transparent way [8, 9]. Nevertheless, even if guidelines are based on high-quality systematic reviews and meta-analyses and follow GRADE or similar guidance, clinical practice guidelines and regulatory agencies sometimes disagree, as the example of low dose aspirin for cardiovascular primary prevention shows (Table 1) [6, 10, 11].
There are reasons for such disagreement among guidelines. Although many guidelines are now based on systematic reviews, few guideline developers use quantitative methods to estimate the benefit-harm balance of interventions [12, 13]. Also, drawing conclusions and issuing population-level recommendations just based on systematic reviews are problematic for some clinical questions, such as aspirin for cardiovascular primary prevention, because population-level recommendations are based on average outcome risks and do not reflect preferences of individuals [14–16], which may lead to over- and undertreatment [17, 18]. This may contribute to the generally rather low adherence to guidelines, along with other factors that make the transfer of knowledge into practice challenging [19, 20].
Compared to guidelines that make recommendations for entire populations, would it not be preferable to have treatment recommendations that are individualized through a patient’s own risks and preferences? And would it not be preferable to have more holistic guidelines on preventative measures that have an impact on more than one disease?
Typically, recommendations are organized separately by disease or medical specialty, and the USPSTF is currently developing or updating its three (separate) guidelines on aspirin for primary prevention of cardiovascular, disease, colorectal cancer, and other cancers . Some have already argued that it may be time to move to guidelines that span across different diseases, which may be prevented by a common preventative measure such as aspirin . To address these two limitations, our aim was to conduct benefit-harm analyses for a wide range of individuals using the example of low dose aspirin for primary prevention of CVD and cancer and to develop Benefit-Harm Charts that show the overall benefit-harm balance for individuals.
Selection of approach for benefit and harm assessment
We outlined a selection process for choosing a particular approach for a quantitative assessment of benefits and harms to illustrate benefit-harm balance in our previous work [23–25]. For this study, we selected the Gail/National Cancer Institute (NCI) approach as the multidimensional approach because it can consider risks of multiple benefit and harm outcomes, treatment effects on these risks, competing risks, and importance of outcomes (determined by patient outcome preferences, and when not available, by survival rates (for example, 5-year survival) and it summarizes all information in a number (benefit-harm index) . This approach also provides a probability of net benefit, which captures major sources of informational uncertainty (see also the section on statistical analysis). In prior work , we compared this approach to the number needed to treat (NNT) approach, which is a well-known and established approach, and showed the Gail/NCI approach’s superiority in situations where there is more than an average benefit and an average harm outcome and where there are competing risks (such as death from other causes).
Selection of data sources
For a quantitative benefit-harm assessment, several sources of evidence on treatment effects, risks of outcomes, and preferences for these outcomes are needed. We selected the following data sources:
a) Treatment effects: We used a recently updated meta-analysis of nine RCTs for the effect estimates of aspirin for primary prevention on the outcomes of MI and severe ischemic stroke (benefit outcomes) and on severe hemorrhagic stroke and severe GI bleeds . The pooled relative risk for aspirin versus placebo was 0.86 (95 % confidence interval 0.74,1.00) for MI, 0.87 (0.73,1.02) for severe ischemic stroke, 1.35 (1.01,1.81) for severe hemorrhagic stroke, and 1.62 (1.31,2.00) for severe GI bleeds. We assumed a homogeneous treatment effect across the male and female populations since current evidence does not suggest heterogeneity of (relative) treatment effects . A previous meta-analysis by the same authors formed the basis of recommendations of the most recent USPSTF statement on the benefits and harms of aspirin for cardiovascular primary prevention [6, 27].
For cancers, we used the summary measures of a meta-analysis of RCTs that assessed the effect of aspirin on long-term cancer incidence . The pooled relative risk for aspirin versus placebo was 0.58 (0.44,0.78) for colorectal cancer, 0.55 (0.23,1.34) for biliary cancer, 0.51 (0.31,0.83) for esophageal cancer, 0.77 (0.49,1.22) for gastric cancer, 1.17 (0.50,2.71) for breast cancer, 0.84 (0.69,1.03) for lung cancer, 0.77 (0.59,1.01) for prostate cancer, 0.92 (0.66,1.29) for hematological cancer, 0.91 (0.59,1.40) for pancreatic cancer, 0.91 (0.54,1.51) for bladder cancer, 1.04 (0.40,2.73) for gynecological cancer, and 0.88 (0.48,1.61) for renal cancer. Some of the 95 % confidence intervals were wide and crossed 1.0 and the statistical models considered such statistical uncertainty.
b) Outcome risks: We stratified the analyses for men and women and four age categories since these two variables have a substantial effect on the risks of the outcomes and on all-cause death as a competing risk. We considered five risk categories both for MI and severe GI bleeds while we used age- and sex-specific outcome risks (that is, only one risk per age and sex category) for all other outcomes (severe ischemic stroke , hemorrhagic stroke , 12 different cancers , and death ). For each of the resulting combinations of outcome risks (2sex *4age *5MI *5gastrointestinal bleeds = 200) we repeated the benefit-harm analyses.
Weights assigned to outcomes included in the benefit-harm analyses of low dose aspirin for primary prevention of cardiovascular disease and colorectal cancer
Myocardial infarction 
Ischemic stroke 
Hemorrhagic stroke 
Gastrointestinal bleeds 
45.5 % (3-year)
Colorectal cancer 
Biliary cancer 
Esophageal cancer 
Gastric cancer 
Breast cancer 
Lung cancer 
Prostate cancer 
Hematological cancer 
48.5 –85.8 %
Pancreatic cancer 
Bladder cancer 
Gynecological cancer 
45.8 –81.6 %
Renal cancer 
For each of the combinations of outcome risks we used the Gail/NCI approach to estimate the benefit-harm balance. We first calculated the number of expected events (N) without aspirin for each of the 16 outcomes per 10,000 subjects over 10 years based on an exponential model that assumed a constant hazard rate over 10 years and adjusted for competing risks (here all-cause death). We then calculated the corresponding number of events with aspirin prevention, taking into account the treatment effects of aspirin from the meta-analysis. We calculated the difference in events between individuals with and without taking aspirin as an absolute measure of the preventive effect. We then calculated the benefit-harm index as the sum of differences in events for each outcome using the weights described above. To take into consideration the statistical uncertainty of the estimates for the treatment effects of aspirin, we performed simulations with 100,000 repetitions where we modeled treatment effects (log relative risk) using a normal distribution and obtained the probability that aspirin is beneficial as the proportion of index estimates (out of the 100,000 repetitions) that are positive [17, 38]. We assumed that outcome risks for MI and severe GI bleeds follow a uniform distribution within each risk category. We did not consider that aspirin may be discontinued after the occurrence of a bleed. As explained above, we repeated this analysis 200 times (that is, 200 simulations with 100,000 repetitions each) in order to get estimates of the benefit-harm balance for each of the 200 combinations of risk profiles. The simulations were done using R statistical software version 3.0.1 , and the codes are available on request. It took 25 s to run one simulation (100,000 repetitions for one combination of outcome risks) on a standard laptop (HP EliteBook 840).
Construction of Benefit-Harm Charts
Similar to cardiovascular risk prediction charts, we constructed, for men and women separately, charts that inform individuals directly about the benefit-harm balance of aspirin [http://www.benefit-harm-balance.com]. We converted the probabilities that aspirin is net-beneficial for each of the combinations of outcome risks into a traffic light scheme. For results where ≥60 % of the 100,000 repetitions yielded a positive index (indicating that aspirin has a positive benefit-harm balance), we used the color green to indicate that the benefits of aspirin are likely to outweigh the harms. Accordingly, we used orange for results where 40—60 % of the 100,000 repetitions yielded a positive index (to indicate some uncertainty because the index is around 0) and red for results where <40 % of the 100,000 repetitions yielded a positive index (indicating that the benefit-harm balance is likely negative). The benefit-harm charts could include many more combinations of outcome risks (for example, for stroke and cancers), but we decided, for the sake of usability, to restrict the benefit-harm charts to stratification by sex, age, and 10-year risks of MI and severe GI bleeds. But even if not represented visually, all analyses included age- and sex-specific outcome risks for ischemic stroke, hemorrhagic stroke, the 12 cancers, and death, as explained above.
Illustrations of the Benefit-Harm Charts
Benefit-Harm Charts for women and men taking aspirin for primary prevention of CVD and cancer
In this article, we conducted quantitative benefit-harm assessments of low dose aspirin for primary prevention of cardiovascular disease and cancer and we introduced our Benefit-Harm Charts that visualize the results for individuals. Our approach shows how two current limitations of guidelines on low dose aspirin, that is, separate recommendations for cardiovascular disease and cancer and population-based rather than more granulated recommendations, could be overcome. Besides the large impact of age and sex, the Benefit-Harm Charts show that individuals will derive a certain net benefit from aspirin depending not only on the risk for cardiovascular disease and severe GI bleeds but also on the importance attributed to different benefit and harm outcomes. The Benefit-Harm Charts may support policy and guideline developers and also regulatory agencies in making more finely granulated recommendations and decisions. In addition, the Benefit-Harm Charts can inform questions across diseases that share a common preventive or therapeutic intervention. Patients and physicians may be able to make individualized treatment decisions based on combinations of outcome risks and preferences.
Going beyond the simple approaches for benefit-harm assessment
Estimating the benefit-harm balance is challenging for many health care decisions because so many factors need to be considered. Currently physicians and individuals have to either simplify the task and use approaches like the numberneeded totreat or number needed to harm or not use a quantitative approach to assess benefit-harm balance at all. Table 1 shows how guidelines result in different recommendations when using a simplified or no approach to estimate the benefit-harm balance. In contrast, comprehensive quantitative benefit-harm assessments that consider all relevant factors that have an impact on the benefit-harm balance allow for testing the impact of different assumptions (such as preferences) on the benefit-harm balance. To bridge the gap between population-based estimates of the benefit-harm balance (that focus on very few and averaged combinations of outcome risks) and individual preventive counseling, quantitative benefit-harm assessments can be repeated thousands of times for any possible risk profile and preferences for outcomes, and the results can be visualized through Benefit-Harm Charts. Based on Benefit-Harm Charts it becomes easier to issue more nuanced recommendations that reduce over- and underuse of interventions. Such an approach could address the current lack of systematic and transparent approaches to estimate the balance of benefits and harms during the development of many guidelines and reduce disagreement among guidelines .
However, some simplifications are currently necessary when Benefit-Harm Charts are developed. For example, we repeated the benefit-harm analyses “just” for women and men and for four age categories and 25 combinations of outcome risks for MI and GI bleeds (thus 2*4*25 = 200 different profiles). Thus we simplified this second step by not repeating the analyses for any combination of the 16 outcome risks but just for combinations of sex, age, and outcome risks for MI and severe GI bleeds, all of which have a substantial impact on the benefit-harm balance of aspirin. For a visual and real-time display (as on [http://www.benefit-harm-balance.com]) such simplifications are (currently) necessary. One could also produce more individualized Benefit-Harm Charts where different outcome risks are considered for all outcomes or where the benefit-harm balance would be calculated even for one individual. It is challenging to make the simulations so fast that the user can obtain a real-time estimate of his or her (fully) individual benefit-harm balance.
Moving guidelines forward
The Benefit-Harm Charts show that a substantial proportion of the population is likely to benefit from low dose aspirin for primary prevention of cardiovascular disease and cancer. For example, a large proportion of the general population has a low 10-year risk (<3 %) for severe GI bleeds [40, 41]. Assuming the weights used for Fig. 2, men of all four age classes and at 10-year risks for severe GI bleeds of <10 % (no previous gastric ulcer, no nonsteroidal anti-inflammatory agents ) are likely to benefit from aspirin irrespective of their risk of MI. Elderly women with at least moderately increased risk of MI are also likely to benefit from aspirin. Even when assuming that the proportion of men and women changes if outcomes are weighted differently, a substantial proportion of men and women are likely to benefit.
The Benefit-Harm Charts show the limitations of current guidelines: The recommendations are not granular enough to accommodate the great variation of the benefit-harm balance of aspirin across the population. Guidelines use few parameters to guide individualized prevention and do not base their recommendations on quantitative benefit-harm assessments except for the USPSTF. As a consequence, there is a risk for under- and overtreatment. Also current guidelines are likely to underestimate the overall benefit from aspirin because they focus on cardiovascular disease and cancer separately. Thereby, the same harms are counted twice (in the cardiovascular and in the cancer guidelines against prevented outcomes). The benefit-harm analyses and the Benefit-Harm Charts presented here thus support the idea of combining outcomes across disease areas if they are prevented or treated by the same intervention .
Although the Benefit-Harm Charts may appear attractive, substantial research is still needed to bring them to practice. For example, to consider the importance individuals assign to outcomes, preference-eliciting tools need to be developed that are easily understood by individuals and implementable. Standard methods such as standard gamble or time trade-off are complicated for respondents and unrealistic for use in a practice setting . Best-worst scaling, which requires individuals to repeatedly choose one outcome over another, pictorial representations of illness, or some more informal techniques are likely to be preferable [43–45]. In addition, the presentation format of the Benefit-Harm Charts needs to be tested using qualitative and quantitative research . Also, the impact of using Benefit-Harm Charts on the decision-making process must be assessed through trials, as is common for decision aids . Finally, outcome risks, evidence on treatment effects, and preferences may change over time. For example, there are ongoing studies (ASPREE, ARRIVE, ASCEND, ACCEPT-D) that assess the effects of aspirin in diverse settings and populations as well as cost effectiveness [48, 49]. Technically, it is not difficult to update benefit-harm analyses such as the ones presented here with additional evidence. But an important question is how to organize such updates efficiently so that decision makers can always rely on up-to-date Benefit-Harm Charts. The use of modern information and computing technology may prove valuable to support an update process where, for example based on a Bayesian framework, the additional evidence adds to existing benefit-harm assessments and Benefit-Harm Charts.
Strengths and limitations of study
We did not perform extensive sensitivity analyses as commonly reported for quantitative benefit-harm analyses [24, 25, 50, 51] but provided an example for how the choice of weights impacts the benefit-harm balance (Fig. 2). The Gail/NCI approach can easily accommodate such sensitivity analyses that consider different weights [http://www.benefit-harm-balance.com], heterogeneity of treatment effects, or a greater number of outcomes. Such sensitivity analyses could also consider recent insights into the time-varying effects of aspirin, which may not show beneficial effects until at least 3 years after the start of use, but whose benefits may be sustained for several years even after cessation in long-term users . Second, we assumed a simplified decision-making context, where we did not consider additional conditions, (for example, chronic lung disease), treatments (such as proton pump inhibitors), or events during the 10 years of prevention (for example, gastrointestinal bleed) that may influence the risk profile or the propensity of taking aspirin. Finally, we refrained from making recommendations about which prediction models to use and from making recommendations for or against low dose aspirin, since the necessary judgments needed for developing recommendations in a guideline depend on more factors than the ones we considered here [8, 9].
Extensive quantitative benefit-harm analyses for many different combinations of outcome risks go well beyond benefit-harm assessments made by policy makers, regulators, or guideline developers that are often made for entire populations only and not based on quantitative benefit-harm analyses. The example of low dose aspirin for primary prevention of cardiovascular disease and cancer shows that it may be time for guideline developers to provide combined recommendations for different diseases that may be prevented or treated by the same intervention. Visualization of results by Benefit-Harm Charts provides a novel way to make more finely granulated policy decisions and recommendations but also to inform individualized decisions on interventions. This approach may avoid some of the simplifications made by current regulatory process and guidelines, which carry greater risk of over- and undertreatment.
This work was based partially on prior work (Methods for Benefit and Harm Assessment in Systematic Reviews, Agency for Healthcare Research and Quality 2012, 12(13)-EHC150-EF) funded by a contract to AHRQ, Rockville, MD (Contract Number HHSA 290-2007-10061-I), but represents new analyses and methods development that were not funded by AHRQ. The findings and conclusions in this document are those of the author(s), who are responsible for its content, and do not necessarily represent the views of AHRQ. No statement in this report should be construed as an official position of AHRQ or of the U.S. Department of Health and Human Services.
Dr. Boyd was supported the Paul Beeson Career Development Award Program (NIA K23 AG032910, AFAR, The John A. Hartford Foundation, The Atlantic Philanthropies, The Starr Foundation, and an anonymous donor).
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- National Heart, Lung and Blood Institute. Risk Assessment Tool for Estimating Your 10-year Risk of Having a Heart Attack. http://cvdrisk.nhlbi.nih.gov. Accessed 27 Sept 2015.
- Framingham Heart Study. Stroke risk calculator. Based on D’Agostino et al. Stroke Risk Profile: Adjustment for Antihypertensive Medication. Stroke. 1994;25:40–3.View ArticleGoogle Scholar
- National Cancer Institute. Colorectal Cancer Risk Assessment Tool. http://www.cancer.gov/colorectalcancerrisk/. Accessed 27 Sept 2015.
- Mendis S, Puska P, Norrving B. WHO | Global atlas on cardiovascular disease prevention and control. Geneva: World Health Organization; 2011. http://www.who.int/cardiovascular_diseases/publications/atlas_cvd/en/. Accessed 27 Sept 2015.
- Perk J, De Backer G, Gohlke H, Graham I, Reiner Z, Verschuren WM, et al. European Guidelines on cardiovascular disease prevention in clinical practice. The Fifth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice. Eur Heart J. 2012;33:1635–701.View ArticlePubMedGoogle Scholar
- United States Preventive Services Task Force. Aspirin for the Prevention of Cardiovascular Disease: U.S. Preventive Services Task Force Recommendation Statement. Ann Intern Med. 2009;150:396–404.View ArticleGoogle Scholar
- United States Preventive Services Task Force. Routine aspirin or nonsteroidal anti-inflammatory drugs for the primary prevention of colorectal cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med. 2007;146:361–4.View ArticleGoogle Scholar
- Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336:924–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Guyatt GH, Oxman AD, Kunz R, Falck-Ytter Y, Vist GE, Liberati A, et al. Going from evidence to recommendations. BMJ. 2008;336:1049–51.View ArticlePubMedPubMed CentralGoogle Scholar
- Vandvik PO, Lincoff AM, Gore JM, Gutterman DD, Sonnenberg FA, Alonso-Coello P, et al. Primary and secondary prevention of cardiovascular disease: Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest. 2012;141:e637S–68.View ArticlePubMedPubMed CentralGoogle Scholar
- JBS3 Board. Joint British Societies’ consensus recommendations for the prevention of cardiovascular disease (JBS3). Heart. 2014;100 Suppl:ii1–ii67.Google Scholar
- Yu T, Vollenweider D, Varadhan R, Li T, Boyd C, Puhan MA. Support of personalized medicine through risk-stratified treatment recommendations - an environmental scan of clinical practice guidelines. BMC Med. 2013;11:7.View ArticlePubMedPubMed CentralGoogle Scholar
- Habbema JDF, Wilt TJ, Etzioni R, Nelson HD, Schechter CB, Lawrence WF, et al. Models in the development of clinical practice guidelines. Ann Intern Med. 2014;161:812.View ArticlePubMedGoogle Scholar
- Berger JS, Lala A, Krantz MJ, Baker GS, Hiatt WR. Aspirin for the prevention of cardiovascular events in patients without clinical cardiovascular disease: a meta-analysis of randomized trials. Am Heart J. 2011;162:115–24. e2.View ArticlePubMedGoogle Scholar
- Man-Son-Hing M, Laupacis A, O’Connor AM, Coyle D, Berquist R, McAlister F. Patient preference-based treatment thresholds and recommendations: a comparison of decision-analytic modeling with the probability-tradeoff technique. Med Decis Making. 2000;20:394–403.View ArticlePubMedGoogle Scholar
- Fried TR, Tinetti ME, Towle V, O’Leary JR, Iannone L. Effects of benefits and harms on older persons’ willingness to take medication for primary cardiovascular prevention. Arch Intern Med. 2011;171:923–8.PubMedPubMed CentralGoogle Scholar
- Gail MH, Costantino JP, Bryant J, Croyle R, Freedman L, Helzlsouer K, et al. Weighing the risks and benefits of tamoxifen. J Natl Cancer Inst. 1999;91:1829–46.View ArticlePubMedGoogle Scholar
- Greenhalgh T, Howick J, Maskrey N. Evidence based medicine: a movement in crisis? BMJ. 2014;348:g3725.View ArticlePubMedPubMed CentralGoogle Scholar
- Graham ID, Tetroe J. Some theoretical underpinnings of knowledge translation. Acad Emerg Med. 2007;14:936–41.View ArticlePubMedGoogle Scholar
- Pronovost PJ. Enhancing physicians’ use of clinical guidelines. JAMA. 2013;310:2501–2.View ArticlePubMedGoogle Scholar
- Aspirin for the Prevention of Cardiovascular Disease: Preventive Medication. http://www.uspreventiveservicestaskforce.org/BrowseRec/Search?s=aspirin. Accessed 27 Sept 2015.
- Thun MJ, Jacobs EJ, Patrono C. The role of aspirin in cancer prevention. Nat Rev Clin Oncol. 2012;9:259–67.View ArticlePubMedGoogle Scholar
- Puhan MA, Singh S, Weiss CO, Varadhan R, Boyd CM. A framework for organizing and selecting quantitative approaches for benefit-harm assessment. BMC Med Res Methodol. 2012;12:173.View ArticlePubMedPubMed CentralGoogle Scholar
- Boyd C, Singh S, Varadhan R, Weiss CO, Sharma R, Bass EB, et al. Methods for benefit and harm assessment in systematic reviews. Agency for Healthcare Research and Quality. 2012;12:EHC150-EF.Google Scholar
- Stegeman I, Bossuyt PM, Yu T, Boyd C, Puhan MA. Aspirin for primary prevention of cardiovascular disease and cancer. A benefit and harm analysis. PLoS One. 2015;10:e0127194.View ArticlePubMedPubMed CentralGoogle Scholar
- Puhan MA, Singh S, Weiss CO, Varadhan R, Sharma R, Boyd CM. Evaluation of the benefits and harms of aspirin for primary prevention of cardiovascular events. Agency for Healthcare Research and Quality. 2013;12:EHC149-EF.Google Scholar
- Berger JS, Roncaglioni MC, Avanzini F, Pangrazzi I, Tognoni G, Brown DL. Aspirin for the primary prevention of cardiovascular events in women and men: a sex-specific meta-analysis of randomized controlled trials. JAMA. 2006;295:306–13.View ArticlePubMedGoogle Scholar
- Algra AM, Rothwell PM. Effects of regular aspirin on long-term cancer incidence and metastasis: a systematic comparison of evidence from observational studies versus randomised trials. Lancet Oncol. 2012;13:518–27.View ArticlePubMedGoogle Scholar
- NHLBI Incidence and Prevalence Chartbook. https://www.nhlbi.nih.gov/research/reports/2006-incidence-chart-book.htm. Accessed 27 Sept 2015.
- Sacco S, Marini C, Toni D, Olivieri L, Carolei A. Incidence and 10-year survival of intracerebral hemorrhage in a population-based registry. Stroke. 2009;40:394–9.View ArticlePubMedGoogle Scholar
- U.S. Cancer Statistics Working Group. United States Cancer Statistics: 1999–2012 Incidence and Mortality Web-based Report. Atlanta: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention and National Cancer Institute; 2014. www.cdc.gov/uscs. Accessed 27 Sept 2015.
- Centers for Disease Control and Prevention. Deaths: Final Data for 2013. National Vital Statistics Reports. Volume 64, Number 2. http://www.cdc.gov/nchs/deaths.htm. Accessed 13 July 2015.
- Cost Effectiveness Analysis Registry. Tufts Medical Center, USA, www.cearegistry.org. Accessed 27 Sept 2015.
- Bata IR, Gregor RD, Wolf HK, Brownell B. Trends in five-year survival of patients discharged after acute myocardial infarction. Can J Cardiol. 2006;22:399–404.View ArticlePubMedPubMed CentralGoogle Scholar
- Hankey GJ, Jamrozik K, Broadhurst RJ, Forbes S, Burvill PW, Anderson CS, et al. Five-year survival after first-ever stroke and related prognostic factors in the Perth Community Stroke Study. Stroke. 2000;31:2080–6.View ArticlePubMedGoogle Scholar
- Roberts SE, Button LA, Williams JG. Prognosis following upper gastrointestinal bleeding. PLoS One. 2012;7:e49507.View ArticlePubMedPubMed CentralGoogle Scholar
- Howlader N, Noone AM, Krapcho M, Garshell J, Miller D, Altekruse SF, et al. SEER Cancer Statistics Review, 1975–2012. National Cancer Institute. Bethesda, MD, http://seer.cancer.gov/csr/1975_2012/. Accessed 27 Sept 2015.
- Minelli C, Abrams KR, Sutton AJ, Cooper NJ. Benefits and harms associated with hormone replacement therapy: clinical decision analysis. BMJ. 2004;328:371.View ArticlePubMedPubMed CentralGoogle Scholar
- R Foundation for Statistical Computing. R: A language and environment for statistical computing. 2014. http://www.r-project.org/. Accessed 27 Sept 2015.
- Thorat MA, Cuzick J. Prophylactic use of aspirin: systematic review of harms and approaches to mitigation in the general population. Eur J Epidemiol. 2015;30:5–18.View ArticlePubMedGoogle Scholar
- Hernández-Díaz S, García Rodríguez LA. Cardioprotective aspirin users and their excess risk of upper gastrointestinal complications. BMC Med. 2006;4:22.View ArticlePubMedPubMed CentralGoogle Scholar
- Puhan MA, Guyatt GH, Montori VM, Bhandari M, Devereaux PJ, Griffith L, et al. The standard gamble demonstrated lower reliability than the feeling thermometer. J Clin Epidemiol. 2005;58:458–65.View ArticlePubMedGoogle Scholar
- Brett Hauber A, Fairchild AO, Reed JF. Quantifying benefit-risk preferences for medical interventions: an overview of a growing empirical literature. Appl Health Econ Health Policy. 2013;11:319–29.View ArticlePubMedGoogle Scholar
- Flynn TN. Valuing citizen and patient preferences in health: recent developments in three types of best-worst scaling. Expert Rev Pharmacoecon Outcomes Res. 2010;10:259–67.View ArticlePubMedGoogle Scholar
- Büchi S, Sensky T, Sharpe L, Timberlake N. Graphic representation of illness: a novel method of measuring patients’ perceptions of the impact of illness. Psychother Psychosom. 1998;67:222–5.View ArticlePubMedGoogle Scholar
- Zipkin DA, Umscheid CA, Keating NL, Allen E, Aung K, Beyth R, et al. Evidence-based risk communication: a systematic review. Ann Intern Med. 2014;161:270–80.View ArticlePubMedGoogle Scholar
- Stacey D, Légaré F, Col NF, Bennett CL, Barry MJ, Eden KB, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2014;1:CD001431.PubMedGoogle Scholar
- Ademi Z, Liew D, Hollingsworth B, Steg PG, Bhatt DL, Reid CM. Is it cost-effective to increase aspirin use in outpatient settings for primary or secondary prevention? Simulation data from the REACH Registry Australian Cohort. Cardiovasc Ther. 2013;31:45–52.View ArticlePubMedGoogle Scholar
- Clinical Trials Gov. https://clinicaltrials.gov/ct2/search. Accessed 27 Sept 2015.
- Yu T, Fain K, Boyd CM, Singh S, Weiss CO, Li T, et al. Benefits and harms of roflumilast in moderate to severe COPD. Thorax. 2014;69:616–22.View ArticlePubMedGoogle Scholar
- Mt-Isa S, Hallgreen CE, Wang N, Callréus T, Genov G, Hirsch I, et al. Balancing benefit and risk of medicines: a systematic review and classification of available methodologies. Pharmacoepidemiol Drug Saf. 2014;23:667–78.View ArticlePubMedGoogle Scholar
- Cuzick J, Thorat MA, Bosetti C, Brown PH, Burn J, Cook NR, et al. Estimates of benefits and harms of prophylactic use of aspirin in the general population. Ann Oncol. 2015;26:47–57.View ArticlePubMedGoogle Scholar