Ruling out coronary heart disease in primary care patients with chest pain: a clinical prediction score
- Baris Gencer†1,
- Paul Vaucher†1,
- Lilli Herzig2,
- François Verdon2,
- Christiane Ruffieux3,
- Stefan Bösner4,
- Bernard Burnand3,
- Thomas Bischoff2,
- Norbert Donner-Banzhoff4 and
- Bernard Favrat1Email author
© Gencer et al; licensee BioMed Central Ltd. 2010
Received: 24 October 2009
Accepted: 21 January 2010
Published: 21 January 2010
Chest pain raises concern for the possibility of coronary heart disease. Scoring methods have been developed to identify coronary heart disease in emergency settings, but not in primary care.
Data were collected from a multicenter Swiss clinical cohort study including 672 consecutive patients with chest pain, who had visited one of 59 family practitioners' offices. Using delayed diagnosis we derived a prediction rule to rule out coronary heart disease by means of a logistic regression model. Known cardiovascular risk factors, pain characteristics, and physical signs associated with coronary heart disease were explored to develop a clinical score. Patients diagnosed with angina or acute myocardial infarction within the year following their initial visit comprised the coronary heart disease group.
The coronary heart disease score was derived from eight variables: age, gender, duration of chest pain from 1 to 60 minutes, substernal chest pain location, pain increasing with exertion, absence of tenderness point at palpation, cardiovascular risks factors, and personal history of cardiovascular disease. Area under the receiver operating characteristics curve was of 0.95 with a 95% confidence interval of 0.92; 0.97. From this score, 413 patients were considered as low risk for values of percentile 5 of the coronary heart disease patients. Internal validity was confirmed by bootstrapping. External validation using data from a German cohort (Marburg, n = 774) revealed a receiver operating characteristics curve of 0.75 (95% confidence interval, 0.72; 0.81) with a sensitivity of 85.6% and a specificity of 47.2%.
This score, based only on history and physical examination, is a complementary tool for ruling out coronary heart disease in primary care patients complaining of chest pain.
Chest pain is a common complaint that occurs in 1 to 2% of primary care patients . Chest pain raises concerns about the occurrence of a serious condition such as coronary heart disease (CHD) , which is present in about 12% of primary care patients with chest pain [1, 3]. Family practitioners should be equipped to rule out an acute CHD related event rapidly. They are used to estimating the probability of CHD in a patient with chest pain on the basis of pain characteristics, patient's age, gender, history and cardiovascular risk factors . Cardiovascular risk factors and chest pain history are associated with CHD, and have been widely studied [4, 5]. However, chest pain characteristics alone are not sufficient to reliably rule out ischemic heart disease . A more complete set of predictors is thus needed for this purpose.
Predictive scores for CHD in emergency settings have been developed [7–9], and are now implemented [10, 11]. However, these scores are not necessarily useful in the primary care setting . To our knowledge, no ambulatory CHD score has been developed to support primary care physicians in ruling out CHD in patients with chest pain. Such a score might help physicians, reassure patients , and spare time and resources from being spent on further investigations. The objective of this study was to develop an ambulatory CHD predictive score, based only on the patient's history and physical examination in the primary care setting, to rule out CHD without further investigations of patients with chest-pain.
We used data from a multicenter clinical cohort of primary care patients with chest pain (TOPIC - Thoracic Pain in Community)  to develop a clinical prediction score for CHD, and secondarily the data from a study conducted in Germany (Marburg study) to validate the score . The primary goal of both these studies was to examine the frequency of occurrence, mode of presentation, etiology, clinical characteristics and correlates, management strategies and outcomes in these patients.
Settings and participants
The initial survey used a research network of family practitioners. Fifty-eight independent offices, urban and rural, and one primary care outpatient clinic from Western Switzerland recruited patients from March to June 2001. Family practitioners consecutively enrolled all patients over 16 years of age who reported any type of chest pain during their visits (n = 672). The presence of chest pain was ascertained according to the usual practice of each family practitioner. Chest pain due to obvious causes such as trauma or known body metastases were also included. Patients with anginal equivalents alone, such as jaw pain, dyspnea on exertion, arm pain, and so on, were therefore excluded. Chest pain was not necessarily the chief complaint on presentation. Participating physicians had an average term of experience in private practice of 12 years (range 1 to 24). They received detailed information on the study and were trained to fill in the forms during a special meeting. Each patient gave informed consent to participate in the study. The study protocol was approved by the official state local Ethical Committee (Prot. 41/2000).
Physicians completed the first part of the Case Report Form (CRF) during the patient's index visit. Additional follow-up information was obtained after three and twelve months (additional encounters). All completed forms were sent to the study coordination center. A set of predefined criteria was used for data entry checks. The data entry clerk reported inconsistencies to the principle investigators, who contacted physicians when needed for case resolution. Missing data were completed by contacting physicians by telephone and obtaining answers from the patient's record. Double data entry was used to identify transcription errors. Data cleaning and validation was performed by a group of physicians experienced in research. When the diagnosis reported by the family practitioner was not consistent throughout the year of follow-up, the final diagnosis for chest pain was discussed and approved by a group of clinicians who were not aware of the aim of this study.
Distribution of analyzed variables according to diagnostic group and unadjusted Odds Ratio over the derivation cohort.
(n = 774)
(n = 661)
1.2 (0.7 to 1.8)
M < 55 yr or F < 65 yr
M 55 to 64 yr or F 65 to 74 yr
12.8 (4.9 to 33.5)
M ≥ 65 yr or F ≥ 75 yr
33.2 (14.0 to 78.7)
18.1 (4.3 to 15.8)
67.4 (15.8 to 287.6)
Previous history of CVD
24.1 (12.5 to 46.4)
Characteristic of the pain
Duration 1 to 60 minutes
8.5 (4.8 to 15.1)
Increasing on exertion
3.5 (2.1 to 5.7)
Substernal area pain
8.0 (4.7 to 13.7)
No tenderness on palpation
6.9 (3.5 to 13.5)
Sudden excruciating pain
0.63 (0.39 to 1.0)
4.1 (2.5 to 6.7)
1.0 (0.5 to 2.3)
Not position dependant
3.5 (1.6 to 7.4)
Not increased with breathing
5.6 (2.2 to 14.4)
0.96 (0.58 to 1.6)
1.7 (0.64 to 4.3)
0.27 (0.15 to 0.46)
0.67 (0.39 to 1.1)
0.88 (0.56 to 1.4)
CVR status unknown (no lab)
0.44 (0.1 to 1. 9)
Outcomes and follow-up
In a primary care setting, it is very difficult to have all patients' cardiovascular status assessed using a gold standard. We therefore opted to use a delayed diagnosis over one year to detect patients with CHD. During the initial visit, the suspected diagnosis was noted and then confirmed or modified during follow-up. Detailed information on patients' history and physical examination, level of anxiety expressed by patients and physicians, cardiovascular and thrombo-embolic risk factors, laboratory results obtained in emergencies, co-morbidities, medications, and treatment decisions at the end of the consultation were also collected. CRFs included information on further examinations and laboratory assays, referrals to specialists, admissions to emergency wards, hospitalizations, and health events during the follow-up period. The diagnoses retained after 12 months of follow-up were grouped in six categories: chest wall, CHD, psychogenic, respiratory, digestive, and miscellaneous. CHD included angina pectoris, unstable angina, and myocardial infarction (MI). When the diagnosis of chest pain was inconsistent or uncertain through the follow-up, a group of investigators discussed the case. When the group of investigators was unable to confirm the diagnosis, or if the diagnosis at 12 months was missing, the patient was contacted for further information through his family practitioner. If the patient could not be contacted, the diagnosis at three months was retained. Ten percent of all CRFs were revised by the group of investigators in evaluating the consistency of the final diagnosis.
External validity was done using data from a German (Marburg) study. Briefly, 1,199 patients aged 35 and over with chest pain observed in one of 74 family practitioners' offices in Germany were successively included in this study. Chest pain was previously unknown and present for a maximum of one month. Patients were followed-up during six months. Cases were defined as patients having been diagnosed with CHD during the following six months by experts who were blinded to patients' clinical conditions. Variables used from this study were age, sex, cardiovascular risk, history of CVD, presence of retrosternal chest pain, pain triggered by exertion, and pain at palpation. Having a cardiovascular risk was defined as having at least one of the following characteristics: family history of CVD, diabetes, hypertension or treated hypertension, hyperlipidemia or treated hyperlipidemia, smoking or obesity (Body Mass Index ≥30).
From previous studies we expected a prevalence of CHD of 10%. The study was powered to detect factors for which the risk of CHD was increased by two (20% vs. 10%) with β set at 0.2 and α at 0.05. The smallest expected exposure group was the one including patients with previous history of CVD (20%). This required including 127 patients with history of CVD and 510 without, or a total of 637 patients with chest pain. Expecting 10% lost to follow-up or missing data, we rounded this to 700 patients. Bivariate analyses were performed to identify factors associated with CHD in patients with chest pain. Fishers' exact test was used. Variables associated with CHD (P < 0.1) were eligible for inclusion in a multivariable logistic model. A variable was retained in the model if it significantly contributed to the model (P < 0.05). Goodness of fit was assessed by means of the Hosmer and Lemshow test. A score was then defined on the basis of the coefficients of the logistic regression, and rounded to the nearest unit. Area under the receiver operating characteristic (ROC) curve was an indicator of the discriminatory power of the score. The coefficient of the logistic model with CHD as the dependent variable and the score as the unique independent variable was estimated as a second performance index . Risk categories were defined on the basis of two cut off values of the score: percentile 5 of the CHD group for the low-risk category, and percentile 95 of the non-CHD group for the high-risk category. Patients with a score between these two cut-off values were considered at intermediate-risk. The sensitivity and specificity of the prediction rule for discriminating low- from intermediate- or high-risk cases indicated the classification performance of the score. The prevalence of CHD at given score levels and risk categories was determined, and the mean of the estimated individual probabilities was given. Sensibility analysis was performed to assess the effect of not considering patients with unknown cardiovascular risk status to be at risk. Data were reanalyzed, considering patients with unknown cardiovascular risk status as patients having a risk.
Internal validity was assessed by means of bootstrapping techniques . The whole analysis was replicated on 300 different samples of the same size drawn with replacement from the original sample. Following the same algorithm, new scores and new prediction rules (based on new cut off values) were defined and applied to the original sample and also to the bootstrapping sample. The area under the ROC curve was computed, as well as the calibration index and the sensitivity and specificity of the rule to classify low risk patients. The mean and standard deviation (SD) of the areas under the curves of the 300 scores, applied to the bootstrap samples and to the original sample, mean and standard deviation of the calibration index, applied to the bootstrap sample and to the original sample, and the mean and SD of the sensibilities and specificities of the 300 rules applied to the original sample were obtained. The mean number of times that patients, originally classified as low-risk, were reclassified in the low-risk category, and then the mean and SD of the predicted values were computed for each patient. Finally, the mean of the mean and SD of the predicted values were given for each score level and risk category.
For external validation, the area under the ROC curve, sensitivity, specificity, negative likelihood ratio and occurrence of CHD in each risk group were calculated from the data available from the Marburg Study . Only patients with complete data were included in analysis. All calculations were performed with StataCorp. 2008, Statistical Software: Release 10.0., Stata Corporation, College Station, Texas, USA.
Altogether, 672 patients were included in the study. Twenty-seven patients were lost to follow-up at one year. Their CHD status reported at three months was therefore carried forward and these patients were included in the analysis. Excluded patients were those having missing data on baseline cardiovascular risk status (n = 6) or were younger than 16 (n = 5). In the remaining group of 661 patients, an average of 11.2 (SD, ±7.6) patients were recruited in each of the 59 centers. The total practice-year we followed was of 4.8 years including Thursdays, Saturdays and Sundays when practices are closed. This corresponds to an average of 0.7 patients with chest pain for every GP for every working day. The recruitment period was nevertheless not the same between physicians. Eleven physicians stopped recruiting before they were meant to. If we overview the intervals from which patients were recruited for each physicians, inclusion was constant over time. Physicians apparently either stopped recruiting or continued recruiting per protocol. The mean age of patients included in analysis was 55.4 years (SD ±19), and 314 patients (47.5%) were male. Most patients (602, 91.1%) were already known to their family practitioners, and 314 (47.5%) had never experienced the same type of pain before. One hundred and twenty patients (18.2%) had previous evidence of CHD or CVD (revascularization procedures, heart failure, or peripheral arterial disease) and 433 patients (65.5%) were known to have one or more cardiovascular risk factors, 196 were known to have none. The presence of cardio-vascular risk was unknown to the physician for 32 of the 661 patients. Eighty-five patients (12.9%) were diagnosed with CHD, including 75 cases of angina pectoris (11.1%), six cases of unstable angina (0.9%) and four cases of myocardial infarction (0.6%). None of the 196 patients for which it was known that they had no risk factor, and two of the 32 patients with unknown laboratory status were diagnosed with CHD.
Building the prediction score
Bivariate analyses identified 11 variables associated with CHD at a significance level of P = 0.1 (Table 1). The variables were gender, known cardiovascular risk, past history of CVD, substernal pain location, duration of pain, pain during exertion, absence of tenderness, oppressive pain, sudden excruciating pain, pain dependent of the position, pain increased by a deep breath and previously having felt the same pain. Not knowing if patients had dyslipidemia or diabetes (n = 32) was not associated to having CHD (Odds Ratio = 0.44; CI 95% 0.1 to 1. 9).
Regression coefficients, contributions to the CHD-score, ORs (adjusted) for the subpopulation with cardiovascular risks (n = 435).
ORadj (95% CI)
M < 55 yr or F < 65 yr
M 55-64 yr or F 65 to 74 yr
7.3 (2.4 to 22.5)
M ≥ 65 yr or F ≥ 75 yr
11.5 (4.2 to 31.5)
Known cardiovascular risk
1 to 2
5.8 (1.2 to 29.0)
6.7 (1.3 to 35.2)
Known previous history of CVD
6.7 (3.2 to 13.8)
Duration of chest pain 1 to 60 minutes
3.0 (1.4 to 6.2)
Area of pain described as substernal
5.2 (2.5 to 10.9)
Precipitating with exertion
2.1 (1.0 to 4.3)
Absence of tenderness
3.4 (1.5 to 8.0)
The regression coefficients, OR (adjusted and unadjusted) are given in Table 2, as well as the contribution of each factor to the CHD score. The score ranged from 0 to 11. The model allowed two points each for the following determinates: having a known cardiovascular risk, men over 55 years or women over 65 years, personal history of CVD, and substernal pain. The other determinants, duration, exertion with effort, and tenderness, each received one point.
Prevalence of events for each level of risk.
Score = 0-4
CHD Score = 5-7
CHD Score = 8-11
Coronary Heart Disease
(0.0 to 1.7)
(7.8 to 18.5)
(61.8 to 81.5)
Prevalence from bootstrapping*
Validation cohort (N = 774) †
(3.0 to 8.4)
(8.9 to 16.3)
(29.8 to 45.4)
Acute myocardial infarction
(0 to 3.4)
(0.3 to 8.1)
(0 to 0.9)
(0.2 to 4.4)
(1.3 to 11.4)
(0.3 to 2.5)
(3.5 to 11.9)
(4.8 to 18.7)
(0 to 0.9)
(0.2 to 4.4)
(4.8 to 8.7)
(0 to 0.9)
(0.2 to 4.4)
(3.3 to 15.9)
Classification of major events and electrocardiograms (ECG)
Table 3 shows the prevalence of major events for each risk class. We observed one patient with acute myocardial infarction classified as low-risk. This patient's cardiovascular risk status was unknown. During the year of follow-up, 24 patients died. Four of them belonged to the low-risk group. None of these patients were diagnosed with a CHD. It is worth mentioning that 72 ECGs were taken of low-risk patients, representing 50.3% of all the ECGs done on patients with chest pain. For high-risk patients, less than one third were investigated by ECG.
The results of the 300 iterations of score development (bootstrapping) gave consistent results with the initial analysis, except for 40 samples. The mean area under the curve for the 300 different prediction rules applied to the original sample was 0.942 (SD 0.004), and the mean calibration index was 0.87 (SD 0.13). When the predictive rules where applied to the bootstrap samples, we had a mean area under the curve of 0.950 (SD 0.011), and a mean calibration index of 0.97 (SD 0.07). The difference between both calibration indexes revealed the over-optimism of the model. The dispersion of the calibration index revealed some kind of instability of the model (due to the very small number of CHD in the group without known risk factor). Mean sensitivity and specificity for the rule-out threshold values were 0.956 (SD 0.027) and 0.710 (SD 0.077), respectively.
Nevertheless, the classification appears to be relatively stable because the 392 patients in the low-risk category were classified on average 283.35 times (range 149 to 300) in the low-risk category by the bootstrap rules. The mean prevalence of CHD in the low-risk category was 0.005 (SD 0.005). The distribution of the prevalence of CHD by risk category is given in Table 3 where the score distribution is compared with the actual prevalence. The mean predicted values and mean deviation from original predicted values are given by risk category.
We developed a clinical prediction score for ruling out CHD in primary care patients with chest pain. Our CHD score includes eight predictors (age, gender, having at least one CVD risk factor, history of CVD, duration of pain, substernal location of pain, increased pain with exertion, absence of tenderness at palpation), which are all known to be associated with CHD , and easily identifiable from history and physical examination. Our score can classify patients in three groups with an increasing prevalence of CHD. Bootstrapping, the recommended tool for this kind of modeling , was used to test internal validity. Our ambulatory CHD score is consistent throughout our data, and the predictive power of the model is acceptable. Our ruling-out score classified two thirds of the studied population in the low-risk category with a strong negative predictive value (99.8%). Negative predictive value remained high in the validation cohort (94.8%) with a negative likelihood ratio of 0.31. Our ambulatory CHD score seems adapted for the management of CHDs in primary care. However, this score does not entirely rule out CHD as 5.2% of patients in the low risk group from the validation cohort ended up having CHD within the next six months.
Our data show both similarities and differences from the published determinants used to rule out CHD. The American College of Physicians  developed guidelines to manage patients in primary care for whom chronic stable angina was suspected. Our scores are in agreement with their recommendations of using age, gender, cardiovascular risk factors, and pain characteristics to estimate the probability of CHD. Like the Framingham risk score , our ambulatory CHD score also includes age, gender, and cardiovascular risks as indicators of CHD events. The Framingham risk score does not include a personal history of CVD or characteristics of pain, which are essential to detecting patients with CHD. These characteristics have been included in scores developed in emergency departments [7, 8, 17–25]. However, the prevalence and etiology of CHD differ considerably between these two settings. CHD is about four times less frequent in patients with chest pain in primary care  than in those admitted in emergency departments . Furthermore, the severity of CHD differs between these settings. Over 10% of patients hospitalized with chest pain [26, 27] have a myocardial infarction, whereas we observed a prevalence of only 0.6% in primary care . Factors that may appear to be important or unimportant in samples with relatively few outcome events may be substantially misleading. For example, pain lasting for more than 60 minutes is very atypical for angina but not so unusual for an acute myocardial infarction. Given the very low prevalence of myocardial infarction in this manuscript, factors that may be very important for diagnosing acute myocardial infarction may be substantially undervalued. This could explain why the area under the curve for predicting CHD seems better in our score than for either the TIMI, the PURSUIT or the GRACE scores . This difference illustrates the importance of developing guidelines and scores specifically for the primary care setting instead of a mere use of scores developed for emergency department patients.
The major strength of our study is the development of a clinical tool for family practitioners, using data collected by a research network in primary care . The use of the ambulatory CHD score, based only on the patient's history and physical examination, allows family practitioners to estimate risks of discharging a patient without further examinations.
Our study has some limitations. We would first like to remind physicians that scores derived from logistic regression cannot identify unusual presentations. Consider the example of a young patient who abuses cocaine, and presenting an acute myocardial infarction. This patient would be classified in the low-risk group . Clinical knowledge and experience therefore still remain essential in ruling out CHD in patients with chest pain [31, 32]. Secondly, we used delayed diagnosis instead of referring all patients to a specialist. Logistical resources and patients' unavailability make it very difficult to assure objective confirmation in primary care research. Furthermore, in the derivation cohort, assessors were not blinded to the initial state of exposure when defining cases. However, 28% of the patients have been referred to specialists or to hospitals, and the one-year follow up allows us to reasonably confirm the absence of missed CHD. Furthermore, in cases of doubt, the family practitioner was questioned for further information. In the 10% of records reviewed by experts, only one controversial case was detected and resolved after discussion with the family practitioner. We therefore believe that misclassification is negligible. It should be noted that most patients were known to their primary care physicians, a factor that could have facilitated the diagnostic process. Physicians were therefore not blinded to their patient's condition and could have been more likely to report some signs knowing their patient had cardiac chest pain. Furthermore, we cannot exclude that patients with MI or unstable angina which rapidly became entirely asymptomatic remained undetected. The study is also underpowered to detect any difference in myocardial infarction or unstable angina between the risk groups. Finally, external validation showed the score to be much less sensitive than it was meant to be. Both studies however included different patients. In the Marburg study, young patients were not included (≥35 years vs. ≥16 years), nor were those with posterior chest pain or pain lasting more than one month. The Marburg study therefore excluded patients who were more likely to be at low risk compared to those included in the Lausanne cohort. This method nevertheless shows a better diagnosis ability than recognized laboratory markers such as BNP and NT-proBNP  in possible heart failure patients.
In summary, we developed a clinical prediction score to rule out CHD in primary care patients with chest pain. This clinical tool may limit clinical investigation in patients with chest pain in primary care where the presentation and the management are completely different from the emergency departments. However, further analyses of the proposed score should be conducted in various primary care contexts to evaluate its true benefit better and evaluate its implementation.
area under the curve
body mass index
coronary heart disease
case report form
thoracic pain in community
rater operating characteristic
We are indebted to the Swiss Academy of Medical Sciences for a grant that supported the study (RMMA 6/2000). We thank Françoise Secretan for her valuable work as the coordinating research nurse, and all our colleagues from the General Practitioner Network for data, counselling and clinical contributions.
- Ruigomez A, Rodriguez LA, Wallander MA, Johansson S, Jones R: Chest pain in general practice: incidence, comorbidity and mortality. Fam Pract. 2006, 23: 167-174. 10.1093/fampra/cmi124.View ArticlePubMedGoogle Scholar
- Luepker RV, Apple FS, Christenson RH, Crow RS, Fortmann SP, Goff D, Goldberg RJ, Hand MM, Jaffe AS, Julian DG, Levy D, Manolio T, Mendis S, Mensah G, Pajak A, Prineas RJ, Reddy KS, Roger VL, Rosamond WD, Shahar E, Sharrett AR, Sorlie P, Tunstall-Pedoe H, AHA Council on Epidemiology and Prevention; AHA Statistics Committee; World Heart Federation Council on Epidemiology and Prevention; European Society of Cardiology Working Group on Epidemiology and Prevention; Centers for Disease Control and Prevention; National Heart, Lung, and Blood Institute: Case definitions for acute coronary heart disease in epidemiology and clinical research studies: a statement from the AHA Council on Epidemiology and Prevention; AHA Statistics Committee; World Heart Federation Council on Epidemiology and Prevention; the European Society of Cardiology Working Group on Epidemiology and Prevention; Centers for Disease Control and Prevention; and the National Heart, Lung, and Blood Institute. Circulation. 2003, 108: 2543-2549. 10.1161/01.CIR.0000100560.46946.EA.View ArticlePubMedGoogle Scholar
- Verdon F, Herzig L, Burnand B, Bischoff T, Pecoud A, Junod M, Muhlemann N, Favrat B: Chest pain in daily practice: occurrence, causes and management. Swiss Med Wkly. 2008, 138: 340-347.PubMedGoogle Scholar
- Snow V, Barry P, Fihn SD, Gibbons RJ, Owens DK, Williams SV, Weiss KB, Mottur-Pilson C: Evaluation of primary care patients with chronic stable angina: guidelines from the American College of Physicians. Ann Intern Med. 2004, 141: 57-64.View ArticlePubMedGoogle Scholar
- Eichler K, Puhan MA, Steurer J, Bachmann LM: Prediction of first coronary events with the Framingham score: a systematic review. Am Heart J. 2007, 153: 722-731. 10.1016/j.ahj.2007.02.027. 731 e721-728View ArticlePubMedGoogle Scholar
- Swap CJ, Nagurney JT: Value and limitations of chest pain history in the evaluation of patients with suspected acute coronary syndromes. JAMA. 2005, 294: 2623-2629. 10.1001/jama.294.20.2623.View ArticlePubMedGoogle Scholar
- Christenson J, Innes G, McKnight D, Thompson CR, Wong H, Yu E, Boychuk B, Grafstein E, Rosenberg F, Gin K, Anis A, Singer J: A clinical prediction rule for early discharge of patients with chest pain. Ann Emerg Med. 2006, 47: 1-10. 10.1016/j.annemergmed.2005.08.007.View ArticlePubMedGoogle Scholar
- Gatien M, Perry JJ, Stiell IG, Wielgosz A, Lee JS: A clinical decision rule to identify which chest pain patients can safely be removed from cardiac monitoring in the emergency department. Ann Emerg Med. 2007, 50: 136-143. 10.1016/j.annemergmed.2007.02.004.View ArticlePubMedGoogle Scholar
- Ramsay G, Podogrodzka M, McClure C, Fox KA: Risk prediction in patients presenting with suspected cardiac pain: the GRACE and TIMI risk scores versus clinical evaluation. QJM. 2007, 100: 11-18. 10.1093/qjmed/hcl133.View ArticlePubMedGoogle Scholar
- MacGougan CK, Christenson JM, Innes GD, Raboud J: Emergency physicians' attitudes toward a clinical prediction rule for the identification and early discharge of low risk patients with chest discomfort. CJEM. 2001, 3: 89-94.View ArticlePubMedGoogle Scholar
- Pearson SD, Goldman L, Garcia TB, Cook EF, Lee TH: Physician response to a prediction rule for the triage of emergency department patients with chest pain. J Gen Intern Med. 1994, 9: 241-247. 10.1007/BF02599648.View ArticlePubMedGoogle Scholar
- Buntinx F, Knockaert D, Bruyninckx R, de Blaey N, Aerts M, Knottnerus JA, Delooz H: Chest pain in general practice or in the hospital emergency department: is it the same?. Fam Pract. 2001, 18: 586-589. 10.1093/fampra/18.6.586.View ArticlePubMedGoogle Scholar
- Katz DA, Williams GC, Brown RL, Aufderheide TP, Bogner M, Rahko PS, Selker HP: Emergency physicians' fear of malpractice in evaluating patients with possible acute cardiac ischemia. Ann Emerg Med. 2005, 46: 525-533. 10.1016/j.annemergmed.2005.04.016.View ArticlePubMedGoogle Scholar
- Bösner S, Becker A, Haasenritter J, Abu Hani M, Keller H, Sönnichsen AC, Karatolios K, Schaefer JR, Seitz G, Baum E, Donner-Banzhoff N: Chest pain in primary care: Epidemiology and pre-work-up probabilities. Eur J Gen Pract. 2009, 15: 141-6. 10.3109/13814780903329528.View ArticlePubMedGoogle Scholar
- Steyerberg EW, Harrell FE, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD: Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol. 2001, 54: 774-781. 10.1016/S0895-4356(01)00341-9.View ArticlePubMedGoogle Scholar
- Baser O, Crown WH, Pollicino C: Guidelines for selecting among different types of bootstraps. Current Medical Research and Opinion. 2006, 22: 799-808. 10.1185/030079906X100230.View ArticlePubMedGoogle Scholar
- Diamond GA, Forrester JS: Analysis of probability as an aid in the clinical diagnosis of coronary-artery disease. N Engl J Med. 1979, 300: 1350-1358.View ArticlePubMedGoogle Scholar
- Grover SA, Lowensteyn I, Esrey KL, Steinert Y, Joseph L, Abrahamowicz M: Do doctors accurately assess coronary risk in their patients? Preliminary results of the coronary health assessment study. BMJ. 1995, 310: 975-978.View ArticlePubMedPubMed CentralGoogle Scholar
- Lee TH, Cook EF, Weisberg M, Sargent RK, Wilson C, Goldman L: Acute chest pain in the emergency room. Identification and examination of low-risk patients. Arch Intern Med. 1985, 145: 65-69. 10.1001/archinte.145.1.65.View ArticlePubMedGoogle Scholar
- Morise AP, Haddad WJ, Beckner D: Development and validation of a clinical score to estimate the probability of coronary artery disease in men and women presenting with suspected coronary disease. Am J Med. 1997, 102: 350-356. 10.1016/S0002-9343(97)00086-7.View ArticlePubMedGoogle Scholar
- Panju AA, Hemmelgarn BR, Guyatt GH, Simel DL: The rational clinical examination. Is this patient having a myocardial infarction?. JAMA. 1998, 280: 1256-1263. 10.1001/jama.280.14.1256.View ArticlePubMedGoogle Scholar
- Pryor DB, Shaw L, McCants CB, Lee KL, Mark DB, Harrell FE, Muhlbaier LH, Califf RM: Value of the history and physical in identifying patients at increased risk for coronary artery disease. Ann Intern Med. 1993, 118: 81-90.View ArticlePubMedGoogle Scholar
- Rouan GW, Lee TH, Cook EF, Brand DA, Weisberg MC, Goldman L: Clinical characteristics and outcome of acute myocardial infarction in patients with initially normal or nonspecific electrocardiograms (a report from the Multicenter Chest Pain Study). Am J Cardiol. 1989, 64: 1087-1092. 10.1016/0002-9149(89)90857-6.View ArticlePubMedGoogle Scholar
- Tierney WM, Roth BJ, Psaty B, McHenry R, Fitzgerald J, Stump DL, Anderson FK, Ryder KW, McDonald CJ, Smith DM: Predictors of myocardial infarction in emergency room patients. Crit Care Med. 1985, 13: 526-531. 10.1097/00003246-198507000-00002.View ArticlePubMedGoogle Scholar
- Bjork J, Forberg JL, Ohlsson M, Edenbrandt L, Ohlin H, Ekelund U: A simple statistical model for prediction of acute coronary syndrome in chest pain patients in the emergency department. BMC Med Inform Decis Mak. 2006, 6: 28-10.1186/1472-6947-6-28.View ArticlePubMedPubMed CentralGoogle Scholar
- Kohn MA, Kwan E, Gupta M, Tabas JA: Prevalence of acute myocardial infarction and other serious diagnoses in patients presenting to an urban emergency department with chest pain. J Emerg Med. 2005, 29: 383-390. 10.1016/j.jemermed.2005.04.010.View ArticlePubMedGoogle Scholar
- Goldman L, Cook EF, Johnson PA, Brand DA, Rouan GW, Lee TH: Prediction of the need for intensive care in patients who come to the emergency departments with acute chest pain. N Engl J Med. 1996, 334: 1498-1504. 10.1056/NEJM199606063342303.View ArticlePubMedGoogle Scholar
- de Araujo Goncalves P, Ferreira J, Aguiar C, Seabra-Gomes R: TIMI, PURSUIT, and GRACE risk scores: sustained prognostic value and interaction with revascularization in NSTE-ACS. Eur Heart J. 2005, 26: 865-872. 10.1093/eurheartj/ehi187.View ArticlePubMedGoogle Scholar
- Laupacis A, Sekar N, Stiell IG: Clinical prediction rules. A review and suggested modifications of methodological standards. JAMA. 1997, 277: 488-494. 10.1001/jama.277.6.488.View ArticlePubMedGoogle Scholar
- Bansal D, Eigenbrodt M, Gupta E, Mehta JL: Traditional risk factors and acute myocardial infarction in patients hospitalized with cocaine-associated chest pain. Clin Cardiol. 2007, 30: 290-294. 10.1002/clc.20079.View ArticlePubMedGoogle Scholar
- Bruyninckx R, Bruel Van den A, Hannes K, Buntinx F, Aertgeerts B: GPs' reasons for referral of patients with chest pain: a qualitative study. BMC Fam Pract. 2009, 10: 55-10.1186/1471-2296-10-55.View ArticlePubMedPubMed CentralGoogle Scholar
- Hani MA, Keller H, Vandenesch J, Sonnichsen AC, Griffiths F, Donner-Banzhoff N: Different from what the textbooks say: how GPs diagnose coronary heart disease. Fam Pract. 2007, 24: 622-627. 10.1093/fampra/cmm053.View ArticlePubMedGoogle Scholar
- Balion C, Santaguida PL, Hill S, Worster A, McQueen M, Oremus M, McKelvie R, Booker L, Fagbemi J, Reichert S, Raina P: Testing for BNP and NT-proBNP in the diagnosis and prognosis of heart failure. Evid Rep Technol Assess (Full Rep). 2006, 1-147.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/8/9/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.