- Research article
- Open Open Peer Review
The Alvarado score for predicting acute appendicitis: a systematic review
BMC Medicinevolume 9, Article number: 139 (2011)
The Alvarado score can be used to stratify patients with symptoms of suspected appendicitis; the validity of the score in certain patient groups and at different cut points is still unclear. The aim of this study was to assess the discrimination (diagnostic accuracy) and calibration performance of the Alvarado score.
A systematic search of validation studies in Medline, Embase, DARE and The Cochrane library was performed up to April 2011. We assessed the diagnostic accuracy of the score at the two cut-off points: score of 5 (1 to 4 vs. 5 to 10) and score of 7 (1 to 6 vs. 7 to 10). Calibration was analysed across low (1 to 4), intermediate (5 to 6) and high (7 to 10) risk strata. The analysis focused on three sub-groups: men, women and children.
Forty-two studies were included in the review. In terms of diagnostic accuracy, the cut-point of 5 was good at 'ruling out' admission for appendicitis (sensitivity 99% overall, 96% men, 99% woman, 99% children). At the cut-point of 7, recommended for 'ruling in' appendicitis and progression to surgery, the score performed poorly in each subgroup (specificity overall 81%, men 57%, woman 73%, children 76%). The Alvarado score is well calibrated in men across all risk strata (low RR 1.06, 95% CI 0.87 to 1.28; intermediate 1.09, 0.86 to 1.37 and high 1.02, 0.97 to 1.08). The score over-predicts the probability of appendicitis in children in the intermediate and high risk groups and in women across all risk strata.
The Alvarado score is a useful diagnostic 'rule out' score at a cut point of 5 for all patient groups. The score is well calibrated in men, inconsistent in children and over-predicts the probability of appendicitis in women across all strata of risk.
Acute appendicitis is the most common cause of an acute abdomen requiring surgery, with a lifetime risk of about 7% . Symptoms of appendicitis overlap with a number of other conditions making diagnosis a challenge, particularly at an early stage of presentation . Patients may be suitably triaged into alternative management strategies: reassurance, pursuit of an alternative diagnosis or observation/admission to hospital. If admitted to hospital, appropriate imaging may be required prior to proceeding to an appendectomy .
Clinical prediction rules (CPRs) quantify the diagnosis of a target disorder based on findings of key symptoms, signs and available diagnostic tests, thus having an independent diagnostic or prognostic value . They can also extend into clinical decision making if probability estimates are linked to management recommendations, and are subsequently referred to as clinical decision rules. CPRs have the potential to reduce diagnostic error, increase quality and enhance appropriate patient care . In 1986, Alvarado constructed a 10-point clinical scoring system, also known by the acronym MANTRELS, for the diagnosis of acute appendicitis as based on symptoms, signs and diagnostic tests in patients presenting with suspected acute appendicitis (Figure 1) .
The Alvarado score enables risk stratification in patients presenting with abdominal pain, linking the probability of appendicitis to recommendations regarding discharge, observation or surgical intervention . Further investigations, such as ultrasound and computed tomography (CT) scanning, are recommended when probability of appendicitis is in the intermediate range . However, the time lag, high costs and variable availability of imaging procedures mean that the Alvarado score may be a valuable diagnostic aid when appendicitis is suspected to be the underlying cause of an acute abdomen, particularly in low-resource countries, where imaging is not an option.
A recent clinical policy document from the American College of Emergency Physicians reviews the value of using clinical findings to guide decision making in acute appendicitis . Under the heading of the Alvarado score, they state that 'combining various signs and symptoms into a scoring system may be more useful in predicting the presence or absence of appendicitis'. Although not a strong recommendation, the Alvarado score is the only scoring system presented in the document.
The Alvarado score was originally designed more than two decades ago as a diagnostic score; however, its performance and appropriateness for routine clinical use is still unclear. The aim of this study was to perform a systematic review and meta-analysis of validation studies that assess the Alvarado score in order to determine its performance (diagnostic accuracy or discrimination at two cut-points commonly used for decision making, and calibration of the score). As studies have suggested that the accuracy of the Alvarado is affected by gender and age [8–12], we focused our analysis on three separate groups of patients: men, women and children.
Data sources and search strategy
An electronic search was performed on PubMed (January 1986 to 4 April 2011), EMBASE (January 1986 to 4 April 2011), Cochrane library, MEDION and DARE databases. The search strategy is presented as a flow diagram in Figure 2. A combination of keywords and MeSH terms were used; 'appendicitis' OR 'alvarado' OR, 'Mantrels', was used in combination with 26 specific terms for CPRs, including 'risk score', 'decision rule', 'predictive value', 'diagnostic score', and 'diagnostic rule' . A citation search of included articles was undertaken using Google Scholar. The references of included studies were also hand searched for relevant papers. Authors of recent papers (2001 onwards) were contacted when included studies did not report sufficient data to enable inclusion. No language restrictions were placed on the searches.
To be included in this study, participants had to be recruited from an emergency department or a surgical ward and present with symptoms suggestive of acute appendicitis, including abdominal pain, rebound tenderness, nausea, vomiting or elevated temperature. Each included study assessed the performance of the Alvarado score in comparison with the histological examination of the appendix following surgery (reference standard). For those who did not undergo appendectomy and histological examination, outpatient follow-up or no repeat presentation were used as alternative outcome measures. To be included, studies had to report results in a manner that allowed data to be extracted for either the diagnostic test accuracy analysis of the Alvarado score at specific cut points or the calibration analysis. Studies that focused on pregnant patients were excluded.
Two reviewers (RO and FO'R) completed the review process. The inclusion criteria were defined a priori. They reviewed titles and abstracts independently and after discussion decided which articles should be reviewed in full. Full text articles were reviewed independently by the same reviewers and any disagreements were resolved by discussion.
Quality assessment, data extraction and statistical analysis
Quality assessment of included papers was assessed using QUADAS (quality assessment of studies of diagnostic accuracy included in systematic reviews) and the risk of bias table in Review Manager 5 software from the Cochrane collaboration [14, 15]. A summary of the quality of included papers is presented in Figure 3. Quality assessment was performed independently by two investigators (RO an FO'R) and any disagreements were resolved by discussion with a third investigator (KO'B).
Diagnostic accuracy of the Alvarado score
For the diagnostic accuracy (discrimination performance) of the Alvarado score, data were extracted and 2 × 2 tables constructed for use of the score as a criterion for admission (score 1 to 4 versus score 5 to 10, Figure 1) and as a criterion for surgery (score 7 to 10 versus score 1 to 6, Figure 1). Data extraction was carried out independently by two reviewers (RO and FO'R) and the data compared. A bivariate random-effects model was used to compute summary diagnostic sensitivity and specificity which allowed for heterogeneity beyond chance as a result of clinical and methodological differences between the studies to be taken into account. Heterogeneity was assessed using the variance of logit transformed sensitivity and specificity, where smaller values indicate less heterogeneity across studies. HSROC (hierarchical summary receiver operating characteristic) curves were also constructed with 95% confidence regions illustrating the precision with which pooled values are estimated and a 95% prediction region, illustrating the amount of between-study variation. Analyses were carried out using STATA software (StataCorp LP, College Station, TX, 77845, USA), using the "metandi" command [16, 17].
Calibration analysis of the Alvarado score
The initial derivation study of the Alvarado score was used as the predictive model against which all validation studies were compared . The number of patients diagnosed with appendicitis as estimated by the Alvarado score (predicted events) was compared to the actual number of patients with appendicitis (observed events) in each of the validation studies. The analysis was performed separately across three risk strata of the Alvarado score (low risk, score 1 to 4; intermediate risk, score 5 to 6; and high risk, score 7 to 10) (Figure 1). Within each risk stratum, each of the three main study populations, men, women and children were analysed separately [8, 10–12, 18].
The results from the calibration assessment were presented as risk ratios (RRs with 95% confidence intervals) and are illustrated as forest plots. RR < 1.00 indicates an under-prediction of appendicitis by the score (observed number with appendicitis is greater than the predicted number) and RR > 1.00 indicates an over-prediction of appendicitis by the score (observed number with appendicitis is less than the predicted number). RR = 1 indicates a matched calibration between observed and predicted numbers. Review Manager 5 software from the Cochrane collaboration was used to perform the pooled analysis, determine heterogeneity and produce the forest plots. RRs with their 95% CIs were computed by the Mantel-Haenszel (M-H) method. A random-effects model was used and heterogeneity assessed by I 2 statistic.
Prevalence was investigated as a source of heterogeneity in a subgroup analysis. Studies were dichotomised, based on their prevalence, as being either higher or lower than the Alvarado's derivation study; the effect on heterogeneity and the calibration of the score were also investigated.
The literature search yielded > 3,000 titles and abstracts for screening. The full text of 91 articles met the eligibility criteria, and these articles were retrieved (Figure 2). Thirty-seven articles were included from the search, and a further five articles were retrieved after citation searching, with a total of 42 articles meeting the inclusion criteria. The included studies came from a variety of settings and countries (Table 1). Nine studies took place in a surgical ward; three studies only specified that patients were hospitalised, all remaining studies were performed in an emergency department setting. Detailed characteristics of all included studies are presented in Table 1.
Results of the quality assessment are shown in Figure 3. The overall quality of the included studies is considered acceptable for most of the quality items. The assessment of the clinical variables composing the Alvarado score and the reference standard for diagnosis (histological results of the appendectomy) were interpreted independently in most studies. The retrospective studies rarely reported if the scorer was aware of the final diagnosis (blind assessment). The quality item, 'time between tests', is the time between administering the Alvarado score and verifying the diagnosis with pathology or follow-up and was very poorly reported. As part of our inclusion criteria, all studies had to confirm the diagnosis of appendicitis on those undergoing appendectomy; however, follow-up of those discharged was poor in the majority of studies (item 'All verified with reference test').
Diagnostic accuracy of the Alvarado score
The Alvarado score discriminated well as an observation/admission criterion (cut point of 5) by achieving high pooled sensitivity of 99% overall (n = 28 studies, [5, 8, 10, 18–42]) and in studies where data were available, it also performed well in the subgroup analysis for men, woman and children (pooled sensitivities: 0.96 for men, n = 5 [23, 30, 33–35]; 0.99 for women, n = 5 [23, 30, 34, 35, 43] and 0.99 for children, n = 9 [10, 21, 23, 27, 28, 30, 40–42]) (Table 2 and Additional file 1 - Figure S1). In patients presenting with higher Alvarado scores (cut point of 7, the criterion for surgery), pooled diagnostic accuracy results had more limited clinical value (pooled specificity for all studies 0.82, n = 29, [5, 8, 10, 11, 18–25, 27–32, 34–38, 41, 42, 44–47]), with pooled specificities ranging from 0.57 for subgroup analysis of men (n = 6, [9, 23, 30, 34, 35, 45]), 0.73 for subgroup analysis of women (n = 7, [9, 23, 30, 33–35, 45]) and 0.76 for subgroup analysis of children (n = 9, [10, 21, 23, 27, 28, 30, 41, 42, 47]) (Table 2 and Additional file 1 - Figure S1).
Overall, heterogeneity was high when all studies were included and was particularly high in the children subgroup as indicated by the variance logit transformed sensitivity and specificity (Table 2) and the prediction ellipses on the SROC curves Additional file 1 - Figure S1).
Calibration of the Alvarado score
The Alvarado score performed well in all three risk strata for men: (low risk RR 1.06, 95% CI 0.87 to 1.28; intermediate risk 1.09, 0.86 to 1.37 and high risk 1.02, 0.97 to 1.08). In women, there was a systematic over-prediction across all risk strata: low risk (RR 5.35, 2.17 to 13.19), intermediate risk (RR 1.82, 1.20 to 2.78) and high risk (RR 1.14, 1.04 to 1.25). In children, there was a non-significant trend towards over-prediction in the low risk strata (5.03, 0.52 to 48.82) and a significant over-prediction in the intermediate risk category (1.81, 1.13 to 2.89) and high risk strata (1.13, 1.01 to 1.27) (Figures 4, 5, 6). Heterogeneity in terms of between-study predicted/observed risk ratio estimates is apparent in children across all risk strata and in women at a high risk (I 2 > 50%), and, therefore, these pooled estimates should be treated with caution.
In a subgroup analysis based on prevalence (Additional file 1 - Figure S2), the high prevalence category consisted of six studies [9, 10, 23, 32, 37, 39] - the score predicted well in this group and heterogeneity was below 50% in the high and low risk groups (low risk RR 0.65, 95% CI 0.25 to 1.75, I 2 = 34%; intermediate risk RR 0.99, 95% CI 0.70 to 1.40, I 2 = 72%; high risk RR 0.99, 95% CI 0.96 to 1.02, I 2 = 0%). The low prevalence subgroup consisted of 24 studies, there was a significant overprediction across all risk strata; however, heterogeneity was extremely high (I 2 = 78% to 85%) suggesting that other factors, perhaps age and gender, contributed to the high levels of heterogeneity in this group. Unfortunately, not enough studies had age and gender information to allow us to do further subgroup analysis.
This systematic review shows that the Alvarado score at the cut point of 5 performs well as a "rule out" CPR in all patient groups with suspected appendicitis. Pooled diagnostic accuracy in terms of "ruling in" appendicitis at a cut-point of seven points is not sufficiently specific in any patient group to proceed directly to surgery. In terms of calibration, the observed, predicted estimates in men suggest the score is well calibrated across all risk strata. Application of the Alvarado score in women over-predicts the probability of appendicitis across all strata of risk and should be used with caution. The validity of the Alvarado score in children was inconclusive; the calibration analysis showed high levels of heterogeneity across all risk strata. Further validation studies are required before clinical implementation of the Alvarado score for this age group could be recommended.
A recent clinical policy document from the American College of Emergency Physicians reviewed the value of using clinical findings to guide decision making in acute appendicitis . They state that combining various signs and symptoms, as in the Alvarado score, may be more useful in predicting the presence or absence of appendicitis. This systematic review supports the use of the Alvarado score as a triage CPR that can be applied to 'rule out' appendicitis at a score below five points (sensitivity 94% to 99%), but not as a 'rule in' for appendicitis. Patients with a score less than 5 can be considered for discharge with the proviso that watchful waiting and re-assessment may be required if symptoms change or deteriorate. The advantage of applying the Alvarado score in this way is that resources in terms of admitting a patient to hospital or performing diagnostic imaging can be reserved for higher-risk scoring patients. Such an approach may be particularly useful in low-resource settings where diagnostic testing is limited or not available .
Based on the results of this review, the Alvarado score at a cut-off of five points compares favourably with other CPRs used in clinical practice. The Ottawa ankle and knee rules represent "rule out" CPRs of similarly high sensitivity that are used in emergency departments to decide if a patient should be referred for radiography to determine if their ankle or knee is fractured. The application of these CPRs is to identify those patients with a very low risk of fracture, where fracture can be confidently ruled out and the patient can be discharged without unnecessary imaging. For this purpose, it is important that such CPRs have high sensitivity. Meta-analysis of validation studies show these rules achieve high sensitivity that is comparable to the Alvarado score at a cut-off of five points (ankle rule - 97.6% , knee rule - 98.5%  and Alvarado score at cut-off of five points - 99%).
The use of the Alvarado score as a 'rule in' CPR for surgery at a cut point of 7 is not supported by our diagnostic test accuracy results. Our analysis indicates that the Alvarado score has moderate to high sensitivity (all studies 82%, men 88%, women 86% and children 87%) and a moderate specificity (all studies 81%, men 57%, women 73% and children 76%), suggesting it is not sufficiently accurate to rule in or rule out surgery (Table 2). However, several studies report that the application of Alvarado score as a sole decision criterion for surgery (cut point of 7) produces negative appendectomy rates of 13.3%, 15.6%, 16.2% and 14.3%, respectively, without an increase in perforations [11, 20, 29, 35]. This is comparable with a clinician's judgment in other reports (17.1%, 12%, 12.5% and 11%) [5, 8, 19, 27]. An Alvarado score ≥ 7 is useful at identifying those at high risk of acute appendicitis who require a surgical consultation or further diagnostic imaging, it should not be used as the sole criterion for ruling in surgery in any patient group.
During the last 10 years, the diagnostic imaging by CT scan in the diagnosis of appendicitis has become a common practice. In some centres over 90% of the patients presenting with suspected appendicitis undergo CT imaging. CT has a high sensitivity and specificity for the diagnosis of appendicitis and it considerably reduces the level of negative appendectomy. However, some studies have shown that the use of CT does not necessarily change the clinical management of a patient, especially in those at high risk [33, 50]. CT imaging may also delay the time of operation and, therefore, may increase the subsequent risk of perforation . Assessing the use of the Alvarado score and CT imaging as a series of diagnostic investigations on all these types of outcomes is warranted.
Lastly, the results of this systematic review have important implications in low-resource countries. First, in low-resource settings where the decision to operate may be based on a clinical judgment, the Alvarado score provides an accurate and consistent triage tool for ruling out appendicitis and identifying those at higher risk who would benefit at most from an admission to a hospital. Second, the Alvarado score could serve as a simplified tool for the emergency physician in order to stratify patients for referral for surgical consultation.
Context of other research
Although the Alvarado score was developed in a mixed gender population, the ratio of men to woman was 1.4:1 and the score has subsequently been shown to perform poorly when applied to women of child-bearing age [8–11]. It is also possible that a certain loss of diagnostic information may have occurred due to dichotomisation when the score was originally constructed in the derivation study. Abdominal pain in women is a diagnostically challenging symptom as there are more diagnostic possibilities aside from appendicitis, such as pelvic inflammatory disease and other gynaecological pathologies. Alternative risk scores or CPRs, such as Lindeberg , Eskelinen  and Fenyo  scores for appendicitis, have different numerical values for symptoms depending on whether the patient is male or female . The Van Way, Teicher and Arnbjornssion scores include gender as one of their components . Of note, Ohman et al.  reported that the Alvarado score outperformed each of these other scores.
Distinguishing appendicitis from other causes of abdominal pain in children is also challenging, particularly in young children who cannot articulate how they feel or where the pain is. There is also a wide variation in presenting symptoms and it is often hard to elicit the classical presentation . The use of symptoms and signs to identify children who are at risk of acute appendicitis is particularly appealing as diagnostic imaging using a CT scan exposes children to ionizing radiation and the diagnostic accuracy of ultrasound is still uncertain . A recent review found that "fever" in a child is the single most important sign associated with appendicitis, followed by rebound tenderness and migration of pain, suggesting that the Alvarado score may not be the most appropriate scoring system for children as double points are scored for tenderness in the right lower quadrant and leukocytosis, but only one point for each of all other signs (Figure 1) . This review also reported the accuracy of clinical scoring systems, including the Alvarado score, where the likelihood ratio for cut points of 7 and 5 (based on three studies) was similar to our pooled estimates (cut point of 7, 3.1 and 3.5; cut point of 5, 0.05 and 0.02, respectively). Two of the studies in the review by Bundy et al. were included in this review [11, 21].
Strengths and weaknesses of the present study
Our study does have a number of limitations. First, although it is usually related mainly to discrimination, some degree of misclassification may have also occurred when calibration was considered by comparing predicted versus observed patients with appendicitis; however, given the high levels of diagnostic performance, overall (especially, at the cut-off point of 5) this appears unlikely.
Second, a moderate to high level of heterogeneity was shown across the included studies in both the diagnostic test accuracy analysis and the calibration analysis (Table 2, Figures 4, 5, 6 and Additional file 1 - Figure S1). There are a number of possible sources for heterogeneity, including chance; variation in pre-test probability; the case mix of men, woman and children; a threshold effect caused by observer variation in the measurement of signs and symptoms; no active follow-up of patients discharged and other unanticipated factors. We addressed a number of these potential sources of heterogeneity by performing subgroup analysis. The main focus of this paper was an analysis of such subgroups as men, woman and children. The performance of the score has been shown by others [8–12] to be affected by age and gender and, therefore, high heterogeneity in the overall results may be due to the gender and age spectrum of the patients in the included studies (for example, Table 2, all studies, variance logit sensitivity is 3.37). The prevalence of appendicitis among the validation studies was highly variable (range 32% to 91%, Table 1). Although this was investigated in a subgroup analysis a good deal of heterogeneity still existed, suggesting that other factors contributed towards heterogeneity in this analysis (Additional file 1 - Figure S2). Unfortunately it was not possible to do further subgroup analysis based on age, gender and prevalence due to a lack of studies with this information. Finally, a number of the studies used no repeat admission as a negative proxy measure for appendicitis. The lack of active follow-up in these studies may have led to misclassification if patients presented to a different hospital. This may have led to a lower reporting of appendicitis cases, particularly in the low-risk groups, and inflated our estimates of sensitivity and specificity.
Finally, although we used an up-to-date systematic search strategy, we acknowledge that it was not exhaustive and it is possible, as with all systematic reviews, that relevant articles may have been missed. As we did not search the grey literature, there is also the possibility of publication bias, with smaller negative studies being under reported, leading to inflated estimates of sensitivity and specificity in our meta-analysis.
Future research and applications in clinical practice
The criteria for selection of the included articles were broad and reflected the nature of the validation studies themselves, producing a high level of heterogeneity across the studies in some of the risk strata. Further analyses are needed to explore the reasons behind the over-prediction of the Alvarado score in women. Such future analyses may suggest ways to adjust the predicted estimates according to the population prevalence in the various settings and/or a re-calibration or re-modelling of the score itself, mainly in low-prevalence settings and in women. Obtaining individual-level data from the validation studies to perform meta-analysis of the risk ratios can make such approaches possible, particularly for the more detailed exploration of the various sources of heterogeneity.
This study shows that the Alvarado score accurately predicts appendicitis and is well calibrated in men. As a decision rule for observation/admission, the Alvarado score performs well as a 'rule out' criterion (high sensitivity). As a decision rule in relation to surgery the Alvarado score cannot be used to 'rule in' a diagnosis of appendicitis without surgical assessment and further diagnostic testing. Patients presenting in the emergency department and in primary care settings, especially in low-resource countries, could benefit from the implementation of the Alvarado score as a triage decision rule.
clinical prediction rules
hierarchical summary receiver operating characteristic
a popular mnemonic used to remember the Alvarado score factors: Migration to the right iliac fossa, Anorexia, Nausea/Vomiting, Tenderness in the right iliac fossa, Rebound pain, Elevated temperature (fever), Leukocytosis, and Shift of leukocytes to the left
- M-H method:
quality assessment of studies of diagnostic accuracy included in systematic reviews
Ergul E: Importance of family history and genetics for the prediction of acute appendicitis. Internet J Surg. 2007, 10: 2.
Bundy DG, Byerley JS, Liles EA, Perrin EM, Katznelson J, Rice HE: Does this child have appendicitis?. JAMA. 2007, 298: 438-451. 10.1001/jama.298.4.438.
Paulson EK, Kalady MF, Pappas TN: Clinical practice. Suspected appendicitis. N Engl J Med. 2003, 348: 236-242. 10.1056/NEJMcp013351.
Reilly BM, Evans AT: Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med. 2006, 144: 201-209.
Alvarado A: A practical score for the early diagnosis of acute appendicitis. Ann Emerg Med. 1986, 15: 557-564. 10.1016/S0196-0644(86)80993-3.
Terasawa T, Blackmore CC, Bent S, Kohlwes RJ: Systematic review: computed tomography and ultrasonography to detect acute appendicitis in adults and adolescents. Ann Intern Med. 2004, 141: 537-546.
Howell JM, Eddy OL, Lukens TW, Thiessen ME, Weingart SD, Decker WW: Clinical policy: critical issues in the evaluation and management of emergency department patients with suspected appendicitis. Ann Emerg Med. 2010, 55: 71-116. 10.1016/j.annemergmed.2009.10.004.
Al Qahtani HH, Muhammad AA: Alvarado score as an admission criterion for suspected appendicitis in adults. Saudi J Gastroenterol. 2004, 10: 86-91.
Kim HE, Park SB, Woo SU, Rho HR, Chae GB, Choi WJ: [Application of the Alvarado score to the diagnosis of acute appendicitis]. J Korean Soc Coloproctol. 2006, 22: 229-234.
Lada PE, Ocho S, Rosso F, Ternengo D, Sanchez M, Di Benedetto N, Carbonell JM, Vaca A: Use of Alvarado's score for the early diagnosis of acute appendicitis. Prensa Med Argentina. 2005, 92: 447-456.
Owen TD, Williams H, Stiff G, Jenkinson LR, Rees BI: Evaluation of the Alvarado score in acute appendicitis. J R Soc Med. 1992, 85: 87-88.
Schneider C, Kharbanda A, Bachur R: Evaluating appendicitis scoring systems using a prospective pediatric cohort. Ann Emerg Med. 2007, 49: 778-784. 10.1016/j.annemergmed.2006.12.016.
Keogh C, Wallace E, O'Brien KK, Murphy PJ, Teljeur C, McGrath B, Smith SM, Doherty N, Dimitrov BD, Fahey T: Optimized retrieval of primary care clinical prediction rules from MEDLINE to establish a web-based register. J Clin Epidemiol. 2011, 64: 848-860. 10.1016/j.jclinepi.2010.11.011.
Review Manager (RevMan) [Computer program]. Version 5.0. 2008, Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration
Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J: The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003, 3: 25-10.1186/1471-2288-3-25.
Dwamena B: Midas: computational and graphical routines for meta-analytical integration of diagnostic accuracy studies in Stata. 2007, Division of Nuclear Medicine, Department of Radiology, University of Michigan Medical School, Ann Arbor, Michigan
Harbord R: Metandi: Stata module for meta-analysis of diagnostic accuracy. 2008, Statistical Software Components Boston College, Department of Economics
Kim K, Rhee JE, Lee CC, Kim KS, Shin JH, Kwak MJ, Kim JH, Suh GJ, Hahn SK, Singer AJ: Impact of helical computed tomography in clinically evident appendicitis. Emerg Med J. 2008, 25: 477-481. 10.1136/emj.2006.044552.
Abdeldaim Y, Mahmood S, Mc Avinchey D: The Alvarado score as a tool for diagnosis of acute appendicitis. Ir Med J. 2007, 100: 342.
Arain GM, Sohu KM, Ahmad E, Haider W, Naqi SA: Role of Alvarado score in diagnosis of acute appendicitis. Pak J Surg. 2001, 17: 41-46.
Bond GR, Tully SB, Chan LS, Bradley RL: Use of the MANTRELS score in childhood appendicitis: a prospective study of 187 children with abdominal pain. Ann Emerg Med. 1990, 19: 1014-1018. 10.1016/S0196-0644(05)82566-1.
Borges PSGN, Lima MdC, Neto GHF: The Alvarado score validation in diagnosing acute appendicitis in children and teenagers at the Instituto Materno Infantil de Pernambuco, IMIP. Rev Bras Saude Mater Infant. 2003, 3: 439-445. 10.1590/S1519-38292003000400008.
Canavosso L, Carena P, Carbonell JM, Monjo L, Palas Zuñiga C, Sánchez M, Lada PE: [Right iliac fossa pain and Alvarado Score]. Cir Esp. 2008, 83: 247-251. 10.1016/S0009-739X(08)70562-1.
Chan MY, Tan C, Chiu MT, Ng YY: Alvarado score: an admission criterion in patients with right iliac fossa pain. Surgeon. 2003, 1: 39-41. 10.1016/S1479-666X(03)80007-0.
Chan MY, Teo BS, Ng BL: The Alvarado score and acute appendicitis. Ann Acad Med Singapore. 2001, 30: 510-512.
Farahnak M, Talaei-Khoei M, Gorouhi F, Jalali A: The Alvarado score and antibiotics therapy as a corporate protocol versus conventional clinical management: randomized controlled pilot study of approach to acute appendicitis. Am J Emerg Med. 2007, 25: 850-852. 10.1016/j.ajem.2007.01.012.
Gwynn LK: The diagnosis of acute appendicitis: clinical assessment versus computed tomography evaluation. J Emerg Med. 2001, 21: 119-123. 10.1016/S0736-4679(01)00353-5.
Hsiao K-H, Lin L-H, Chen D-F: Application of the MANTRELS scoring system in the diagnosis of acute appendicitis in children. Acta Paediatr Taiwan. 2005, 46: 128-131.
Khan I, ur Rehman A: Application of Alvarado scoring system in diagnosis of acute appendicitis. J Ayub Med Coll, Abbottabad. 2005, 17: 41-44.
Wani MM, Yousaf MN, Khan MA, BabaAbdul A, Durrani M, Wani MM, Shafi M: Usefulness of the Alvarado scoring system with respect to age, sex and time of presentation, with regression analysis of individual parameters. Internet J Surg. 2007, 11.
McKay R, Shepherd J: The use of the clinical scoring system by Alvarado in the decision to perform computed tomography for acute appendicitis in the ED. Am J Emerg Med. 2007, 25: 489-493. 10.1016/j.ajem.2006.08.020.
Memon AA, Vohra LM, Khaliq T, Lehri A: Diagnostic accuracy of Alvarado score in the diagnosis of acute appendicitis. Pak J Med Sci. 2009, 25: 118-121.
Petrosyan M, Estrada J, Chan S, Somers S, Yacoub WN, Kelso RL, Mason RJ: CT scan in patients with suspected appendicitis: clinical implications for the acute care surgeon. Eur Surg Res. 2008, 40: 211-219.
Sanabria A, Domínguez LC, Bermúdez C, Serna A: Evaluation of diagnostic scales for appendicitis in patients with lower abdominal pain. Biomedica. 2007, 27: 419-428.
Singh K, Gupta S, Pargal P: Application of Alvarado scoring system in diagnosis of acute appendicitis. JK Sci. 2008, 10: 84-86.
Soomro AG, Siddiqui FG, Abro AH, Abro S, Shaikh NA, Memon AS: Diagnostic accuracy of Alvarado Scoring System in acute appendicitis. J Liaquat Univ Med Health Sci. 2008, 7: 93-96.
Stephens PL, Mazzucco JJ: Comparison of ultrasound and the Alvarado score for the diagnosis of acute appendicitis. Conn Med. 1999, 63: 137-140.
Tade AO: Evaluation of Alvarado score as an admission criterion in patients with suspected diagnosis of acute appendicitis. West Afr J Med. 2007, 26: 210-212.
Yildirim E, Karagulle E, Kirbas I, Turk E, Hasdogan B, Teksam M, Coskun M: Alvarado scores and pain onset in relation to multislice CT findings in acute appendicitis. Diagn Interv Radiol. 2008, 14: 14-18.
Rezak A, Abbas HM, Ajemian MS, Dudrick SJ, Kwasnik EM: Decreased use of computed tomography with a modified clinical scoring system in diagnosis of pediatric acute appendicitis. Arch Surg. 2011, 146: 64-67. 10.1001/archsurg.2010.297.
Shreef KS, Waly AH, Abd-Elrahman S, Abd Elhafez MA: Alvarado score as an admission criterion in children with pain in right iliac fossa. Afr J Paediatr Surg. 2010, 7: 163-165. 10.4103/0189-6725.70417.
Escriba A, Gamell AM, Fernandez Y, Quintilla JM, Cubells CL: Prospective validation of two systems of classification for the diagnosis of acute appendicitis. Pediatr Emerg Care. 2011, 27: 165-169. 10.1097/PEC.0b013e31820d6460.
Saidi RF, Ghasemi M: Role of Alvarado score in diagnosis and treatment of suspected acute appendicitis. Am J Emerg Med. 2000, 18: 230-231. 10.1016/S0735-6757(00)90029-9.
Baidya NRG, Rao A, Khan SA: Evaluation of Alvarado score in acute appendicitis: a prospective study. Internet J Surg. 2007, 9.
Denizbasi A, Unluer EE: The role of the emergency medicine resident using the Alvarado score in the diagnosis of acute appendicitis compared with the general surgery resident. Eur J Emerg Med. 2003, 10: 296-301. 10.1097/00063110-200312000-00011.
Kang W-M, Lee C-H, Chou Y-H, Lin H-J, Lo H-C, Hu S-C, P'eng F-K: A clinical evaluation of ultrasonography in the diagnosis of acute appendicitis. Surgery. 1989, 105: 154-159.
Muenzer JT, Jaffe DM, Schwulst SJ, Dixon DJ, Schierding WS, Li Q, MacMillan SK, Oppedal D, Warner BW, Dillon PA, Lin N, Checchia PA, Cobb JP: Evidence for a novel blood RNA diagnostic for pediatric appendicitis: the riboleukogram. Pediatr Emerg Care. 2010, 26: 333-338. 10.1097/PEC.0b013e3181db1de3.
Bachmann LM, Kolb E, Koller MT, Steurer J, ter Riet G: Accuracy of Ottawa ankle rules to exclude fractures of the ankle and mid-foot: systematic review. BMJ. 2003, 326: 417-10.1136/bmj.326.7386.417.
Bachmann LM, Haberzeth S, Steurer J, ter Riet G: The accuracy of the Ottawa knee rule to rule out knee fractures: a systematic review. Ann Intern Med. 2004, 140: 121-124.
Santos DA, Manunga J, Hohman D, Avik E, Taylor EW: How often does computed tomography change the management of acute appendicitis?. Am Surg. 2009, 75: 918-921.
Karakas SP, Guelfguat M, Leonidas JC, Springer S, Singh SP: Acute appendicitis in children: comparison of clinical diagnosis with ultrasound and CT imaging. Pediatr Radiol. 2000, 30: 94-98. 10.1007/s002470050023.
Lindeberg G, Feny G: Algorithmic diagnosis of appendicitis using Bayes' theorem and logistic regression. Bayesian Statistics 3. Edited by: Bernardo JM, DeGroot MH, Lindley DV, Smith AF. 1988, Oxford, UK: Oxford University Press, 665-669.
Eskelinen M, Ikonen J, Lipponen P: A computer-based diagnostic score to aid in diagnosis of acute appendicitis: a prospective study of 1333 patients with acute abdominal pain. Theor Surg. 1992, 7: 86-90.
Fenyo G: Routine use of a scoring system for decision-making in suspected acute appendicitis in adults. Acta Chir Scand. 1987, 153: 545-551.
Ohmann C, Yang Q, Franke C: Diagnostic scores for acute appendicitis. Eur J Surg. 1995, 161: 273-281.
Malik KA, Khan A, Waheed I: Evaluation of the Alvarado score in diagnosis of acute appendicitis. J Coll Physicians Surg Pak. 2000, 10: 392-394.
Shrivastava UK, Gupta A, Sharma D: Evaluation of the Alvarado score in the diagnosis of acute appendicitis. Trop Gastroenterol. 2004, 25: 184-186.
Winn RD, Laura S, Douglas C, Davidson P, Gani JS: Protocol-based approach to suspected appendicitis, incorporating the Alvarado score and outpatient antibiotics. ANZ J Surg. 2004, 74: 324-329. 10.1111/j.1445-1433.2004.02993.x.
Subotic AM, Sijacki AD, Dugalic VD, Antic AA, Vukovic GM, Vukojevic VS, Glisic TM, Galun D: Evaluation of the Alvarado score in the diagnosis of acute appendicitis. Acta Chir Iugosl. 2008, 55: 55-61.
Andersson M, Andersson RE: The appendicitis inflammatory response score: a tool for the diagnosis of acute appendicitis that outperforms the Alvarado score. World J Surg. 2008, 32: 1843-1849. 10.1007/s00268-008-9649-y.
Prabhudesai SG, Gould S, Rekhraj S, Tekkis PP, Glazer G, Ziprin P: Artificial neural networks: useful aid in diagnosing acute appendicitis. World J Surg. 2008, 32: 305-309. 10.1007/s00268-007-9298-6. discussion 310-311
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/9/139/prepub
We thank Dr Alvaro Sanabria, Dr Kailash Singh, Dr Paul Eduardo Lada, Dr Robert Winn and Dr Madasir Wani for providing additional information on their studies. We also thank Dr. C Teljeur for statistical advice. This study was funded by the Health Research Board of Ireland (HRB) under grant reference HRC/2007/1.
The authors declare that they have no competing interests.
RO, FO'R and KO'B were responsible for study protocol, data collection, and data elaboration and analysis. TF and BDD were responsible for the concept and study design and contributed to the data analysis and their interpretation, and drafting the report. All authors contributed to the interpretation of results, critical review of the manuscript and agreed on the final layout for submission. BDD is guarantor of the study.
Robert Ohle, Fran O'Reilly contributed equally to this work.