Skip to main content
  • Research article
  • Open access
  • Published:

Neutrophil to lymphocyte ratio and cancer prognosis: an umbrella review of systematic reviews and meta-analyses of observational studies

Abstract

Background

Although neutrophils have been linked to the progression of cancer, uncertainty exists around their association with cancer outcomes, depending on the site, outcome and treatments considered. We aimed to evaluate the strength and validity of evidence on the association between either the neutrophil to lymphocyte ratio (NLR) or tumour-associated neutrophils (TAN) and cancer prognosis.

Methods

We searched MEDLINE, Embase and Cochrane Database of Systematic Reviews from inception to 29 May 2020 for systematic reviews and meta-analyses of observational studies on neutrophil counts (here NLR or TAN) and specific cancer outcomes related to disease progression or survival. The available evidence was graded as strong, highly suggestive, suggestive, weak or uncertain through the application of pre-set GRADE criteria.

Results

A total of 204 meta-analyses from 86 studies investigating the association between either NLR or TAN and cancer outcomes met the criteria for inclusion. All but one meta-analyses found a hazard ratio (HR) which increased risk (HR > 1). We did not find sufficient meta-analyses to evaluate TAN and cancer outcomes (N = 9). When assessed for magnitude of effect, significance and bias related to heterogeneity and small study effects, 18 (9%) associations between NLR and outcomes in composite cancer endpoints (combined analysis), cancers treated with immunotherapy and some site specific cancers (urinary, nasopharyngeal, gastric, breast, endometrial, soft tissue sarcoma and hepatocellular cancers) were supported by strong evidence.

Conclusion

In total, 60 (29%) meta-analyses presented strong or highly suggestive evidence. Although the NLR and TAN hold clinical promise in their association with poor cancer prognosis, further research is required to provide robust evidence, assess causality and test clinical utility.

Trial registration

PROSPERO CRD42017069131.

Peer Review reports

Background

Cancer is the second leading cause of mortality worldwide [1], contributing to over 8.7 million deaths globally in 2015 [2]. Cancer incidence is increasing due, in part, to higher morbidity from chronic diseases and epidemiological transitions in developing countries [3]. This increase highlights the importance of identifying prognostic indicators associated with cancer progression such as the neutrophil to lymphocyte ratio (NLR) [4]. The link between inflammation and cancer was first observed by Rudolf Virchow, who detected leukocytes within tumours and hypothesised that inflammation increased cellular proliferation [5]. Since this discovery in the nineteenth century, inflammation has been recognised as one of the six biological capabilities of tumour development and a hallmark of cancer [6], with links to cancer initiation, progression and metastasis [7]. The paradoxical role of neutrophils in both the prevention and facilitation of tumour progression has generated significant research interest around neutrophils in the tumour microenvironment [8].

The NLR has emerged as a potential biomarker of cancer prognosis and is of particular clinical interest due to its accessibility and the ease of calculating the ratio from patients’ routine blood cell counts [9]. The NLR was first recognised for its association with systemic inflammation in the critically ill and meta-analyses on the association between elevated NLR and poor prognosis have reported a wide range of effect sizes, depending on the site of cancer [9, 10]. The close association between inflammation and cancer progression hints at the potential of elevated tumour-associated neutrophils (TAN), or neutrophils which infiltrate tumours [11], as a prognostic biomarker [8, 12, 13]. Many systematic reviews and meta-analyses have explored the association between neutrophils and cancer prognosis. However, the myriad of different cancer sites, stages, treatments, survival outcomes and cut-off values for classifying a “high” NLR complicates the interpretation of this body of evidence.

It is currently unclear how the association between NLR and poor prognosis varies depending on the site of cancer or the treatment considered. Umbrella reviews allow for the analysis of such broad subject areas to examine the strength and credibility of associations using the results of published systematic reviews and meta-analyses [14, 15]. Umbrella review methods assess the strength and consistency of the literature to evaluate bias and identify which associations are supported by strong evidence [14]. Here we carried out an umbrella review of systematic reviews and meta-analyses with the aim of comprehensively evaluating the validity and strength of reported associations between NLR or TAN and cancer prognosis and identify potential biases in relevant literature.

Methods

Literature search

Searches were conducted in MEDLINE, Embase and the Cochrane Database (Additional File 1: Appendix A) and aimed to include all systematic reviews and meta-analyses published in English from inception up to 29 May 2020. Measures of neutrophil counts included NLR and TAN (intratumoural, peritumoural and stromal neutrophils). Overall survival (OS), cancer-specific survival (CSS), progression-free survival (PFS), disease-free survival (DFS) and reoccurrence-free survival (RFS) were considered as cancer outcomes. Articles were initially screened by title and abstract to determine eligibility for full text screening and inclusion using RefWorks web-based bibliography and database manager [16].

Inclusion and exclusion criteria

Included studies were systematic reviews and meta-analyses of individual observational studies in humans with any cancer diagnosis and NLR or TAN measurements taken around the time of diagnosis. Systematic reviews which did not include a meta-analysis were excluded. Meta-analyses were excluded if they did not assess a cancer outcome in our inclusion criteria, included more than one outcome in a single analysis, did not specify the cancer site or included multiple cancer sites in a single analysis without clarifying whether there was a shared feature (e.g. analyses that combined cancers and classified them as “other cancers” without further details). However, meta-analyses which assessed multiple cancers in a single analysis based on a shared feature were included and classified as “composite cancer endpoints”. Meta-analyses were also excluded if they did not provide sufficient detail for replication, such as the hazard ratio (HR), 95% confidence interval and total sample size of each individual study included in a meta-analysis. If a single systematic review included multiple meta-analyses, all meta-analyses were individually assessed for eligibility.

When more than one meta-analysis was identified for a single association at a specific site, they were assessed for concordance in the direction, magnitude and significance of their effect estimates. If the duplicate meta-analyses identified agreed in significance, magnitude and direction of effect, the meta-analysis with the greatest number of component studies was included. Where disagreement was found, both duplicate meta-analyses were excluded unless the disagreement arose from an underpowered meta-analysis (less than five component studies), in which case the meta-analysis with the greatest number of component studies was used.

Data extraction

Data extraction forms were generated to record information from each meta-analysis and the included individual studies. First author, year of publication, outcome measure, biomarker and cancer diagnosis were extracted from each meta-analysis. For each included individual study within a meta-analysis, the first author, year of publication, total population, epidemiological design, HR and 95% confidence interval were extracted, along with analysis method and NLR cut-off where available.

Data analysis

The weighted inverse variance method was used with restricted maximum likelihood (REML) estimations to reproduce all included meta-analyses in R with the “meta” package [17] and “metagen” command [18]. For each cancer site-specific biomarker and outcome pair, the summary effect size and 95% confidence interval were calculated using fixed and random effects models with adjustment by the Knapp-Hartung modification. To take into account heterogeneity between studies, a random effects model was used to compute summary effect size estimates [19, 20]. Estimates from the fixed effects model are also presented.

Each included meta-analysis was reproduced to yield both fixed and random effects estimates. Reproduced random or fixed effect estimates which did not match the results of the original review results were assessed for absolute and percent difference. Meta-analyses with a difference in HR of 0.01 were attributed to rounding errors. Studies with larger discrepancies were investigated to determine the source of disagreement. Where there were issues with reproducibility, the calculated values of the random effects model were used to assess the evidence for the association.

We calculated 95% prediction intervals (PI) in order to assess the impact of uncertainty around the summary effect size estimate and between-study variance (Tau) [21]. Prediction intervals account for the uncertainty caused by heterogeneity when estimating the distribution of true effect sizes in an association and yield an interval which predicts the effect size of future studies investigating the same association [21]. In studies with large amounts of heterogeneity or an effect size close to the null value, the prediction interval may be wide enough to include the null value (HR = 1). This suggests the true effect size in a single meta-analysis may be a HR of 1 or < 1. We further assessed heterogeneity with Cochran’s Q test and quantified using the I2 statistic [22]. We considered Cochran’s Q test to detect a departure from homogeny in the effect sizes of individual studies when P < 0.10 [22]. Due to common limitations associated with Cochran’s Q test, the I2 statistic was also used to quantify the percentage of variation which can be attributed to heterogeneity [22]. The 95% confidence intervals around each I2 value were included to evaluate the uncertainty around estimates of heterogeneity [23]. However, large measures of variation due to heterogeneity, representing true heterogeneity or inconsistency due to bias [24], were primarily assessed through prediction intervals. To further assess heterogeneity, we used sub-group analysis and meta-regression and as detailed below.

To further explore heterogeneity and determine the impact of adjustment with additional prognostic factors, sub-group analyses of the statistical models used in each study were conducted. Meta-analyses which reported the analysis method (univariate or multivariate) of their component studies were included. The Q test for subgroup differences was used to test for significant differences in the random effects model effect size between subgroups in each meta-analysis (P < 0.05).

Meta-regression was used to assess NLR cut-offs as a source of heterogeneity in all component studies that reported them [25]. We used a random-effects meta-regression model with REML estimates to account for residual heterogeneity and the Knapp-Hartung method to adjust CIs and test statistics [26].

Small study effects and funnel plot asymmetry were quantified through the arcsine-Thompson test described by Rücker et al. [27] and the command “metabias” from the R package “meta” [17, 27]. The arcsine-Thompson has greater power than similar tests of small study effects when heterogeneity is present; however, it may be overly conservative when no heterogeneity is present [27]. A low significance value in the arcsine-Thompson test (P < 0.10) was used to indicate presence of small study effects which could reflect publication and other selective reporting biases. Further assessment was carried out to determine if the summary effect size estimate of each meta-analysis was greater than the point estimate of the largest included study, indicating potential small study effects [28]. A meta-analysis was judged to have evidence of small study effects if either one of these criteria was met.

The test for excess significance (TES) was used to determine if the number of observed significant results differed significantly from the expected number, indicating reporting bias [29]. TES results can reveal reporting bias if the number of observed studies with significant results in each meta-analysis is significantly larger than the expected number using a two-tailed binomial probability test (P < 0.10) [30]. The expected number of significant results in each meta-analysis was calculated as the sum of the statistical power estimate, or the probability that each component study will find a positive result [29, 30]. The estimated power for each component study was calculated in Stata 14 [31], using the “power cox” command to calculate the power of each test given its sample size, effect size and significance level. The estimation of power for each component study also requires an estimation of the true effect size, so the effect size of the largest study was used to give an estimation of true effect with the smallest standard error. Estimates from both fixed and random effects models were included for sensitivity analysis. The “binom.test” command in R was used to assess the significance of differences in the number of observed versus expected significant studies using an exact binomial test .

Credibility ceilings were utilised for sensitivity analysis and to test the robustness of meta-analyses, considering studies of biomarkers often underestimate biases due to large sample sizes and observational study design [32, 33]. Credibility ceiling calculations inflate the variance of each study included in a meta-analysis to account for the probability c that the true effect size is in the opposite direction of effect of the observed point estimate [33]. Inflated variances were calculated in Stata 14 [31, 32]. The summary effect size and heterogeneity of each meta-analysis was assessed with ceiling values ranging from 5 to 20%.

Associations between neutrophil counts (here NLR or TAN) and cancer prognosis were categorised into strong, highly suggestive, suggestive, weak or uncertain through assessment of the strength and validity of the evidence for each meta-analysis, according to pre-defined Grading of Recommendations, Assessment, Development and Evaluations (GRADE) criteria outlined in Additional File 2: Supplementary Fig. 1 [34]. In order for an association to be considered strong, the meta-analysis must yield a P value of less than 10− 6 in the random effects model [35], include more than 1000 individuals, show significance at P < 0.05 in the largest included study, find no heterogeneity (P > 0.10) through the Q test, detect less than 50% variance due to heterogeneity through the I2 statistic, yield a prediction interval excluding the null value (HR = 1), display no evidence of small study effects or excess significance, and the association must maintain significance at P < 0.05 with the application of a credibility ceiling of 10%. The number of studies in each meta-analysis was also included as eligibility criterion for strong evidence since a sample size greater than three is required for reliable assessment of heterogeneity and small study effects [22, 36, 37]. Associations categorised as “highly suggestive” were eligible to be upgraded to “strong” if they presented a HR > 2 and a lower 95% CI > 1.6 [38]. To assess the potential impact of limitations around the measures assessing heterogeneity on the GRADE criteria, we performed a sensitivity analysis in which I2 and Cochran’s Q test criteria were removed for associations classified as strong. Additionally, we applied a simplified method to rank associations based only on their effect size estimate (HR) and precision (standard error from PI or CI intervals) to aid interpretation.

Studies with meta-analyses categorised as providing either highly suggestive or strong evidence underwent quality assessment through AMSTAR 2, a tool for assessing the methodological quality of systematic reviews for both health interventions and observational research [39, 40]. Furthermore, assessment of the component studies included in each meta-analysis providing strong evidence was carried out with the Quality in Prognostic Studies (QUIPS) tool [41]. Studies were assessed by two reviewers (MAC and MC) and consensus reached on any disagreements in quality.

Statistical analyses were carried out in R [18], including the packages “meta” version 4.8-4 and “ggplot2” version 2.2.1, and in Stata 14 [17, 31, 42].

Role of the funding source

Funders had no role in data collection, analysis, interpretation or writing of the report. All authors had access to all the data in the study.

Patient involvement

No patients were involved in development of our umbrella review design nor were they asked to advise on interpretation. No ethical approval was required for this review since it relied entirely on anonymised, published data.

Results

Characteristics of included meta-analyses

The 140 published articles meeting the criteria for inclusion contained 517 meta-analyses (Additional File 1: Appendix B). The 204 meta-analyses meeting the eligibility criteria arose from 86 of these articles, published between 2014 and 2020 (Fig. 1) [43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128]. These meta-analyses included individual studies which presented NLR (N = 195) or TAN (N = 9) categorically as either a high or low value. Included meta-analyses summarised effect size estimates from 1978 individual studies, with OS as the most frequently assessed outcome (N = 90). In 135 meta-analyses (66%), total sample size exceeded 1000 individuals and each meta-analysis had a median of seven studies. However, 134 meta-analyses (66%) included less than ten studies and 25 (12%) included only two studies. The characteristics of included meta-analyses are summarised in Additional File 3: Supplementary Table 1.

Fig. 1
figure 1

Flowchart of systematic review and meta-analysis selection

A total of 171 duplicate meta-analyses were excluded. Nine meta-analyses assessing three associations were excluded due to disagreement in significance between duplicates. A further 162 duplicate meta-analyses that agreed in significance, magnitude and direction of effect were excluded for 69 associations and only the meta-analysis with the largest number of studies was included for each association (Additional File 1: Appendix C).

Summary effect size

All estimated summary effect sizes for both fixed and random effects estimates are shown in Additional File 2: Supplementary Figs. 2–205.

Using a threshold of P < 0.05 for statistical significance, 188 of the 204 meta-analyses (92%) were significant with random effects. At a more stringent threshold of P < 10− 6, the number of statistically significant meta-analyses for random effects dropped to 93 (46%) (Additional File 3: Supplementary Table 1). The 93 meta-analyses with significance at P < 10− 6 assessed both NLR and TAN as biomarkers of poor prognosis. Ninety of these 93 meta-analyses (97%) assessed NLR as a biomarker of poor prognosis in melanoma, neurologic, gynaecologic, pancreatic, gastrointestinal and oesophageal, colorectal, hepatocellular and biliary, respiratory and oral, urinary, head and neck, soft tissue sarcoma (STS), treatment with immunotherapy, and composite cancer endpoints. TAN (intratumoural neutrophils) were assessed as a biomarker of poor prognosis in three of the 93 meta-analyses (3%), including urinary and composite cancer endpoints.

In 48 meta-analyses (24%), the largest component study was not statistically significant at P < 0.05. However, 42 (88%) of these meta-analyses still had a statistically significant summary random effects estimate. In three meta-analyses [68, 70, 94], the largest component study had an effect size in the opposite direction to the random effects estimate (HR < 1). The effect size estimates of the largest component studies tended to be more conservative than the random effect estimates, with 136 meta-analyses (67%) yielding a HR which was greater than the point estimate of the largest component study. However, there was correlation between the log (HR) of the summary random effects and the largest component study for each meta-analysis, indicating consistency in the results (Fig. 2a).

Fig. 2
figure 2

Assessment of consistency in meta-analyses. a Log (HR) of largest study versus log (HR) of random effects estimates for each meta-analysis. The Y-axis labelled “log (HR) Largest Study” represents the log of the HR of the largest component study. The X-axis labelled “log (HR) Random Effects” represents the log of the HR of the random effects estimate calculated in each meta-analysis. b Random effects estimates versus inverse variance. The Y-axis labelled “Random Effects Estimates Hazard Ratio” represents the HR of random effects estimate for each meta-analysis. The X-axis labelled “Inverse Variance” represents the inverse of the variance for each meta-analysis. c, d Box plots of random effects HR estimates for each meta-analysis by cancer site and outcome. The Y-axis labelled “HR” details the effect size for each meta-analysis describing an association between NLR or TAN and cancer prognosis for each site grouping. The X-axis labelled “Site” in c represents each site group meta-analyses have been sorted into. The composite endpoints subgroup is defined as a grouping of cancer diagnosis unrelated to site, stage or treatment. The X-axis labelled “Outcome” in d represents the prognostic outcome assessed in each meta-analysis. The outlier of HR = 14 for NLR and OS in rectal cancer has been excluded from these figures

In order to determine the impact of study size on the magnitude of the summary effect size, random effects estimates were plotted against the inverse variance of the pooled effect size from each meta-analysis. When compared to meta-analyses with large variances, those with smaller variances produced more conservative estimates, displaying a smaller range of HR estimates and a slight tendency toward a null value (HR = 1). Meta-analyses with large variance displayed a wide range of random effects HR and included an increased number of HR estimates greater than two (Fig. 2b).

Reproducibility

In 87 of the 204 included meta-analyses (43%), the pooled effect size was reproduced with an absolute difference between the calculated and reported HR outside of the range which can be attributed to rounding errors (> 0.01). Twenty-eight of these 87 meta-analyses were within 2% of the reported HR, 35 were between 2% and 5% of the reported HR, 14 were between 5% and 10% and ten meta-analyses reported an HR with over a 10% difference from the calculated HR (Additional File 1: Appendix D).

Heterogeneity between studies

Prediction intervals were not calculated for 25 (12%) meta-analyses which had included only two individual studies (Additional File 3: Supplementary Table 1). The prediction intervals of 131 meta-analyses (64%) included the null value of HR = 1. Of 179 meta-analyses (87%) including at least three individual studies, 47 had prediction intervals which excluded the null value (HR = 1). The 25 meta-analyses (12%) including exactly three individual studies yielded very wide prediction intervals, all of which included the null value of HR = 1. For completeness, we also calculated I2 values and Cochran’s Q test although they must be interpreted with caution due to low power, consistent direction of effect and moderate magnitude of effects (Additional File 1: Appendix E).

Subgroup analyses of adjustment of effect estimates

In the subgroup analyses of the 48 meta-analyses (24%) which reported on the analysis methods utilised by component studies, a significant difference was found between the multivariate and univariate groups in only six (13%) meta-analyses (Additional File 1: Appendix F and Additional File 2: Supplementary Figs. 2–205). In general, adjustment of HRs resulted in minor modification in the strength of association with no consistent pattern. In most cases, summary estimates obtained with the random effects model showed slightly stronger or weaker associations with no change in the direction of effect and no major differences in the width of the 95% CI. However, we note that the majority of studies had 10 or fewer component studies. In studies where both univariate and multivariate meta-analyses included at least five component studies, 95% PIs tended to be wider for multivariate studies, with lower bounds close to the null.

Study authors of the included meta-analyses often reported that HRs derived from multivariate models were preferentially included. Additional factors that were typically adjusted for included gender, age, smoking, body mass index, co-morbidities, C-reactive protein, primary tumour location, stage and grade. These could constitute a core set which future studies could consider adjusting for at a minimum. Concurrent infections, other inflammatory markers (such as fibrinogen and erythrocyte sedimentation rate), ethnicity and current medications were not typically reported and could modify the estimates.

Meta-regressions of NLR threshold values

156 meta-analyses (76%) reported sufficient information on NLR cut-offs to undergo meta-regression analysis (Additional File 1: Appendix G). Of these, 97 (62%) yielded a positive association between NLR and effect size, however only 14 (11%) showed significance. In the remaining 59 meta-analyses (38%) with a negative association, only three (5%) showed significance. We observed extreme R2 in many cases, likely due to small sample sizes [129]. In 82 meta-analyses (53%), the addition of NLR cut-off did not account for any of the heterogeneity observed, indicated by an R2 value of 0%. In 15 (20%) of the remaining 74 meta-analyses, the addition of NLR cut-off values accounted for 100% of the heterogeneity, with a mean and standard deviation of 50.15 ± 39.94%.

Results of the meta-regressions should be interpreted with caution since only 58 meta-analyses (37%) included the recommended threshold of ten or more component studies to be considered reliable [25]. Of these 58 meta-analyses, 42 (72%) suggested a positive association between NLR and effect size, with only four (10%) showing significance. The 16 meta-analyses (28%) suggesting a negative association did not show significance. Bubble plots of the regression of log HR on NLR cut-off are available in Additional File 2: Supplementary Figs. 2–205. Although few showed significance, most meta-regressions yielded a positive association between NLR cut-off and effect size, suggesting the dose-response relationship should be explored further in future studies. Ideally, continuous data should be reported instead of non-standardised thresholds.

Small study effects

179 meta-analyses (88%) included two or more studies and were eligible for further assessment through the arcsine-Thompson test for publication bias [27]. Eighty-eight (49%) of these 179 meta-analyses yielded significant P-values (P < 0.10), indicating potential small study effects. The presence of small study effects was also assessed through comparison of the random effects model effect estimate and the effect estimate of the largest component study. In 68 meta-analyses (33%), the summary effects estimate from the largest component study was larger than the point estimate of the model and were considered to have evidence of small study effects. Taking both criteria into account, 136 (67%) of the 204 included meta-analyses were judged to have evidence of small study effects (Additional File 1: Appendix E).

Excess significance

Forty-two meta-analyses (21%) showed evidence of excess significance bias according to the TES when the effect size of the largest component study was utilised as an estimate of true effect size (Additional File 1: Appendix H). When the fixed summary effect sizes were utilised as an estimation of true effect size, 50 meta-analyses (25%) showed evidence of excess significance. Four meta-analyses (2%) showed evidence when the random summary effect sizes were used.

Credibility ceilings

The summary effect size estimates and significance of each meta-analysis matched that of the random effects model at a credibility ceiling of 0%, with 188 of the 204 meta-analyses being significant at P < 0.05 (93%) (Table 1).

Table 1 Credibility ceiling results

At a ceiling of 5%, 178 maintained significance (87%) and 139 (68%), 84 (41%) and 51 (25%) maintained significance at ceilings of 10%, 15% and 20%, respectively. All of the meta-analyses remained consistent in direction of effect (HR > 1) up to a ceiling of 15% and three (1.5%) yielded an effect estimate in the opposite direction (HR < 1) with a ceiling of 20%. The I2 value of each meta-analysis decreased with each increase in ceiling value.

Grading the evidence

Each included meta-analysis was evaluated to determine if the association of interest was supported by strong, highly suggestive, suggestive or weak evidence (Additional File 1: Appendix I). In 16 meta-analyses (8%), no significance was detected at a threshold of P < 0.05. The remaining 188 meta-analyses (92%) provided at least weak evidence of an association (P < 0.05) (Table 2).

Table 2 Grading of evidence

Strong evidence was presented in 18 meta-analyses (9%) for associations between NLR and poor cancer prognosis. Seven of these associations met the grade criteria for strong evidence, including PFS in non-muscle-invasive bladder cancer (N = 6; HR 2.26, 95%CI 1.59–3.22), OS and PFS in nasopharyngeal cancer (N = 10; HR 1.48, 95%CI 1.29–1.69 and N = 5; HR 1.50, 95%CI 1.30–1.73), OS in castration-resistant prostate cancer (N = 9; HR 1.56, 95%CI 1.42–1.72), RFS in bladder cancer with urothelial transurethral resection (UTR) (N = 5; HR 2.22, 95%CI 1.81–2.74), OS in endometrial cancer (N = 9, HR 2.22, 95%CI 1.76–2.79) and DFS in soft tissue sarcoma (STS) (N = 7, HR 1.72, 95%CI 1.43–2.08) and the other 11 were upgraded from highly suggestive (Additional File 1: Appendix J), including DFS in composite cancer endpoints (N = 20; HR 2.11, 95%CI 1.71–2.60), OS in advanced cancer with anti-vascular endothelial growth factor receptors (VEGFR) (N = 14; HR 2.02, 95%CI 1.61–2.53), OS in cancer with immune checkpoint inhibitors (ICI) (N = 18; HR 2.21, 95%CI 1.70–2.88), OS in gastric cancer with surgical resection (SR) (N = 7; HR 3.13, 95%CI 1.99–4.92), OS in colorectal liver metastasis (CLM) (N = 7; HR 2.17, 95%CI 1.83–2.57), OS in CLM with SR (N = 5; HR 2.08, 95%CI 1.73–2.49), OS in breast cancer (N = 13, HR 2.54, 95%CI 1.96–3.30), OS in renal cancer with tyrosine kinase inhibitors (TKIs) (N = 7; HR 2.14, 95%CI 1.66–2.76), OS in melanoma with ICI (N = 9, HR 2.49, 95%CI 1.72–3.61), OS in non-small cell lung cancer (NSCLC) with PD-1 inhibitors (N = 13, HR 2.59, 95%CI 2.10–3.20) and OS in breast cancer with SR (N = 12, HR 2.47, 95%CI 1.71–3.56).

Forty-two meta-analyses (21%) presented associations supported by highly suggestive evidence, including associations between increased NLR and poor prognosis in composite cancer endpoints, cancers treated with immunotherapy, gastric, colorectal, CLM, pancreatic, gynaecologic, breast, hepatocellular, biliary, NSCLC, lung, head and neck, oral, renal, advanced renal cancer, upper urinary and bladder, STS and bladder. The most commonly assessed outcome for highly suggestive associations was OS (N = 26), followed by PFS (N = 7), DFS (N = 5) and RFS (N = 4).

Fifty-one meta-analyses (25%) provided suggestive evidence for an association between high NLR (N = 50) or TAN (N = 1) and poor cancer prognosis, and 77 meta-analyses (38%) provided weak evidence for an association between high NLR or TAN and poor cancer prognosis. The association between intratumoural neutrophils and overall survival in composite cancer endpoints was classified as suggestive, but there was weak evidence supporting associations with peritumoural neutrophils or stromal neutrophils. Details of the grading and upgrading for each meta-analysis are included in Additional File 1: Appendices I and J.

Sensitivity analysis of evidence classification

The sensitivity analysis of GRADE criteria resulted in only one association between NLR and OS in gastric cancer being reclassified from highly suggestive to strong when I2 and Cochran’s Q test criteria were removed (Additional File 1: Appendix K). To aid interpretation, we also ranked studies by precision (inverse of the standard error of 95% PI or 95% CI) and then by effect size (Additional File 1: Appendix L). We observed a moderate but highly significant positive correlation between rankings (Kendall’s rank correlation tau = 0.31, P value = 1.32e−07 for GRADE and SE 95% PI rank). Although GRADE criteria are limited by rigid thresholds, these analyses suggest they are relatively robust and considerably improve the classification of evidence for quality and strength of recommendations.

Quality assessment

The 38 meta-analyses categorised as providing either highly suggestive (N = 26) or strong evidence (N = 12) arose from 30 individually published studies. Of the 26 highly suggestive meta-analyses, four were from studies ranked as critically low quality (15%), five as low quality (19%), seventeen as moderate quality (65%) and one as high quality (4%). The twelve meta-analyses categorised as providing strong evidence were ranked as moderate quality (N = 8, 67%), low quality (N = 3, 25%) and critically low quality (N = 1, 8%) (Additional File 1: Appendix M). From the 86 review studies included, we found that 10 (12%) did not assess the risk of bias in component studies, 7 (8%) used QUIPS and the remainder used various other tools (Additional File 1: Appendix N, Table 1). We assessed the risk of bias in the 42 unique component studies included from the seven review studies graded as strong and considered most (N = 37) to be at low risk of bias (Additional File 1: Appendix N, Table 2).

Discussion

A total of 204 associations between elevated NLR or TAN and cancer outcomes were reviewed to assess the strength of the evidence supporting them. Twelve associations were supported by strong evidence. Although the studies included showed strong consistency in direction of effect and moderate effect sizes, we detected poor reproducibility of findings overall as well as evidence of heterogeneity and small-study effects.

Risk of elevated neutrophil to lymphocyte ratio

Previous studies have documented the prognostic role of neutrophils, particularly the NLR, and their link with poor outcomes for many cancer sites [10]. We found that 92% of the included meta-analyses had a significant HR through random effects estimates (P < 0.05). However, a cautious interpretation is required due to the presence of heterogeneity and small study effect biases. Associations supported by strong evidence included elevated NLR in urinary (prostate and non-muscle-invasive bladder) and nasopharyngeal cancers, amongst others. Future research should assess the association between the NLR and prognosis in oral and respiratory cancers by environmental exposures, such as smoking status, to ensure these do not confound associations.

CLM represents a unique case where metastasis has already occurred and may present a link between elevated NLR and poor prognosis in metastasised cancers. It is interesting to note that the associations between NLR and OS and PFS in colorectal cancer also included patients with different stages of metastasis according to the tumour node metastasis (TNM) system. These associations were supported by highly suggestive and suggestive evidence, respectively, and emerged from a study of moderate quality. To determine the impact of advanced cancer stages, metastasis and subtypes of cancer on the association between the NLR and cancer outcomes, future studies should consider these additional factors carefully when assessing the prognostic potential of the NLR.

Risk of tumour-associated neutrophils

Although previous studies suggest a link between TAN and the progression of cancer in the tumour microenvironment [11, 13, 130], the evidence for their association was mostly classified as weak or uncertain. The significance of these associations may have been limited by small sample size, and it is important to note that all meta-analyses considering TAN arose from a single publication and may be subject to the same limitations [55]. The association between TAN and cancer outcomes holds potential for a strong association due to the large effect size observed in this review and the plausibility of the biological mechanism behind the relationship [8]. However, a recently published individual study on this association found that high levels of TAN had a protective effect in cancer [131], indicating that additional research is required.

Strengths

A key strength of this study comes from the use of umbrella review methodology which only includes meta-analyses as evidence for quantitative data analyses [14]. The use of meta-analyses ensures that effect size estimates are a balanced representation of the available evidence, as demonstrated by the sensitivity analysis of the association between elevated NLR and OS in rectal cancer from Dong et al. (Additional File 1: Appendix O) [114]. When an extreme outlier detected in this meta-analysis was removed from the analysis, the random effects estimate was not considerably altered due to the small weighting given to studies with large variances.

Although there are considerable differences between the included meta-analyses in terms of cancer site, stage and treatment, all but one of the HR estimates reported in these meta-analyses were in the same direction of effect. This finding suggests consistency in the relationship between neutrophil biomarkers and poor outcomes across a wide spectrum of cancer diagnoses.

Limitations

Only 39% of the identified meta-analyses were eligible for inclusion and 16% of the identified meta-analyses were excluded because they did not include sufficient data to be reproduced. Furthermore, we were unable to reproduce 43% of the included studies within 0.01 of the reported HR, highlighting issues with transparency and reproducibility of findings in epidemiologic research [132]. Umbrella reviews also fail to include evidence published in individual studies after the last published meta-analyses. However, all the included meta-analyses in our review were recently published, with the oldest published in 2014, so the exclusion of individual studies in our case may be minimal. This exclusion of individual studies is of greatest concern in the association between TAN and cancer outcomes, due to the availability of a single systematic review, which yielded all nine meta-analysis considered.

Umbrella reviews are reliant on the quality of the included meta-analyses. This methodological limitation is of concern since 42% of the studies which yielded meta-analyses with highly suggestive or strong evidence were ranked as low or critically low quality by AMSTAR 2 (Additional File 1: Appendix M). The application of AMSTAR 2 for the purpose of ranking the quality of systematic reviews of prognostic studies may also present a limitation in itself, as there are currently no tools designed specifically for this. There is also some concern over consistency, since meta-analyses aggregated the results of individual studies which categorised patients’ NLR or TAN levels as high or low using different cut-off values (Additional File 1: Appendix G) and utilised different analysis methods which adjusted for a range of confounders (Additional File 1: Appendix F). Due to heterogeneity in these values, it is not possible to establish a dose-response relationship between NLR and cancer prognosis.

The assessment of heterogeneity using Cochran’s Q test and the I2 statistic is problematic with varying sizes of component studies. Although some studies recommend the interpretation of the I2 value with 95% confidence intervals [36], we did not utilise them as grading criteria since 168 of our included meta-analyses (82%) include less than 15 studies [36]. Cochran’s Q test also has weak power when there are few studies and excess power in detecting heterogeneity when studies are numerous, both of which are complications in this study [22]. The sensitivity analysis removing I2 and Cochran’s Q test was conducted to assess the potential impact of these limitations, and the resulting reclassification of only a single association suggests the GRADE criteria are relatively robust.

Causal association

This umbrella review does not address causality directly and cannot determine whether the association between neutrophils and poor prognosis in cancer is causal or due to confounding or reverse causation [133, 134]. Previous studies have highlighted the paradoxical role of neutrophils in both tumour progression and suppression [13]. Our study suggests that the overall effect of high NLR could be tumourigenic in certain cases, but further work is required to assess this.

Our study supports the relationship between elevated NLR and poor outcomes in cancer in terms of effect size and consistency of findings. We cannot address temporality as the studies included measured biomarkers before the initiation of treatment but after diagnosis. The biological mechanisms behind inflammation and cancer progression could suggest temporality, as elevated NLR and TAN are proposed to promote increased cell proliferation, angiogenesis and risk of metastasis as contributors to poor prognosis [5, 13, 135].

Clinical significance and future research

Future research should focus on strengthening the current evidence base for specific cancers which displayed suggestive and highly suggestive associations, addressing heterogeneity and small-study issues. Unveiling a causal association between neutrophils and cancer outcomes could lead to cancer treatments which involve neutrophils as a therapeutic target and validate the NLR as a prognostic biomarker in cancer. A causal association between neutrophils and poor prognosis could give further insight into experimental therapy which lowers neutrophil counts in the body to improve outcomes in cancer [136,137,138,139]. Sub-group analysis suggested that the magnitude and direction of effect of NLR on cancer outcomes was robust to adjustment for additional prognostic factors. Regardless, consensus on a minimum set of covariates to adjust for is needed. Furthermore, the dose response relationship between NLR and prognosis remains unclear. Within the included papers, only two of the 86 conducted a dose response analysis [80, 140]. Future work should consider whether the association is linear or has threshold effects. In light of the variation observed in meta-regressions of NLR cut-off and effect size, identification of a clinically relevant NLR cut-off could be specific to different cancer sites and may be affected by treatment. Future systematic reviews should consider performing individual patient data (IPD) meta-analyses to allow for the assessment of NLR values on a continuous scale.

Conclusion

The quantitative evidence presented suggests an association between elevated NLR and poor outcomes in cancer patients across a wide spectrum of diagnoses, stages of disease and courses of treatment. The evidence is strongest for associations between NLR and OS in prostate, non-muscle-invasive bladder and nasopharyngeal cancer, amongst others. Overall however, and in particular for associations between TAN and poor prognosis in cancer patients, evidence is limited by study quality, heterogeneity and small-study effects. Further research is required to overcome the limitations of the existing evidence.

Availability of data and materials

The datasets generated and analysed during the current study are available in the “Neutrophils-and-Cancer-Prognosis” repository, at https://github.com/megcupp. All authors had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis. The corresponding author had final responsibility for the decision to submit for publication.

Abbreviations

NLR:

Neutrophil to lymphocyte ratio

TAN:

Tumour-associated neutrophils

HR:

Hazard ratio

OS:

Overall survival

CSS:

Cancer-specific survival

PFS:

Progression-free survival

DFS:

Disease-free survival

RFS:

Reoccurrence-free survival

REML:

Restricted maximum likelihood

PI:

Prediction intervals

TES:

Test for excess significance

GRADE:

Grading of Recommendations, Assessment, Development and Evaluations

QUIPS:

Quality in Prognostic Studies

ICI:

Immune checkpoint inhibitors

UTR:

Urothelial transurethral resection

VEGFR:

Anti-vascular endothelial growth factor receptors

SR:

Surgical resection

CLM:

Colorectal liver metastasis

TKI:

Tyrosine kinase inhibitor

NSCLC:

Non-small cell lung cancer

TNM:

Tumour node metastasis

References

  1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2017. CA Cancer J Clin. 2017;67(1):7–30. https://doi.org/10.3322/caac.21387.

    Article  PubMed  Google Scholar 

  2. Collaboration GB of DC. Global, regional, and national cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life-years for 32 cancer groups, 1990 to 2015: a systematic analysis for the global burden of disease study. JAMA Oncol. 2017;3(4):524–48.

    Article  Google Scholar 

  3. Omran AR. The epidemiologic transition: a theory of the epidemiology of population change. Milbank Q. 2005;83(4):731–57. https://doi.org/10.1111/j.1468-0009.2005.00398.x.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Gospodarowicz M, O’Sullivan B. Prognostic factors in cancer. Semin Surg Oncol. 2003;21(1):13–8. https://doi.org/10.1002/ssu.10016.

    Article  PubMed  Google Scholar 

  5. Coussens LM, Werb Z. Inflammation and cancer. Nature. 2002;420(6917):860–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Hanahan D, Weinberg RA. Hallmarks of cancer: the next generation. Cell. 2017;144(5):646–74. https://doi.org/10.1016/j.cell.2011.02.013.

    Article  CAS  Google Scholar 

  7. Grivennikov SI, Greten FR, Karin M. Immunity, inflammation, and cancer. Cell. 2010;140(6):883–99. https://doi.org/10.1016/j.cell.2010.01.025.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Powell DR, Huttenlocher A. Neutrophils in the tumor microenvironment. Trends Immunol. 2017;37(1):41–52. https://doi.org/10.1016/j.it.2015.11.008.

    Article  CAS  Google Scholar 

  9. Zahorec R. Ratio of neutrophil to lymphocyte counts--rapid and simple parameter of systemic inflammation and stress in critically ill. Bratisl Lek Listy. 2011;102(1):5–14. https://doi.org/10.1021/tx0600393.

    Article  CAS  Google Scholar 

  10. Templeton AJ, McNamara MG, Seruga B, et al. Prognostic role of neutrophil-to-lymphocyte ratio in solid tumors: a systematic review and meta-analysis. J Natl Cancer Inst. 2014;106(6):dju124.

    PubMed  Google Scholar 

  11. Jensen HK, Donskov F, Marcussen N, Nordsmark M, Lundbeck F, von der Maase H. Presence of intratumoral neutrophils is an independent prognostic factor in localized renal cell carcinoma. J Clin Oncol. 2009;27(28):4709–17. https://doi.org/10.1200/JCO.2008.18.9498.

    Article  PubMed  Google Scholar 

  12. Granot Z, Henke E, Comen EA, King TA, Norton L, Benezra R. Tumor entrained neutrophils inhibit seeding in the premetastatic lung. Cancer Cell. 2017;20(3):300–14. https://doi.org/10.1016/j.ccr.2011.08.012.

    Article  CAS  Google Scholar 

  13. Coffelt SB, Wellenstein MD, de Visser KE. Neutrophils in cancer: neutral no more. Nat Rev Cancer. 2016;16(7):431–46.

    CAS  PubMed  Google Scholar 

  14. Aromataris E, Fernandez R, Godfrey C, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc. 2015;13:132–40. https://doi.org/10.1097/XEB.0000000000000055.

    Article  PubMed  Google Scholar 

  15. Ioannidis JPA. Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. C Can Med Assoc J. 2009;181(8):488–93. https://doi.org/10.1503/cmaj.081086.

    Article  Google Scholar 

  16. Reichardt C. RefWorks: http://www.refworks.com. Public Services Quarterly. 2010;6(4):366–7.

  17. Schwarzer G. meta: An R package for meta-analysis. R news. 2007;7(3):40–5.

  18. Team RC. R Core Team. R: A language and environment for statistical computing. Foundation for Statistical Computing 2013.

  19. Riley RD, Higgins JPT, Deeks JJ. Interpretation of random effects meta-analyses. BMJ. 2011;342 https://doi.org/10.1136/bmj.d549.

  20. Hedges LV, Vevea JL. Fixed- and random-effects models in meta-analysis. Psychol Methods. 1998;3(4):486–504.

    Google Scholar 

  21. Salanti G, Ades AE, Ioannidis JPA. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64(2):163–171. https://doi.org/10.1016/j.jclinepi.2010.03.016.

  22. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60. https://doi.org/10.1136/bmj.327.7414.557.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Ioannidis JPA, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ. 2007;335(7626):914–6.

    PubMed  PubMed Central  Google Scholar 

  24. Hoaglin DC. Misunderstandings about Q and “Cochran’s Q test” in meta-analysis. Stat Med. 2016;35:485–95.

    PubMed  Google Scholar 

  25. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11):1559–73. https://doi.org/10.1002/sim.1187.

    Article  PubMed  Google Scholar 

  26. Panityakul T, Bumrungsup C, Knapp G. On estimating residual heterogeneity in random-effects meta-regression: a comparative study. J Stat Theory Appl. 2013;12(3):253–65. https://doi.org/10.2991/jsta.2013.12.3.4.

    Article  Google Scholar 

  27. Rücker G, Schwarzer G, Carpenter J. Arcsine test for publication bias in meta-analyses with binary outcomes. Vol 27; 2008. https://doi.org/10.1002/sim.2971.

  28. Sterne JAC, Sutton AJ, Ioannidis JPA, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343 https://doi.org/10.1136/bmj.d4002.

  29. Ioannidis JPA, Trikalinos TA. An exploratory test for an excess of significant findings. Clin Trials. 2007;4(3):245–53. https://doi.org/10.1177/1740774507079441.

    Article  PubMed  Google Scholar 

  30. Tsilidis KK, Papatheodorou SI, Evangelou E, Ioannidis JPA. Evaluation of excess statistical significance in meta-analyses of 98 biomarker associations with cancer risk. JNCI J Natl Cancer Inst. 2012;104(24):1867–78. https://doi.org/10.1093/jnci/djs437.

    Article  CAS  PubMed  Google Scholar 

  31. StataCorp. Stata statistical software: release 14. College Station: StataCorp LP; 2015.

    Google Scholar 

  32. Papatheodorou SI, Tsilidis KK, Evangelou E, Ioannidis JPA. Application of credibility ceilings probes the robustness of meta-analyses of biomarkers and cancer risk. J Clin Epidemiol. 2015;68(2):163–74. https://doi.org/10.1016/j.jclinepi.2014.09.004.

    Article  PubMed  Google Scholar 

  33. Salanti G, Ioannidis JPA. Synthesis of observational studies should consider credibility ceilings. J Clin Epidemiol. 2009;62(2):115–22. https://doi.org/10.1016/j.jclinepi.2008.05.014.

    Article  PubMed  Google Scholar 

  34. Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924. LP - 926.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Johnson VE. Revised standards for statistical evidence. Proc Natl Acad Sci. 2013;110(48):19313–7. https://doi.org/10.1073/pnas.1313476110.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Thorlund K, Imberger G, Johnston BC, et al. Evolution of heterogeneity (I2) estimates and their 95% confidence intervals in large meta-analyses. PLoS One. 2012;7(7):e39471.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Sterne JAC, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):1119–29. https://doi.org/10.1016/S0895-4356(00)00242-0.

    Article  CAS  PubMed  Google Scholar 

  38. Schünemann H, Higgins J, Vist G, et al. Domains that may lead to increasing the certainty level of a body of evidence. In: Higgins J, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 6. Cochrane; 2019.

  39. Shea B, Reeves B, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ. 2017;358:j4008.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Pieper D, Mathes T, Eikermann M. Can AMSTAR also be applied to systematic reviews of non-randomized studies? BMC Res Notes. 2014;7(1):609. https://doi.org/10.1186/1756-0500-7-609.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Hayden JA, van der Windt DA, Cartwright JL, Côté P, Bombardier C. Assessing bias in studies of prognostic factors. Ann Intern Med. 2013;158(4):280–6. https://doi.org/10.7326/0003-4819-158-4-201302190-00009.

    Article  PubMed  Google Scholar 

  42. Wickham H. Package ggplot2: create elegant data Visualisations using the grammar of graphics; 2016.

    Google Scholar 

  43. Jiang T, Qiao M, Zhao C, et al. Pretreatment neutrophil-to-lymphocyte ratio is associated with outcome of advanced-stage cancer patients treated with immunotherapy: a meta-analysis. Cancer Immunol Immunother. 2018;67(5):713–27.

    PubMed  Google Scholar 

  44. Mei Z, Shi L, Wang B, et al. Prognostic role of pretreatment blood neutrophil-to-lymphocyte ratio in advanced cancer survivors: a systematic review and meta-analysis of 66 cohort studies. Cancer Treat Rev. 2017;58:1–13.

    Article  PubMed  Google Scholar 

  45. Ethier J-L, Desautels D, Templeton A, Shah PS, Amir E. Prognostic role of neutrophil-to-lymphocyte ratio in breast cancer: a systematic review and meta-analysis. Breast Cancer Res. 2017;19(1):2.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  46. Liu X, Qu JK, Zhang J, et al. Prognostic role of pretreatment neutrophil to lymphocyte ratio in breast cancer patients. Med (United States). 2017;96(45):e8101. https://doi.org/10.1097/MD.0000000000008101.

  47. Chen J, Pan Y, He B, et al. Meta-analysis of prognostic value of inflammation parameter in breast cancer. J Cancer Res Ther. 2018;14(Supplement):ate of Pubaton: 01 Mar 2018.

  48. Duan J, Pan L, Yang M. Preoperative elevated neutrophil-to-lymphocyte ratio (NLR) and derived NLR are associated with poor prognosis in patients with breast cancer: a meta-analysis. Medicine (Baltimore). 2018;97(49):e13340. https://doi.org/10.1097/MD.0000000000013340.

  49. Guo W, Lu X, Liu Q, et al. Prognostic value of neutrophil-to-lymphocyte ratio and platelet-to-lymphocyte ratio for breast cancer patients: an updated meta-analysis of 17079 individuals. Cancer Med. 2019;8(9):4135–4148. https://doi.org/10.1002/cam4.2281.

  50. Wu J, Chen M, Liang C, Su W. Prognostic value of the pretreatment neutrophil-to-lymphocyte ratio in cervical cancer: a meta-analysis and systematic review. Oncotarget. 2017;8(8):13400–12.

    PubMed  PubMed Central  Google Scholar 

  51. Zhang J, Zhang H-Y, Li J, Shao X-Y, Zhang C-X. The elevated NLR, PLR and PLT may predict the prognosis of patients with colorectal cancer: a systematic review and meta-analysis. Oncotarget. 2017;8(40):68837–46.

    PubMed  PubMed Central  Google Scholar 

  52. Zheng DC, Zheng C, Wu J, et al. Neutrophil-lymphocyte ratio predicts the prognosis of patients with colorectal cancer: a meta-analysis. Int J Clin Exp Med. 2015;9(1):78–90.

    Google Scholar 

  53. Malietzis G, Giacometti M, Kennedy RH, Athanasiou T, Aziz O, Jenkins JT. The emerging role of neutrophil to lymphocyte ratio in determining colorectal cancer treatment outcomes: a systematic review and meta-analysis. Ann Surg Oncol. 2014;21(12):3938–46.

    PubMed  Google Scholar 

  54. Li H, Zhao Y, Zheng F. Prognostic significance of elevated preoperative neutrophil-to-lymphocyte ratio for patients with colorectal cancer undergoing curative surgery: a meta-analysis. Medicine (Baltimore). 2019;98(3):e14126. https://doi.org/10.1097/MD.0000000000014126.

  55. Shen M, Hu P, Donskov F, Wang G, Liu Q, Du J. Tumor-associated neutrophils as a new prognostic factor in cancer: a systematic review and meta-analysis. PLoS One. 2014;9(6):e98259.

    PubMed  PubMed Central  Google Scholar 

  56. Tang H, Li B, Zhang A, Lu A, Xiang C. Prognostic significance of neutrophil-to-lymphocyte ratio in colorectal liver metastasis: a systematic review and meta-analysis. PLoS One. 2016;11(7):e0159447.

    PubMed  PubMed Central  Google Scholar 

  57. Ni L, Tao J, Xu J, et al. Prognostic values of pretreatment neutrophil - to - lymphocyte and platelet - to - lymphocyte ratios in endometrial cancer : a systematic review and meta - analysis 2019;(0123456789). https://doi.org/10.1007/s00404-019-05372-w.

  58. Sun J, Chen X, Gao P, et al. Can the neutrophil to lymphocyte ratio be used to determine gastric cancer treatment outcomes? A systematic review and meta-analysis. Dis Markers. 2016;2016:7862469.

    PubMed  PubMed Central  Google Scholar 

  59. Zhang X, Zhang W, Feng L. Prognostic significance of neutrophil lymphocyte ratio in patients with gastric cancer: a meta-analysis. PLoS One. 2014;9(11):e111906.

    PubMed  PubMed Central  Google Scholar 

  60. Szor DJ, Dias AR, Pereira MA, et al. Prognostic role of neutrophil/lymphocyte ratio in resected gastric cancer: a systematic review and meta-analysis. Clinics (Sao Paulo). 2018;73:e360.

  61. Mellor KL, Powell AGMT, Lewis WG. Systematic review and meta-analysis of the prognostic significance of neutrophil-lymphocyte ratio (NLR) after R0 gastrectomy for cancer. J Gastrointest Cancer. 2018;49(3):237–44.

    PubMed  PubMed Central  Google Scholar 

  62. Zhou Y, Li D, Lin Y, et al. Pretreatment hematologic markers as prognostic predictors of gastroenteropancreatic neuroendocrine tumors: a systematic review and meta-analysis. Onco Targets Ther. 2018;11:2489–96.

  63. Luo X-F, Zhou L-H. Prognostic significance of neutrophil to lymphocyte ratio in patients with gastrointestinal stromal tumors: a meta-analysis. Clin Chim Acta. 2018;477:7–12.

    CAS  PubMed  Google Scholar 

  64. Lei Y-Y, Li Y-T, Hu Q-L, et al. Prognostic impact of neutrophil-to-lymphocyte ratio in gliomas: a systematic review and meta-analysis. World J Surg Oncol. 2019;17(1):152. https://doi.org/10.1186/s12957-019-1686-5.

  65. Ethier J-L, Desautels DN, Templeton AJ, Oza A, Amir E, Lheureux S. Is the neutrophil-to-lymphocyte ratio prognostic of survival outcomes in gynecologic cancers? A systematic review and meta-analysis. Gynecol Oncol. 2017;145(3):584–94.

    PubMed  Google Scholar 

  66. Paramanathan A, Saxena A, Morris DL. A systematic review and meta-analysis on the impact of pre-operative neutrophil lymphocyte ratio on long term outcomes after curative intent resection of solid tumours. Surg Oncol. 2014;23(1):31–9.

    PubMed  Google Scholar 

  67. Yu Y, Wang H, Yan A, et al. Pretreatment neutrophil to lymphocyte ratio in determining the prognosis of head and neck cancer: a meta-analysis. BMC Cancer. 2018;18(1):383.

    PubMed  PubMed Central  Google Scholar 

  68. Tham T, Bardash Y, Herman SW, Costantino PD. Neutrophil-to-lymphocyte ratio as a prognostic indicator in head and neck cancer: a systematic review and meta-analysis. Head Neck. 2018;(pagination):ate of Pubaton: 2018.

  69. Yang L, Huang Y, Zhou L, et al. High pretreatment neutrophil-to-lymphocyte ratio as a predictor of poor survival prognosis in head and neck squamous cell carcinoma: systematic review and meta-analysis. Head Neck. 2019;41(5):1525–1535. https://doi.org/10.1002/hed.25583.

  70. Cho J-K, Kim MW, Choi IS, et al. Optimal cutoff of pretreatment neutrophil-to-lymphocyte ratio in head and neck cancer patients: a meta-analysis and validation study. BMC Cancer. 2018;18(1):969. https://doi.org/10.1186/s12885-018-4876-6.

  71. Min G-TT, Li Y-MM, Yao N, Wang J, Wang H-PP, Chen W. The pretreatment neutrophil-lymphocyte ratio may predict prognosis of patients with liver cancer: a systematic review and meta-analysis. Clin Transplant. 2018;32(1):Arte Number: e13151. ate of Pubaton: January 2018.

  72. Xiao W-K, Chen D, Li S-Q, Fu S-J, Peng B-G, Liang L-J. Prognostic significance of neutrophil-lymphocyte ratio in hepatocellular carcinoma: a meta-analysis. BMC Cancer. 2014;14:117.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  73. L. L, Y. G, Q. Z, et al. Prognostic roles of blood inflammatory markers in hepatocellular carcinoma patients taking sorafenib. A systematic review and meta-analysis. Front Oncol. 2019;9:1557. https://doi.org/10.3389/fonc.2019.01557.

  74. Wang Y, Peng C, Cheng Z, et al. The prognostic significance of preoperative neutrophil-lymphocyte ratio in patients with hepatocellular carcinoma receiving hepatectomy: a systematic review and meta-analysis. Int J Surg. 2018;55:73–80.

    Article  PubMed  Google Scholar 

  75. Li S, Feng X, Cao G, Wang Q, Wang L. Prognostic significance of inflammatory indices in hepatocellular carcinoma treated with transarterial chemoembolization: a systematic review and meta-analysis. PLoS One. 2020;15(3):e0230879. https://doi.org/10.1371/journal.pone.0230879.

  76. Xu Z-GG, Ye C-JJ, Liu L-XX, et al. The pretransplant neutrophil-lymphocyte ratio as a new prognostic predictor after liver transplantation for hepatocellular cancer: a systematic review and meta-analysis. Biomark Med. 2018;12(2):189–99.

    Article  CAS  PubMed  Google Scholar 

  77. Dolan RD, McSorley ST, Horgan PG, et al. The role of the systemic inflammatory response in predicting outcomes in patients with operable cancer: systematic review and meta-analysis. Sci Rep. 2017;116(1):134–46.

    Google Scholar 

  78. Tan Q, Liu S, Liang C, Han X, Shi Y. Pretreatment hematological markers predict clinical outcome in cancer patients receiving immune checkpoint inhibitors: a meta-analysis. August: Thorac Cancer; 2018.

    Google Scholar 

  79. X. X, J. L, H. Y, et al. Prognostic value of baseline neutrophil-to-lymphocyte ratio in outcome of immune checkpoint inhibitors. Cancer Invest. 2019;37(6):265–274. https://doi.org/10.1080/07357907.2019.1639057.

  80. Mu S, Ai L, Fan F, Qin Y, Sun C, Hu Y. Prognostic role of neutrophil-to-lymphocyte ratio in diffuse large B cell lymphoma patients: an updated dose-response meta-analysis. Cancer Cell Int. 2018;18:119.

    PubMed  PubMed Central  Google Scholar 

  81. Mascarella MA, Mannard E, Silva SD, Zeitouni A. Neutrophil-to-lymphocyte ratio in head and neck cancer prognosis: a systematic review and meta-analysis. Head Neck. 2018;40(5):1091–100.

    PubMed  Google Scholar 

  82. Zhao Q-T, Yang Y, Xu S, et al. Prognostic role of neutrophil to lymphocyte ratio in lung cancers: a meta-analysis including 7,054 patients. Onco Targets Ther. 2015;8:2731–8.

    CAS  PubMed  PubMed Central  Google Scholar 

  83. Yu Y, Qian L, Cui J. Value of neutrophil-to-lymphocyte ratio for predicting lung cancer prognosis: a meta-analysis of 7,219 patients. Mol Clin Oncol. 2017;7(3):498–506.

    CAS  PubMed  PubMed Central  Google Scholar 

  84. Zhan H, Ma J-Y, Jian Q-C. Prognostic significance of pretreatment neutrophil-to-lymphocyte ratio in melanoma patients: a meta-analysis. Clin Chim Acta. 2018;484:136–40. https://doi.org/10.1016/j.cca.2018.05.055.

    Article  CAS  PubMed  Google Scholar 

  85. Ding Y, Zhang S, Qiao J. Prognostic value of neutrophil-to-lymphocyte ratio in melanoma: evidence from a PRISMA-compliant meta-analysis. Medicine (Baltimore). 2018;97(30):e11446.

    Google Scholar 

  86. Chen N, Liu S, Huang L, et al. Prognostic significance of neutrophil-to-lymphocyte ratio in patients with malignant pleural mesothelioma: a meta-analysis. Oncotarget. 2017;.

  87. Zeng Q, Liu Z, Li Q, Liu T. Prognostic value of neutrophil to lymphocyte ratio and clinicopathological characteristics for multiple myeloma: a meta-analysis. Medicine (Baltimore). 2018;97(41):e12678. https://doi.org/10.1097/MD.0000000000012678.

  88. Tang H, Lu W, Li B, Li C, Xu Y, Dong J. Prognostic significance of neutrophil-to-lymphocyte ratio in biliary tract cancers: a systematic review and meta-analysis. Oncotarget. 2017;8(22):36857–68.

    Article  PubMed  PubMed Central  Google Scholar 

  89. Yang S, Zhao K, Ding X, et al. Prognostic significance of hematological markers for patients with nasopharyngeal carcinoma: a meta-analysis. J Cancer. 2019;10(11):2568–2577. https://doi.org/10.7150/jca.26770.

  90. Yin J, Qin Y, Luo YK, Feng M, Lang JY. Prognostic value of neutrophil-to-lymphocyte ratio for nasopharyngeal carcinoma. Med (United States). 2017;96(29) (pagination):Arte Number: e7577. ate of Pubaton: 01 Ju 2017.

  91. Su L, Zhang M, Zhang W, Cai C, Hong J. Pretreatment hematologic markers as prognostic factors in patients with nasopharyngeal carcinoma. Med (United States). 2017;96(11) (pagination):Arte Number: e6364. ate of Pubaton: 01 Mar 2017.

  92. Li X, Dai D, Chen B, Tang H, Xie X, Wei W. The value of neutrophil-to-lymphocyte ratio for response and prognostic effect of neoadjuvant chemotherapy in solid tumors: a systematic review and meta-analysis. J Cancer. 2018;9(5):861–71.

    PubMed  PubMed Central  Google Scholar 

  93. Vartolomei MD, PoravHodade D, Ferro M, et al. Prognostic role of pretreatment neutrophil-to-lymphocyte ratio (NLR) in patients with non-muscle-invasive bladder cancer (NMIBC): a systematic review and meta-analysis. Urol Oncol Semin Orig Investig. 2018;(pagination):ate of Pubaton: 2018.

  94. Lu Y, Jiang J, Ren C. The clinicopathological and prognostic value of the pretreatment neutrophil-to-lymphocyte ratio in small cell lung cancer: a meta-analysis. PLoS One. 2020;15(4):e0230979. https://doi.org/10.1371/journal.pone.0230979.

  95. Gu XB, Tian T, Tian XJ, Zhang XJ. Prognostic significance of neutrophil-to-lymphocyte ratio in non-small cell lung cancer: a meta-analysis. Sci Rep. 2015;5:12493. https://doi.org/10.1038/srep12493.

  96. Wang Z, Zhan P, Lv Y, et al. Prognostic role of pretreatment neutrophil-to-lymphocyte ratio in non-small cell lung cancer patients treated with systemic therapy: a meta-analysis. Transl lung cancer Res. 2019;8(3):214–226. https://doi.org/10.21037/tlcr.2019.06.10.

  97. Cao D, Xu H, Xu X, Guo T, Ge W. A reliable and feasible way to predict the benefits of nivolumab in patients with non-small cell lung cancer: a pooled analysis of 14 retrospective studies. Oncoimmunology. 2018;(pagination):ate of Pubaton: 2018.

  98. Jiang T, Bai Y, Zhou F, et al. Clinical value of neutrophil-to-lymphocyte ratio in patients with non-small-cell lung cancer treated with PD-1/PD-L1 inhibitors. Lung Cancer. 2019;130:76–83. https://doi.org/10.1016/j.lungcan.2019.02.009.

  99. Hu G, Xu F, Zhong K, et al. The prognostic role of preoperative circulating neutrophil-lymphocyte ratio in primary bladder cancer patients undergoing radical cystectomy: a meta-analysis. World J Urol. 2019;37(9):1817–1825. https://doi.org/10.1007/s00345-018-2593-z.

  100. Zhang X, Wang Y, Zhao L, Sang S, Zhang L. Prognostic value of platelet-to-lymphocyte ratio in oncologic outcomes of esophageal cancer: a systematic review and meta-analysis. Int J Biol Markers. 2018;33(4):335–344. https://doi.org/10.1177/1724600818766889.

  101. Pirozzolo G, Gisbertz SS, Castoro C, van Berge Henegouwen MI, Scarpa M. Neutrophil-to-lymphocyte ratio as prognostic marker in esophageal cancer: a systematic review and meta-analysis. J Thorac Dis. 2019;11(7):3136–3145. https://doi.org/10.21037/jtd.2019.07.30.

  102. Yang Y, Liu R, Ren F, Guo R, Zhang P. Prognostic and clinicopathological significance of neutrophil-to-lymphocyte ratio in patients with oral cancer. Biosci Rep. 2018;38(6). https://doi.org/10.1042/BSR20181550.

  103. Wang Y, Wang P, Andrukhov O, et al. Meta-analysis of the prognostic value of the neutrophil-to-lymphocyte ratio in oral squamous cell carcinoma. J Oral Pathol Med. 2018;47(4):353–8.

    CAS  PubMed  Google Scholar 

  104. Zhou Q, Hong L, Zuo M-Z, He Z. Prognostic significance of neutrophil to lymphocyte ratio in ovarian cancer: evidence from 4,910 patients. Oncotarget. 2017;8(40):68938–49.

    PubMed  PubMed Central  Google Scholar 

  105. Zhou Y, Cheng S, Fathy AH, Qian H, Zhao Y. Prognostic value of platelet-to-lymphocyte ratio in pancreatic cancer: a comprehensive meta-analysis of 17 cohort studies. Onco Targets Ther. 2018;11:1899–1908. https://doi.org/10.2147/OTT.S154162.

  106. Yang JJ, Hu ZG, Shi WX, Deng T, He SQ, Yuan SG. Prognostic significance of neutrophil to lymphocyte ratio in pancreatic cancer: a meta-analysis. World J Gastroenterol. 2015;21(9):2807–2815. https://doi.org/10.3748/wjg.v21.i9.2807.

  107. Mowbray NG, Griffith D, Hammoda M, et al. A meta-analysis of the utility of the neutrophil-to-lymphocyte ratio in predicting survival after pancreatic cancer resection. HPB. 2018;20(5):379–84.

    PubMed  Google Scholar 

  108. Zhou Y, Cheng S, Fathy AH, et al. Prognostic value of platelet-tolymphocyte ratio in pancreatic cancer: A comprehensive meta-analysis of 17 cohort studies. Onco Targets Ther. 2018;11:1899–908.

    PubMed  PubMed Central  Google Scholar 

  109. Guo J, Fang J, Huang X, et al. Prognostic role of neutrophil to lymphocyte ratio and platelet to lymphocyte ratio in prostate cancer: a meta-analysis of results from multivariate analysis. Int J Surg. 2018;60:216–23. https://doi.org/10.1016/j.ijsu.2018.11.020.

    Article  PubMed  Google Scholar 

  110. Wu S, Zhao X, Wang Y, et al. Pretreatment neutrophil-lymphocyte ratio as a predictor in bladder cancer and metastatic or unresectable urothelial carcinoma patients: a pooled analysis of comparative studies. Cell Physiol Biochem. 2018;46(4):1352–64.

    Article  CAS  PubMed  Google Scholar 

  111. Cao J, Zhu X, Zhao X, Li X-F, Xu R. Neutrophil-to-lymphocyte ratio predicts PSA response and prognosis in prostate cancer: a systematic review and meta-analysis. PLoS One. 2016;11(7):e0158770.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  112. Yin X, Xiao Y, Li F, Qi S, Yin Z, Gao J. Prognostic role of neutrophil-to-lymphocyte ratio in prostate cancer: a systematic review and meta-analysis. Medicine (Baltimore). 2016;95(3):e2544. https://doi.org/10.1097/MD.0000000000002544.

    Article  Google Scholar 

  113. Guan Y, Xiong H, Feng Y, Liao G, Tong T, Pang J. Revealing the prognostic landscape of neutrophil-to-lymphocyte ratio and platelet-to-lymphocyte ratio in metastatic castration-resistant prostate cancer patients treated with abiraterone or enzalutamide: a meta-analysis. Prostate Cancer Prostatic Dis. 2020;23(2):220–31. https://doi.org/10.1038/s41391-020-0209-3.

    Article  CAS  PubMed  Google Scholar 

  114. Dong YW, Shi YQ, He LW, Su PZ. Prognostic significance of neutrophil-to-lymphocyte ratio in rectal cancer: a meta-analysis. Onco Targets Ther. 2016;9:3127–34. https://doi.org/10.2147/OTT.S103031.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  115. Na N, Yao J, Cheng C, et al. Meta-analysis of the efficacy of the pretreatment neutrophil-tolymphocyte ratio as a predictor of prognosis in renal carcinoma patients receiving tyrosine kinase inhibitors. Oncotarget. 2016;7(28):44039–46.

    Article  PubMed  PubMed Central  Google Scholar 

  116. Luo Y, She D-L, Xiong H, Fu S-J, Yang L. Pretreatment neutrophil to lymphocyte ratio as a prognostic predictor of urologic tumors: a systematic review and meta-analysis. Medicine (Baltimore). 2015;94(40):e1670.

    Article  Google Scholar 

  117. Semeniuk-Wojtas A, Lubas A, Stec R, et al. Neutrophil-to-lymphocyte ratio, platelet-to-lymphocyte ratio, and C-reactive protein as new and simple prognostic factors in patients with metastatic renal cell cancer treated with tyrosine kinase inhibitors: a systemic review and meta-analysis. Clin Genitourin Cancer. 2018;16(3):e693.

    Article  Google Scholar 

  118. Boissier R, Campagna J, Branger N, Karsenty G, Lechevallier E. The prognostic value of the neutrophil-lymphocyte ratio in renal oncology: a review. Urol Oncol. 2017;35(4):135–41.

    Article  PubMed  Google Scholar 

  119. Li L, Bai Z, Zhang L, Zhang Y, Lu X, Ibrahim T. Meta-analysis of hematological biomarkers as reliable indicators of soft tissue sarcoma prognosis 2020;10:1–12. https://doi.org/10.3389/fonc.2020.00030.

  120. Liu G, Ke L-CC, Sun S-RR. Prognostic value of pretreatment neutrophil-to-lymphocyte ratio in patients with soft tissue sarcoma: a meta-analysis. Medicine (Baltimore). 2018;97(36):e12176.

    Google Scholar 

  121. Suh J, Jung JH, Jeong CW, et al. Clinical significance of pre-treated neutrophil-lymphocyte ratio in the management of urothelial carcinoma: a systemic review and meta-analysis. Front Oncol. 2019;9:1365. https://doi.org/10.3389/fonc.2019.01365.

    Article  PubMed  PubMed Central  Google Scholar 

  122. Feng J, Wang Y, Shan G, Gao L. Clinical and prognostic value of neutrophil-lymphocyte ratio for patients with thyroid cancer: a meta-analysis. Medicine (Baltimore). 2020;99(20):e19686. https://doi.org/10.1097/MD.0000000000019686.

    Article  CAS  Google Scholar 

  123. Wei Y, Jiang Y-Z, Qian W-H. Prognostic role of NLR in urinary cancers: a meta-analysis. PLoS One. 2014;9(3):e92079.

    PubMed  PubMed Central  Google Scholar 

  124. Su S, Liu L, Li C, Zhang J, Li S. Prognostic role of pretreatment derived neutrophil to lymphocyte ratio in urological cancers: a systematic review and meta-analysis. Int J Surg. 2019;72:146–53. https://doi.org/10.1016/j.ijsu.2019.10.043.

    Article  PubMed  Google Scholar 

  125. Vartolomei MD, Kimura S, Ferro M, et al. Is neutrophil-to-lymphocytes ratio a clinical relevant preoperative biomarker in upper tract urothelial carcinoma? A meta-analysis of 4385 patients. World J Urol. 2018;36(7):1019–29.

    CAS  PubMed  Google Scholar 

  126. Mori K, Janisch F, Mostafaei H, et al. Prognostic value of preoperative blood-based biomarkers in upper tract urothelial carcinoma treated with nephroureterectomy: a systematic review and meta-analysis. Urol Oncol. 2020;38(5):315–33. https://doi.org/10.1016/j.urolonc.2020.01.015.

    Article  CAS  PubMed  Google Scholar 

  127. Mori K, Miura N, Mostafaei H, et al. Prognostic value of preoperative hematologic biomarkers in urothelial carcinoma of the bladder treated with radical cystectomy: a systematic review and meta-analysis. Int J Clin Oncol. 2020. https://doi.org/10.1007/s10147-020-01690-1.

  128. Li X, Ma X, Tang L, et al. 2017. Prognostic value of neutrophil-to-lymphocyte ratio in urothelial carcinoma of the upper urinary tract and bladder: a systematic review and meta-analysis. Oncotarget. 2017;8(37):62681.

  129. López-López JA, Marín-Martínez F, Sánchez-Meca J, Van den Noortgate W, Viechtbauer W. Estimation of the predictive power of the model in mixed-effects meta-regression: a simulation study. Br J Math Stat Psychol. 2014;67(1):30–48. https://doi.org/10.1111/bmsp.12002.

    Article  PubMed  Google Scholar 

  130. Galdiero MR, Bonavita E, Barajon I, Garlanda C, Mantovani A, Jaillon S. Tumor associated macrophages and neutrophils in cancer. Immunobiology. 2013;218(11):1402–10. https://doi.org/10.1016/j.imbio.2013.06.003.

    Article  CAS  PubMed  Google Scholar 

  131. Berry RS, Xiong M, Greenbaum A, et al. High levels of tumor-associated neutrophils are associated with improved overall survival in patients with stage II colorectal cancer. PLoS One. 2017;12(12):e0188799.

    PubMed  PubMed Central  Google Scholar 

  132. Siegel V. Reproducibility in research. Dis Model Mech. 2011;4(3):279–80. https://doi.org/10.1242/dmm.008037.

    Article  PubMed  PubMed Central  Google Scholar 

  133. Höfler M. The Bradford Hill considerations on causality: a counterfactual perspective. Emerg Themes Epidemiol. 2005;2(1):11. https://doi.org/10.1186/1742-7622-2-11.

    Article  PubMed  PubMed Central  Google Scholar 

  134. Fedak KM, Bernal A, Capshaw ZA, Gross S. Applying the Bradford Hill criteria in the 21st century: how data integration has changed causal inference in molecular epidemiology. Emerg Themes Epidemiol. 2015;12:14. https://doi.org/10.1186/s12982-015-0037-4.

    Article  PubMed  PubMed Central  Google Scholar 

  135. Jablonska J, Leschner S, Westphal K, Lienenklaus S, Weiss S. Neutrophils responsive to endogenous IFN-β regulate tumor angiogenesis and growth in a mouse tumor model. J Clin Invest. 2010;120(4):1151–64. https://doi.org/10.1172/JCI37223.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  136. Kim K, Skora AD, Li Z, et al. Eradication of metastatic mouse cancers resistant to immune checkpoint blockade by suppression of myeloid-derived cells. Proc Natl Acad Sci. 2014;111(32):11774–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  137. Pekarek L, Starr B, Toledano A, Schreiber H. Inhibition of tumor growth by elimination of granulocytes. J Exp Med. 1995;181(1):435–40.

    CAS  PubMed  Google Scholar 

  138. Gregory AD, McGarry HA. Tumor-associated neutrophils: new targets for cancer therapy. Cancer Res. 2011;71(7):2411. LP - 2416.

    CAS  PubMed  Google Scholar 

  139. Szczerba BM, Castro-Giner F, Vetter M, et al. Neutrophils escort circulating tumour cells to enable cell cycle progression. Nature. 2019;566(7745):553–7. https://doi.org/10.1038/s41586-019-0915-y.

    Article  CAS  PubMed  Google Scholar 

  140. Dolan RD, Lim J, McSorley ST, Horgan PG, McMillan DC. The role of the systemic inflammatory response in predicting outcomes in patients with operable cancer: systematic review and meta-analysis. Sci Rep. 2017;7(1):16717.

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank David Muller for advice.

Funding

AJBT was supported by the Medical Research Council (UK MED-BIO Programme Fellowship, MR/L01632X/1).

Author information

Authors and Affiliations

Authors

Contributions

AJBT conceived the study. MAC, AJBT and IT designed the study. MAC collected data and performed the analysis with input from MC, IT, ABJT, DA and EE. MAC and AJBT wrote the manuscript with contributions from all authors. All authors critically revised and approved the manuscript.

Corresponding author

Correspondence to Antonio J. Berlanga-Taylor.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Appendix A. Search strategy. Appendix B. 517 extracted meta-analyses with exclusions identified. Appendix C. Assessment of duplicate meta-analyses. Appendix D. Description of 87 meta-analyses with poor reproducibility. Appendix E. Heterogeneity and small-study effects in included meta-analyses. Appendix F: Results of subgroup analysis of adjusted versus unadjusted effect estimates. Appendix G. Meta-regression results of NLR cut-off values. Appendix H. Excess significance in included meta-analyses. Appendix I: Grading of evidence (GRADE criteria). Appendix J: Effect size upgrading of GRADE. Appendix K. Sensitivity analysis of GRADE. Appendix L. Ranking based on precision versus effect size. Appendix M. AMSTAR 2 Quality Rating of Meta-analyses with Highly Suggestive or Strong Evidence. Appendix N. Assessment of quality of component studies. Appendix O: Sensitivity analysis of overall survival in rectal cancer.

Additional file 2.

Supplementary Figs. 1–205.

Additional file 3.

Supplementary Table 1.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cupp, M.A., Cariolou, M., Tzoulaki, I. et al. Neutrophil to lymphocyte ratio and cancer prognosis: an umbrella review of systematic reviews and meta-analyses of observational studies. BMC Med 18, 360 (2020). https://doi.org/10.1186/s12916-020-01817-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-020-01817-1

Keywords