Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Are immune-related adverse events associated with the efficacy of immune checkpoint inhibitors in patients with cancer? A systematic review and meta-analysis

BMC Medicine volume 18, Article number: 87 (2020) Cite this article

A Commentary to this article was published on 21 April 2020

Abstract

Background

A number of studies have reported an association between the occurrence of immune-related adverse events (irAEs) and clinical efficacy in patients undergoing treatment with immune checkpoint inhibitors (ICIs), but the results remain controversial.

Methods

Under the guidance of a predefined protocol and Preferred Reporting Items for Systematic Reviews and Meta-analyses statement, this meta-analysis included cohort studies investigating the association of irAEs and efficacy of ICIs in patients with cancer. The primary outcome was overall survival (OS), and the secondary outcome was progression-free survival (PFS). Subgroup analyses involving the cancer type, class of ICIs, combination therapy, sample size, model, landmark analysis, and approach used to extract the data were performed. Specific analyses of the type and grade of irAEs were also performed.

Results

This meta-analysis included 30 studies including 4971 individuals. Patients with cancer who developed irAEs experienced both an OS benefit and a PFS benefit from ICI therapy compared to patients who did not develop irAEs (OS: hazard ratio (HR), 0.54, 95% confidence interval (CI), 0.45–0.65; p < 0.001; PFS: HR, 0.52, 95% CI, 0.44–0.61, p < 0.001). Subgroup analyses of the study quality characteristics and cancer types recapitulated these findings. Specific analyses of endocrine irAEs (OS: HR, 0.52, 95% CI, 0.44–0.62, p < 0.001), dermatological irAEs (OS: HR, 0.45, 95% CI, 0.35–0.59, p < 0.001), and low-grade irAEs (OS: HR, 0.57, 95% CI, 0.43–0.75; p < 0.001) yielded similar results. The association between irAE development and a favorable benefit on survival was significant in patients with cancer who were undergoing treatment with programmed cell death-1 inhibitors (OS: HR, 0.51, 95% CI, 0.42–0.62; p < 0.001), but not cytotoxic T-lymphocyte antigen-4 inhibitors (OS: HR, 0.89, 95% CI, 0.49–1.61; p = 0.706). Additionally, the association was significant in patients with cancer who were treated with ICIs as a monotherapy (OS: HR, 0.53, 95% CI, 0.43–0.65; p < 0.001), but not as a combination therapy (OS: HR, 0.62, 95% CI, 0.36–1.05; p = 0.073).

Conclusions

The occurrence of irAEs was significantly associated with a better ICI efficacy in patients with cancer, particularly endocrine, dermatological, and low-grade irAEs. Further large-scale prospective studies are warranted to validate our findings.

Systematic review registration

PROSPERO CRD42019129310.

Peer Review reports

Background

Immune checkpoint inhibitors (ICIs) targeting cytotoxic T-lymphocyte antigen-4 (CTLA-4) or programmed cell death-1 (PD-1) pathways are reshaping the landscape of cancer therapy, yielding unprecedented clinical success in treating multiple cancer types [1]. By blocking the inhibitory pathway between T lymphocytes and tumor cells or antigen-presenting cells, ICIs aim to release the brake of the anergized T cells and reactivate their antitumor cytolytic function [2]. Monoclonal antibodies targeting CTLA-4 and PD-1/programmed cell death ligand-1 (PD-L1) axes are currently two major categories applied in cancer immunotherapies. Immune-related adverse events (irAEs) are a unique spectrum of side effects of ICIs that resemble autoimmune responses. irAEs affect almost every organ of the body and are most commonly observed in the skin, gastrointestinal tract, lung, and endocrine, musculoskeletal, and other systems [3]. Since irAEs occur via a process of immune activation, suggesting that the exhausted immune cells have been reinvigorated and attack not only tumor cells but also normal tissue, theoretically, the occurrence of irAEs may indicate a better response to ICI therapy. Nevertheless, whether irAE development is predictive of the ICI response remains controversial.

A number of recent studies has supported this hypothesis by showing favorable outcomes for patients with non-small cell lung cancer (NSCLC) and melanoma who developed various irAEs in response to immune checkpoint inhibition [4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22]. However, a definite conclusion has not been drawn based on the findings from each single study, as contradictory results exist [23,24,25,26,27,28,29,30,31,32,33,34,35]. A systemic review included 16 studies and reported that irAEs such as pneumonitis, thyroid disorders, myalgias, and mucosal toxicity did not show a significant correlation with overall survival (OS) [36]. However, this review contained an insufficient number of studies and pooled analyses were not performed. Controversy persists regarding whether irAE development predicts the ICI response. A robust and precise systemic review is required to evaluate the association between irAE occurrence and the efficacy of ICIs.

Herein, we conducted a systemic review of the published studies to investigate the association between irAE occurrence and the efficacy of ICIs. We used a standard meta-analysis approach to obtain a statistical and comprehensive view of the association. Our study addressed the question using the PECO tools: (P) patients with cancer receiving ICIs, (E) occurrence of irAEs, (C) non-occurrence of irAEs, (O) efficacy of ICIs (measured using different outcomes). To the best of our knowledge, the present study is the first meta-analysis to explore the association of the occurrence of irAE and the efficacy of ICIs by pooling the results of eligible studies collectively. Additionally, we separately pooled the predictive effects of different irAE types and irAE grades to investigate their specific roles in homogeneous settings.

Methods

This systematic review and meta-analysis was conducted under the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statement [37]. We prospectively registered the protocol in PROSPERO (ID: CRD42019129310). Additional information about the methods is provided in the appendix (Additional file 1: Supplementary Methods).

Literature search strategy

We retrieved articles from the PubMed, Embase, and Cochrane databases to identify studies that reported the association between irAE occurrence and the efficacy of ICIs in patients with cancer that were published from database inception to March 22, 2019. The key retrieval items included irAEs, PD-1, PD-L1, CTLA-4, efficacy, and cancer. No restriction for time was established, while language was confined to English. We also manually reviewed the citations of relevant reviews, editorials, and commentaries and included relevant studies to avoid omission. We performed an additional retrieval from the database inception to June 3, 2019, to identify recent published studies using the same procedure.

Inclusion and exclusion criteria

The following inclusion criteria were adopted:

  • Studies that enrolled patients diagnosed with cancer who had been treated with at least one of the following ICIs: nivolumab, pembrolizumab, atezolizumab, durvalumab, avelumab, or ipilimumab

  • Studies that reported an association between irAE occurrence and ICI efficacy in patients with cancer, including hazard ratios (HRs) of OS and progression-free survival (PFS) in patients who experienced irAEs versus non-irAE patients

  • Studies that reported available survival data for the extraction of HRs and 95% confidence intervals (CIs) or p values

  • Studies that enrolled patients who had received prior treatment or current combination treatment were eligible (e.g., chemotherapy, radiotherapy, and vaccine therapy)

  • Prospective or retrospective cohort studies, including on-trial and off-trial patients

  • Studies published in peer-reviewed journals in English.

Studies not adhering to the inclusion criteria were excluded. Other exclusion criteria were as follows:

  • Studies that reported adverse events that were not related to immune function

  • Studies that reported only survival curves and p values, but not HRs, for the association between the occurrence of irAEs and the efficacy of ICIs

  • For duplicate publications or overlapping study populations, we included only the most recent and complete report.

Data collection and quality assessment

Two researchers (X.Z. and Z.Y.) independently extracted data from the included publications in accordance with a predefined procedure. The data extracted included the author, publication year, area in which the population was located, trial design, criteria for grading irAEs, statistical model, variables for adjustment, landmark analysis, cancer type, agent, follow-up time, sample size, irAE type, grade of irAE, median irAE onset time, and HRs and 95% CIs of OS and PFS for global irAEs, organ-specific irAEs, and grade-specific irAEs. If a study reported both multivariate and univariate HRs, the former was extracted to avoid confounding. If a study reported both HRs with or without a landmark analysis, the former was chosen to avoid time-dependent bias.

The two researchers (X.Z. and Z.Y.) also independently reviewed the included publications to evaluate their methodological quality with the Newcastle-Ottawa scale (NOS) criteria [38]. Every included study was awarded a score ranging from 0 (poor methodological quality) to 9 (optimal methodological quality) points regarding the selection, comparability and outcomes of study cohorts. Any discrepancies were resolved by reaching a consensus with a third author (H.Y. or N.L.).

Data analyses

We utilized Stata 12.0 software (Stata Corporation, College Station, Texas, USA) and R gui software (version 3.4.4), with the forestplot_v.1.7.2 package for statistical analyses and plotting. The log HRs of irAEs versus non-irAEs and 95% CIs were adopted to aggregate the survival results. If a study reported only HRs and p values, but not 95% CIs, the conversion formula proposed by Altman et al. was utilized to calculate the 95% CIs [39]. If an HR of non-irAEs versus irAEs rather than the opposite comparison was reported, then an HR of irAEs versus non-irAEs was calculated by determining the reciprocal of original HR and corresponding CIs [40]. The χ2 test and I2 statistic were applied to estimate the between-study heterogeneity. Significant heterogeneity was indicated if p < 0.10 for the χ2 test or I2 > 50%, and a random effects model was applied to the pooled analysis [41]. Otherwise, we applied a fixed effects model [42]. For the sensitivity analysis, one study was sequentially omitted to judge the stability of the pooled results. Begg’s test and Egger’s test were utilized to identify publication bias [43, 44]. For both tests, significant publication bias was considered when p < 0.05. Moreover, the “trim and fill” method was adopted to identify and adjust for potential sources of publication bias [45]. This method estimated possibly missing studies and incorporated these hypothetical studies into the original analysis to calculate an adjusted effect. For all analyses, a two-sided p < 0.05 was considered representative of statistical significance.

We pooled the studies for organ-specific irAEs, low-grade irAEs (grades 1–2), and severe-grade irAEs (grade greater than or equal to 3) if at least two studies were identified. We also pooled HRs from all studies to identify the overall effect. For the overall pooled analysis, if a study reported both HRs of all-grade irAEs and grade-specific irAEs, the former was selected; if a study reported both HRs of global irAEs and organ-specific irAEs, the former was selected; and if a study reported HRs of multiple organ-specific irAEs, but not of global irAEs, the analysis with the largest sample size of the irAE cohort was selected.

We performed predefined subgroup analyses to investigate the effects of irAEs on the efficacy of ICIs among different settings and potential sources of heterogeneity. We considered subgroups, including cancer type, class of ICIs, combination therapy, sample size, model, landmark analysis, and approach for data extraction, to the overall cohort. In addition, we performed a subgroup analysis of the class of ICIs in the melanoma cohort. We only analyzed subgroups containing at least two studies.

Results

Literature search results

Our literature search retrieved 2236 studies, from which we collected 78 potentially eligible studies after screening the titles and abstracts. Finally, we selected 30 studies after a review of the full article [4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33]. The reasons for exclusion were as follows: Twenty-five studies did not report data on OS or PFS, 9 did not report data of HRs, 1 was a duplicate publication, 1 used an improper control group, 1 reported non-ICI therapy, 1 was a published conference abstract, and 1 was a case report. The detailed retrieval process is shown in Fig. 1.

Fig. 1
figure 1

Flowchart of study selection process. Abbreviations: OS, overall survival; PFS, progression-free survival; NSCLC, non-small cell lung cancer; RCC, renal cell carcinoma

Full size image

Characteristics of the identified studies

We retrieved information from 4971 individuals in this study. The characteristics of the 30 included studies are described in Table 1 and Additional file 1: Tables S1 and S2. These studies were performed in 10 countries. Sixteen studies analyzed patients with non-small cell lung cancer (NSCLC), 7 analyzed patients with melanoma, 2 analyzed patients with renal cell carcinoma (RCC), and 5 analyzed patients with multiple cancer types. Twenty-six studies adopted anti-PD-1 inhibitors, 3 adopted anti-CTLA-4 inhibitors, and 1 adopted anti-PD-1/PD-L1 inhibitors. The number of patients included in the survival analysis ranged from 18 to 613. Twenty studies reported extractable data on global irAEs, and 16 studies reported organ-specific irAEs. Twenty-six studies reported HRs of OS and 22 studies reported HRs of PFS. Six studies utilized a landmark analysis, whereas 24 studies did not. Seventeen studies adopted a multivariate model to control for confounding factors, and 13 studies adopted a univariate model. Two studies were had a prospective cohort design, and 28 studies employed a retrospective cohort design. All studies enrolled patients with stage III or higher cancer, except two studies that did not report this information. Four studies included on-trial patients, 22 studies included off-trial patients, and 4 studies included both on-trial and off-trial patients. The median irAE onset time ranged from 4.2 to 20 weeks. Twenty-six studies adopted ICIs as monotherapy, and 4 studies adopted ICIs as combination therapy (2 with a peptide vaccine, 1 with radiotherapy, and 1 with vemurafenib). All studies adopted the Common Terminology Criteria for Adverse Events (CTCAE) to grade irAEs, with the exception of 3 studies that did not report this information. The NOS scores allocated for the included studies ranged from 4 to 8 points.

Table 1 Main characteristics of the eligible studies
Full size table

Primary outcome: OS

Twenty-six studies comprising 4186 patients that reported HRs of OS were ultimately included in the pooled analysis. The irAE occurrence was significantly associated with improved OS in patients undergoing ICI therapy (HR, 0.54; 95% CI, 0.45–0.65; p < 0.001) (Figs. 2 and 3). However, significant heterogeneity was detected (I2 = 62.2%, p < 0.001).

Fig. 2
figure 2

Forest plot (random effects model) of the association between immune-related adverse event development and overall survival. The sizes of the squares indicate the weight of the study. Abbreviations: HR, hazard ratio; irAEs, immune-related adverse events; non-irAEs, non-immune-related adverse events. aResults for grade 1–2 immune-related adverse events (irAEs). bResults for grade 3–4 irAEs

Full size image
Fig. 3
figure 3

Meta-analyses of the association between immune-related adverse event development and outcome. Abbreviations: HR, hazard ratio; irAEs, immune-related adverse events; non-irAEs, non-immune-related adverse events. Low grade indicates grades 1–2; severe grade indicates a grade greater than or equal to 3. aThe HR was directly presented without pooling because only one study was available

Full size image

We further separately pooled the HRs of OS according to the different types of irAEs. The occurrences of endocrine, dermatological, and gastrointestinal irAEs were significantly associated with a favorable OS in patients treated with ICIs (endocrine irAEs: HR, 0.52, 95% CI, 0.44–0.62, p < 0.001; dermatological irAEs: HR, 0.45, 95% CI, 0.35–0.59, p < 0.001; gastrointestinal irAEs: HR, 0.68, 95% CI, 0.51–0.89, p = 0.005). Nevertheless, the occurrences of pulmonary and hepatobiliary irAEs were not significantly associated with OS (pulmonary irAEs: HR, 1.22, 95% CI, 0.59–2.52, p = 0.584; hepatobiliary irAEs: HR, 0.98, 95% CI, 0.64–1.52, p = 0.944), with significant heterogeneity observed for pulmonary irAEs (I2 = 70.0%, p < 0.001), but not other irAE types. The occurrence of musculoskeletal irAEs also did not show a significant association with OS (HR, 0.38, 95% CI, 0.02–6.48, p = 0.502), although only one study was included (Fig. 3).

The HRs of OS for patients presenting with low and severe irAE grades were also analyzed. The occurrence of low-grade irAEs was significantly associated with a favorable OS in patients receiving ICIs (HR, 0.57, 95% CI, 0.43–0.75, p < 0.001), whereas the occurrence of severe-grade irAEs did not display a significant association with OS (HR, 0.99, 95% CI, 0.43–2.25, p = 0.976). Significant heterogeneity was observed in severe-grade irAEs (I2 = 83.4%, p < 0.001), but not in low-grade irAEs (Fig. 3).

Predefined subgroup analyses were performed according to a series of study quality characteristics and patient characteristics (Fig. 4). The subgroups stratified by study quality characteristics did not change the results, although subgroups stratified by patient characteristics yielded inconsistent results. For example, patients with cancer who were treated with ICIs as a monotherapy, but not combination therapy, experienced a significant OS benefit when irAEs occurred (monotherapy: HR, 0.53, 95% CI, 0.43–0.65, p < 0.001; combination therapy: HR, 0.62, 95% CI, 0.36–1.05, p = 0.073). In addition, the occurrence of irAEs predicted a favorable OS in patients with cancer receiving PD-1 inhibitors (HR, 0.51, 95% CI, 0.40–0.64, p < 0.001), but not CTLA-4 inhibitors (HR, 0.89, 95% CI, 0.49–1.61, p = 0.706). Additionally, significant predictive effects of irAEs on a favorable OS were observed in all subgroups stratified by cancer types, although in patients with melanoma, the effect displayed borderline to statistical threshold value (NSCLC: HR, 0.50, 95% CI, 0.39–0.63, p < 0.001; melanoma: HR, 0.58, 95% CI, 0.35–0.95, p = 0.032; others: HR, 0.63, 95% CI, 0.48–0.82, p = 0.001). Additional subgroup analyses restricting the melanoma cohort to homogeneous class of ICIs revealed that the prediction was significant for patients with melanoma undergoing treatment with PD-1 inhibitors (HR, 0.35, 95% CI, 0.21–0.61, p < 0.001), but not CTLA-4 inhibitors (HR, 0.89, 95% CI, 0.49–1.61, p = 0.706) (Additional file 1: Figure S1).

Fig. 4
figure 4

Subgroup analyses of the association between immune-related adverse event development and overall survival. Abbreviations: OS, overall survival; HR, hazard ratio; NSCLC, non-small cell lung cancer; ICIs, immune checkpoint inhibitors; anti-PD-1, anti-programmed cell death-1; anti-CTLA-4, anti-cytotoxic T-lymphocyte antigen-4. aThis group included four multiple cancer types and 1 renal cell carcinoma. bThe study reported by Owen et al. was not included in subgroup analysis regarding class of ICIs because it is the only one study investigating anti-PD-1/anti-PD-L1 drug. cYes indicates studies that combined ICIs with other therapy, including peptide vaccine (n = 2), radiotherapy (n = 1) and Vemurafenib (n = 1). dNo indicates studies that adopted ICIs as monotherapy

Full size image

Secondary outcome: PFS

Twenty-two studies comprising 3297 patients that reported HRs of PFS were included. Similar to OS, the occurrence of irAEs were significantly associated with a favorable PFS in patients receiving ICIs (HR, 0.52, 95% CI, 0.44–0.61, p < 0.001), but was accompanied by significant heterogeneity (I2 = 52.5%, p = 0.001) (Fig. 3 and Additional file 1: Figure S2).

In the analysis of different types of irAEs, the occurrence of endocrine and dermatological irAEs was significantly associated with a favorable PFS in patients treated with ICIs (endocrine irAEs: HR, 0.57, 95% CI, 0.48–0.68, p < 0.001; dermatological irAEs: HR, 0.42, 95% CI, 0.34–0.53, p < 0.001). However, gastrointestinal, pulmonary, and hepatobiliary irAEs were not significantly associated with a favorable PFS (gastrointestinal irAEs: HR, 0.79, 95% CI, 0.51–1.24, p = 0.303, pulmonary irAEs: HR, 0.98, 95% CI, 0.57–1.69, p = 0.949; hepatobiliary irAEs: HR, 0.94, 95% CI, 0.65–1.38, p = 0.762) (Fig. 3). Significant heterogeneity was detected in gastrointestinal (I2 = 63.8%, p = 0.040) and pulmonary irAEs (I2 = 58.3%, p = 0.066), but not in the other irAE types.

Regarding the grades of irAEs, the pooled analysis showed that both low-grade irAEs and severe-grade irAEs were significantly associated with a favorable PFS, although the significance of severe-grade irAEs was marginal (low grade: HR, 0.42, 95% CI, 0.31–0.57, p < 0.001; severe grade: HR, 0.80, 95% CI, 0.65–1.00, p = 0.045) (Fig. 3), with no significant heterogeneity observed.

The results of subgroup analyses were similar to OS (Additional file 1: Figure S3). The association of irAE occurrences with a reduced risk of progression in patients with cancer receiving ICIs was significant in each subgroup stratified by study quality characteristics. Nonetheless, the predictive effect of irAEs on a favorable PFS was not consistently significant in subgroups stratified by patient characteristics.

Sensitivity analysis and publication bias

In the sensitivity analysis, the pooled results for OS and PFS both remained significant, regardless of which study was deleted, indicating that the significant association between irAE occurrence and ICI efficacy in patients with cancer was robust (Additional file 1: Figure S4). Regarding the overall analysis, the Begg funnel plot for OS displayed evident asymmetry (p = 0.033), indicating that publication bias should be considered, although Egger’s test showed no evidence of publication bias (p = 0.122) (Additional file 1: Figure S5A). Next, we used the trim and fill method to assess the effect of publication bias on the pooled results. However, no study was trimmed or filled in the output results, leaving the pooled result of OS unchanged, which supported the stability of results (Additional file 1: Figure S5A and Additional file 2). Because publication bias is generally caused by small-sized studies, restricting the pooled analysis to large-sized studies (≥100) might provide clues for the origin of publication bias. Indeed, the pooled HR of OS in the large-sized studies was comparable to the overall effect (0.58 vs. 0.54) (Fig. 4). Notably, neither the Begg funnel plot (p = 0.721) nor Egger’s test (p = 0.872) revealed publication bias for OS in large-sized studies, which further confirmed the stability of the OS results (Additional file 1: Figure S6). Regarding PFS, the Begg funnel plot displayed no obvious asymmetry (p = 0.180), indicating that no evident publication bias was detected, and Egger’s test confirmed this finding (p = 0.134) (Additional file 1: Figure S7).

Discussion

Principal findings and implications

Currently, a decision regarding whether the occurrence of irAEs is associated with ICI therapy remains controversial. To our knowledge, our study represents the largest and most comprehensive analysis of the association between irAEs and ICI efficacy performed to date. The conclusions listed below were drawn based on our results.

  • Generally, patients with cancer who developed irAEs experienced an increased OS and PFS compared with patients who did not develop irAEs.

  • Regarding the irAE types, the survival benefit for patients who developed irAEs was observed in patients presenting endocrinal and dermatological abnormalities, but not in patients presenting a gastrointestinal, pulmonary, hepatobiliary, or musculoskeletal abnormality.

  • The occurrence of low-grade irAEs, but not severe-grade irAEs, was associated with better ICI efficacy in patients with cancer.

  • The occurrence of irAEs was significantly associated with a favorable efficacy of PD-1 inhibitors, but not CTLA-4 inhibitors.

The mechanisms underlying the association between irAEs and survival benefits have not been completely elucidated. Antigen mimicry theory has been one of the most promising hypotheses. Preclinical data identified multiple epitopes that were shared in both melanoma and normal melanocytes [46, 47]. The release of shared antigens by ICI therapy might result in the priming of a secondary immune response to host antigens, which was supported by the finding that T cell clones infiltrating irAE lesions and tumors were significantly overlapped among ICI-treated patients with melanoma and NSCLC [48]. Hence, the development of irAEs indicates a robust immune reaction towards both the tumor and healthy tissue, thereby predicting better treatment responses. Moreover, in addition to the antigen mimicry theory, the dysregulation of humoral immunity has been proposed as a possible explanation for the association. The PD-1 signaling pathway modulates B cell activation in both a T cell-dependent and T cell-independent manner [49, 50]. According to the clinical evidence, thyroid dysfunction during ICI treatment is characterized by the production of anti-thyroid antibodies [12], suggesting that the presence of autoantibodies may account for the irAE-prognosis relationship.

Notably, in addition to overall irAEs, the favorable results remained significant for endocrine irAEs and dermatological irAEs, but not for gastrointestinal irAEs, pulmonary irAEs, hepatobiliary irAEs, and musculoskeletal irAEs. As the incidence of musculoskeletal irAEs is low [51], statistical significance may not have been reached due to the insufficient number of samples. Gastrointestinal irAEs are more frequently observed in response to anti-CTLA-4 treatment [52], and thus, the insignificance of pooled results for PFS might be explained by heterogeneity. However, the variation among other organ-specific irAEs is likely attributable to the clinical importance of different systems. The respiratory and hepatobiliary systems are the most commonly affected organs in patients who experienced fatal irAEs and received anti-PD-1/PD-L1 treatment [53], increasing the risk of mortality for the patient and leading to a poorer outcome due to the side effects of ICIs. Therefore, the proper management of irAEs is very important to maximize the benefits of ICIs.

The prognostic value of irAEs also differed in patients with heterogeneous irAE grades, i.e., the predictive effect of irAEs was significant on low-grade irAEs but not severe-grade irAEs. Severe irAEs are potentially life-threatening and require systemic immunosuppressive treatment, which may counteract the effect of ICIs. Glucocorticoids extensively modify cytokine signaling and inhibit the IL-2 and INF-γ pathways [54,55,56], which are reactivated to create the inflammatory tumor microenvironment during ICI therapy. Therefore, exposure to large amounts of immunosuppressive reagents during high-grade irAEs would be expected to alter the antitumor effect.

Regarding the subgroup analyses, the distinct outcomes observed for the anti-PD-1 and anti-CTLA-4 subgroups indicated a possibly different mechanism of irAEs, as CTLA-4 blockade activates T cells at an earlier stage of their development and might thus directly disrupt central tolerance without affecting the tumor immune response. Meanwhile, irAEs induced by PD-1 inhibitors predict a better clinical response by patients with cancer, but the association between irAEs and survival in patients undergoing anti-CTLA-4 therapy remains controversial [8, 29, 57,58,59,60], demanding larger size of studies in the future. The ability of irAEs to predict a favorable OS and PFS was consistently significant in patients with NSCLC and other cancers (including RCC and multiple cancer types), but not in patients with melanoma. However, we prefer to attribute this inconsistency in patients with melanoma to the heterogeneity caused by the large proportion of studies investigating CTLA-4 inhibitors (OS: 3 in 7; PFS: 1 in 3), as the additional subgroup analysis revealed that restricting the melanoma cohort to treatment with PD-1 inhibitors yielded significant association between irAE development and a favorable OS.

Strengths and comparison with other studies

A systematic review performed by Ouwerkerk et al. summarized studies investigating the association between irAEs and ICI efficacy in patients with melanoma [36]. However, the report by Ouwerkerk et al. did not pool the results through a meta-analysis and thus did not provide exact statistical information about the critical question of whether the occurrence of irAEs was associated with ICI efficacy. Additionally, the research scope of their study was restricted to patients with melanoma. In the present systematic review and meta-analysis, we performed a comprehensive pan-cancer meta-analysis. Therefore, an accurate magnitude of the predictive effect of irAEs on ICI efficacy was obtained. Additionally, we separately pooled the predictive effects of different irAE types and irAE grades to investigate their specific roles in homogeneous settings.

The relevance of our findings is strengthened by their consistency across all analyzed subsets stratified by the study quality characteristics, except for data extraction. Nevertheless, some of the included studies utilized a univariate model or were small in size, and a landmark analysis was not performed in every study we selected. However, as described above, the subgroup HR value remained significant, regardless of the adjustment for the model, sample size, or landmark analysis, indicating that the biases derived from these low-quality studies are unlikely to change our results.

Limitations

Several limitations of our study should be noted. First, the Begg funnel plot and Begg’s test identified evident publication bias in the pooled results for OS, indicating that the results of the pooled analysis of OS might be exaggerated. According to the exclusion criteria, we excluded several major studies from the current meta-analysis because they reported only survival curves but not HR values. Two studies presented no significant difference in survival outcome based on irAEs [34, 35], but one study reported a significant difference in survival according to irAEs with landmark analysis [61]. However, Egger’s test and the trim and fill method detected no evidence of publication bias. Compared with the overall analysis of OS, the pooled analysis of OS in large-sized studies was comparable and showed no publication bias, indicating that the bias attributed to small-sized studies was moderate. In addition, the PFS analysis showed a similar significant overall effect to the OS analysis and exhibited no publication bias. Taken together, we believe that our study provides meaningful evidence specifying the association of irAE development with survival benefits in patients with cancer who were treated with ICIs. Second, significant heterogeneity was observed in the OS analysis, which might be attributed to variations in irAE types, irAE grade, class of ICIs, etc. In an attempt to reduce the impact of heterogeneity, we performed specific analyses of each type and grade of irAEs. We also conducted subgroup analyses of patient characteristics and study quality characteristics. Third, our study included limited types of malignancy that were mostly weighted towards NSCLC, melanoma, and RCC, restricting the broad application of our findings. Additional analyses of broader types of cancer are necessary to confirm our conclusions. Fourth, only two publications included in our study employed a prospective design, raising the concerns regarding the quality of evidence analyzed in our study. Hence, further large-scale prospective cohort studies are warranted.

Conclusions

In this systematic review and meta-analysis, the occurrence of irAEs was associated with better ICI efficacy in patients with cancer, particularly endocrine, dermatological, and low-grade irAEs. Further large-scale prospective studies are warranted to confirm our discoveries.

Abbreviations

CIs:

Confidence intervals

CTCAE:

Common Terminology Criteria for Adverse Events

CTLA-4:

Cytotoxic T-lymphocyte antigen-4

HRs:

Hazard ratios

ICIs:

Immune checkpoint inhibitors

irAEs:

Immune-related adverse events

NOS:

Newcastle-Ottawa scale

NSCLC:

Non-small cell lung cancer

OS:

Overall survival

PD-1:

Programmed cell death-1

PD-L1:

Programmed cell death ligand 1

PFS:

Progression-free survival

RCC:

Renal cell carcinoma

References

  1. Homet Moreno B, Ribas A. Anti-programmed cell death protein-1/ligand-1 therapy in different cancers. Br J Cancer. 2015;112(9):1421–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  2. Sanmamed MF, Chen L. A paradigm shift in cancer immunotherapy: from enhancement to normalization. Cell. 2018;175(2):313–26.

    CAS  PubMed  PubMed Central  Google Scholar 

  3. Brahmer JR, Lacchetti C, Schneider BJ, Atkins MB, Brassil KJ, Caterino JM, Chau I, Ernstoff MS, Gardner JM, Ginex P, et al. Management of immune-related adverse events in patients treated with immune checkpoint inhibitor therapy: American Society of Clinical Oncology clinical practice guideline. J Clin Oncol. 2018;36(17):1714–68.

    CAS  PubMed  Google Scholar 

  4. Indini A, Di Guardo L, Cimminiello C, Prisciandaro M, Randon G, De Braud F, Del Vecchio M. Immune-related adverse events correlate with improved survival in patients undergoing anti-PD1 immunotherapy for metastatic melanoma. J Cancer Res Clin Oncol. 2019;145(2):511–21.

    CAS  PubMed  Google Scholar 

  5. Owen DH, Wei L, Bertino EM, Edd T, Villalona-Calero MA, He K, Shields PG, Carbone DP, Otterson GA. Incidence, risk factors, and effect on survival of immune-related adverse events in patients with non–small-cell lung cancer. Clin Lung Cancer. 2018;19(6):e893–900.

    PubMed  PubMed Central  Google Scholar 

  6. Okada N, Kawazoe H, Takechi K, Matsudate Y, Utsunomiya R, Zamami Y, Goda M, Imanishi M, Chuma M, Hidaka N, et al. Association between immune-related adverse events and clinical efficacy in patients with melanoma treated with nivolumab: a multicenter retrospective study. Clin Ther. 2019;41(1):59–67.

    CAS  PubMed  Google Scholar 

  7. Verzoni E, Carteni G, Cortesi E, Giannarelli D, De Giglio A, Sabbatini R, Buti S, Rossetti S, Cognetti F, Rastelli F, et al. Real-world efficacy and safety of nivolumab in previously-treated metastatic renal cell carcinoma, and association between immune-related adverse events and survival: the Italian expanded access program. Cancer Sci. 2019;7(1):99.

    Google Scholar 

  8. Faje AT, Lawrence D, Flaherty K, Freedman C, Fadden R, Rubin K, Cohen J, Sullivan RJ. High-dose glucocorticoids for the treatment of ipilimumab-induced hypophysitis is associated with reduced survival in patients with melanoma. Cancer. 2018;124(18):3706–14.

    CAS  PubMed  Google Scholar 

  9. Freeman-Keller M, Kim Y, Cronin H, Richards A, Gibney G, Weber JS. Nivolumab in resected and unresectable metastatic melanoma: characteristics of immune-related adverse events and association with outcomes. Clin Cancer Res. 2016;22(4):886–94.

    CAS  PubMed  Google Scholar 

  10. Haratani K, Hayashi H, Chiba Y, Kudo K, Yonesaka K, Kato R, Kaneda H, Hasegawa Y, Tanaka K, Takeda M, et al. Association of immune-related adverse events with nivolumab efficacy in non-small cell lung cancer. JAMA Oncol. 2018;4(3):374–8.

    PubMed  Google Scholar 

  11. Kim HI, Kim M, Lee SH, Park SY, Kim YN, Kim H, Jeon MJ, Kim TY, Kim SW, Kim WB, et al. Development of thyroid dysfunction is associated with clinical response to PD-1 blockade treatment in patients with advanced non-small cell lung cancer. Oncoimmunology. 2017;7(1):e1375642.

    PubMed  PubMed Central  Google Scholar 

  12. Osorio JC, Ni A, Chaft JE, Pollina R, Kasler MK, Stephens D, Rodriguez C, Cambridge L, Rizvi H, Wolchok JD, et al. Antibody-mediated thyroid dysfunction during T-cell checkpoint blockade in patients with non-small-cell lung cancer. Ann Oncol. 2017;28(3):583–9.

    CAS  PubMed  Google Scholar 

  13. Yamauchi I. Incidence, features, and prognosis of immune-related adverse events involving the thyroid gland induced by nivolumab. Immunotherapy. 2019;14(5):e0216954.

    CAS  Google Scholar 

  14. Grangeon M, Tomasini P, Chaleat S, Jeanson A, Souquet-Bressand M, Khobta N, Bermudez J, Trigui Y, Greillier L, Blanchon M, et al. Association between immune-related adverse events and efficacy of immune checkpoint inhibitors in non-small-cell lung cancer. Clin Lung Cancer. 2018;20(3):201–7.

  15. Ricciuti B, Genova C, De Giglio A, Bassanelli M, Dal Bello MG, Metro G, Brambilla M, Baglivo S, Grossi F, Chiari R. Impact of immune-related adverse events on survival in patients with advanced non-small cell lung cancer treated with nivolumab: long-term outcomes from a multi-institutional analysis. J Cancer Res Clin Oncol. 2019;145(2):479–85.

    CAS  PubMed  Google Scholar 

  16. Lei M, Michael A, Patel S, Wang D. Evaluation of the impact of thyroiditis development in patients receiving immunotherapy with programmed cell death-1 inhibitors. J Oncol Pharm Pract. 2019;25(6):1402–11.

  17. Ishihara H, Takagi T, Kondo T, Homma C, Tachibana H, Fukuda H, Yoshida K, Iizuka J, Kobayashi H, Okumi M, et al. Association between immune-related adverse events and prognosis in patients with metastatic renal cell carcinoma treated with nivolumab. Urol Oncol. 2019;37(6):355.e21–.e29.

  18. Toi Y, Sugawara S, Sugisaka J, Ono H, Kawashima Y, Aiba T, Kawana S, Saito R, Aso M, Tsurumi K, et al. Profiling preexisting antibodies in patients treated with anti-PD-1 therapy for advanced non-small cell lung cancer. JAMA Oncol. 2018;5(3):376–83.

  19. Cortellini A, Chiari R, Ricciuti B, Metro G, Perrone F, Tiseo M, Bersanelli M, Bordi P, Santini D, Giusti R, et al. Correlations between the immune-related adverse events spectrum and efficacy of anti-PD1 immunotherapy in NSCLC patients. Eurasian J Medicine. 2019;20(4):237–47.

  20. Berner F, Bomze D, Diem S, Ali OH, Fassler M, Ring S, Niederer R, Ackermann CJ, Baumgaertner P, Pikor N, et al. Association of checkpoint inhibitor-induced toxic effects with shared cancer and tissue antigens in non-small cell lung cancer. JAMA Oncol. 2019;5(7):1043–47.

  21. Ahn BC, Pyo KH, Xin CF, Jung D, Shim HS, Lee CY, Park SY, Yoon HI, Hong MH, Cho BC, et al. Comprehensive analysis of the characteristics and treatment outcomes of patients with non-small cell lung cancer treated with anti-PD-1 therapy in real-world practice. J Cancer Res Clin Oncol. 2019;145(6):1613–23.

  22. Nakamura Y, Tanaka R, Asami Y, Teramoto Y, Imamura T, Sato S, Maruyama H, Fujisawa Y, Matsuya T, Fujimoto M, et al. Correlation between vitiligo occurrence and clinical benefit in advanced melanoma patients treated with nivolumab: a multi-institutional retrospective study. J Dermatol. 2017;44(2):117–22.

    CAS  PubMed  Google Scholar 

  23. Judd J, Zibelman M, Handorf E, O'Neill J, Ramamurthy C, Bentota S, Doyle J, Uzzo RG, Bauman J, Borghaei H, et al. Immune-related adverse events as a biomarker in non-melanoma patients treated with programmed cell death 1 inhibitors. Oncologist. 2017;22(10):1232–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  24. Ksienski D, Wai ES, Croteau N, Fiorino L, Brooks E, Poonja Z, Fenton D, Geller G, Glick D, Lesperance M. Efficacy of nivolumab and pembrolizumab in patients with advanced non–small-cell lung cancer needing treatment interruption because of adverse events: a retrospective multicenter analysis. Clin Lung Cancer. 2019;20(1):e97–e106.

    CAS  PubMed  Google Scholar 

  25. Rogado J, Sánchez-Torres JM, Romero-Laorden N, Ballesteros AI, Pacheco-Barcia V, Ramos-Leví A, Arranz R, Lorenzo A, Gullón P, Donnay O, et al. Immune-related adverse events predict the therapeutic efficacy of anti–PD-1 antibodies in cancer patients. Eur J Cancer. 2019;109:21–7.

    CAS  PubMed  Google Scholar 

  26. Lesueur P, Escande A, Thariat J, Vauleon E, Monnet I, Cortot A, Lerouge D, Danhier S, Do P, Dubos-Arvis C, et al. Safety of combined PD-1 pathway inhibition and radiation therapy for non-small-cell lung cancer: a multicentric retrospective study from the GFPC. Cancer Med. 2018;7(11):5505–13.

    CAS  PubMed  PubMed Central  Google Scholar 

  27. Lisberg A, Tucker DA, Goldman JW, Wolf B, Carroll J, Hardy A, Morris K, Linares P, Adame C, Spiegel ML, et al. Treatment-related adverse events predict improved clinical outcome in NSCLC patients on KEYNOTE-001 at a single center. Cancer Immunol Res. 2018;6(3):288–94.

    PubMed  PubMed Central  Google Scholar 

  28. Bjørnhart B, Hansen KH, Jørgensen TL, Herrstedt J, Schytte T. Efficacy and safety of immune checkpoint inhibitors in a Danish real life non-small cell lung cancer population: a retrospective cohort study. Acta Oncol. 2019;58(7):953–61.

  29. Lang N, Dick J, Slynko A, Schulz C, Dimitrakopoulou-Strauss A, Sachpekidis C, Enk AH, Hassel JC. Clinical significance of signs of autoimmune colitis in (18)F-fluorodeoxyglucose positron emission tomography-computed tomography of 100 stage-IV melanoma patients. Immunotherapy. 2019;11(8):667–76.

    CAS  PubMed  Google Scholar 

  30. Fujimoto D, Yoshioka H, Kataoka Y, Morimoto T, Kim YH, Tomii K, Ishida T, Hirabayashi M, Hara S, Ishitoko M, et al. Efficacy and safety of nivolumab in previously treated patients with non-small cell lung cancer: a multicenter retrospective cohort study. Lung Cancer. 2018;119:14–20.

    PubMed  Google Scholar 

  31. Sato K, Akamatsu H, Murakami E, Sasaki S, Kanai K, Hayata A, Tokudome N, Akamatsu K, Koh Y, Ueda H, et al. Correlation between immune-related adverse events and efficacy in non-small cell lung cancer treated with nivolumab. Lung Cancer. 2018;115:71–4.

    PubMed  Google Scholar 

  32. Sanlorenzo M, Vujic I, Daud A, Algazi A, Gubens M, Luna SA, Lin K, Quaglino P, Rappersberger K, Ortiz-Urda S. Pembrolizumab cutaneous adverse events and their association with disease progression. JAMA Dermatol. 2015;151(11):1206–12.

    PubMed  PubMed Central  Google Scholar 

  33. de Moel EC, Rozeman EA, Kapiteijn EH, Verdegaal EME, Grummels A, Bakker JA. Autoantibody development under treatment with immune-checkpoint inhibitors. Cancer Immunol Res. 2019;7(1):6–11.

    PubMed  Google Scholar 

  34. Weber JS, Hodi FS, Wolchok JD, Topalian SL, Schadendorf D, Larkin J, Sznol M, Long GV, Li H, Waxman IM, et al. Safety profile of nivolumab monotherapy: a pooled analysis of patients with advanced melanoma. J Clin Oncol. 2017;35(7):785–92.

    CAS  PubMed  Google Scholar 

  35. Horvat TZ, Adel NG, Dang TO, Momtaz P, Postow MA, Callahan MK, Carvajal RD, Dickson MA, D'Angelo SP, Woo KM, et al. Immune-related adverse events, need for systemic immunosuppression, and effects on survival and time to treatment failure in patients with melanoma treated with ipilimumab at memorial Sloan Kettering cancer center. J Clin Oncol. 2015;33(28):3193–8.

    CAS  PubMed  PubMed Central  Google Scholar 

  36. Ouwerkerk W, van den Berg M, van der Niet S, Limpens J, Luiten RM. Biomarkers, measured during therapy, for response of melanoma patients to immune checkpoint inhibitors: a systematic review. Melanoma Res. 2019;29(5):453–64.

  37. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.

    PubMed  PubMed Central  Google Scholar 

  38. The Newcastle-Ottawa Scale (NOS) for assessing the quality if nonrandomized studies in meta-analyses. http://www.ohri.ca/programs/clinical_epidemiology/oxford.htm.

  39. Altman DG, Bland JM. How to obtain the confidence interval from a P value. BMJ (Clinical research ed). 2011;343:d2090.

    Google Scholar 

  40. Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16.

    PubMed  PubMed Central  Google Scholar 

  41. DerSimonian R, Kacker R. Random-effects model for meta-analysis of clinical trials: an update. Contemp Clin Trials. 2007;28(2):105–14.

    PubMed  Google Scholar 

  42. Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22(4):719–48.

    CAS  PubMed  Google Scholar 

  43. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088–101.

    CAS  PubMed  Google Scholar 

  44. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34.

    CAS  PubMed  PubMed Central  Google Scholar 

  45. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.

    CAS  PubMed  Google Scholar 

  46. Houghton AN, Eisinger M, Albino AP, Cairncross JG, Old LJ. Surface antigens of melanocytes and melanomas. Markers of melanocyte differentiation and melanoma subsets. J Exp Med. 1982;156(6):1755–66.

    CAS  PubMed  Google Scholar 

  47. Cui J, Bystryn JC. Melanoma and vitiligo are associated with antibody responses to similar antigens on pigment cells. Arch Dermatol. 1995;131(3):314–8.

    CAS  PubMed  Google Scholar 

  48. Laubli H, Koelzer VH, Matter MS, Herzig P, Dolder Schlienger B, Wiese MN, Lardinois D, Mertz KD, Zippelius A. The T cell repertoire in tumors overlaps with pulmonary inflammatory lesions in patients treated with checkpoint inhibitors. Oncoimmunology. 2018;7(2):e1386362.

    PubMed  Google Scholar 

  49. Velu V, Titanji K, Zhu B, Husain S, Pladevega A, Lai L, Vanderford TH, Chennareddi L, Silvestri G, Freeman GJ, et al. Enhancing SIV-specific immunity in vivo by PD-1 blockade. Nature. 2009;458(7235):206–10.

    CAS  PubMed  Google Scholar 

  50. Thibult ML, Mamessier E, Gertner-Dardenne J, Pastor S, Just-Landi S, Xerri L, Chetaille B, Olive D. PD-1 is a novel regulator of human B-cell activation. Int Immunol. 2013;25(2):129–37.

    CAS  PubMed  Google Scholar 

  51. Le Burel S, Champiat S, Mateus C, Marabelle A, Michot JM, Robert C, Belkhir R, Soria JC, Laghouati S, Voisin AL, et al. Prevalence of immune-related systemic adverse events in patients treated with anti-Programmed cell Death 1/anti-Programmed cell Death-Ligand 1 agents: a single-centre pharmacovigilance database analysis. Eur J Cancer (Oxford, England : 1990). 2017;82:34–44.

    CAS  Google Scholar 

  52. Xu C, Chen YP, Du XJ, Liu JQ, Huang CL, Chen L, Zhou GQ, Li WF, Mao YP, Hsu C, et al. Comparative safety of immune checkpoint inhibitors in cancer: systematic review and network meta-analysis. BMJ. 2018;363:k4226.

    PubMed  PubMed Central  Google Scholar 

  53. Wang DY, Salem JE, Cohen JV, Chandra S, Menzer C, Ye F, Zhao S, Das S, Beckermann KE, Ha L, et al. Fatal toxic effects associated with immune checkpoint inhibitors: a systematic review and meta-analysis. JAMA Oncol. 2018;4(12):1721–8.

    PubMed  PubMed Central  Google Scholar 

  54. Bianchi M, Meng C, Ivashkiv LB. Inhibition of IL-2-induced Jak-STAT signaling by glucocorticoids. Proc Natl Acad Sci U S A. 2000;97(17):9573–8.

    CAS  PubMed  PubMed Central  Google Scholar 

  55. Rogatsky I, Ivashkiv LB. Glucocorticoid modulation of cytokine signaling. Tissue Antigens. 2006;68(1):1–12.

    CAS  PubMed  Google Scholar 

  56. Hu X, Li WP, Meng C, Ivashkiv LB: Inhibition of IFN-gamma signaling by glucocorticoids. (0022–1767).

  57. Sachpekidis C, Larribere L, Kopp-Schneider A, Hassel JC, Dimitrakopoulou-Strauss A. Can benign lymphoid tissue changes in (18)F-FDG PET/CT predict response to immunotherapy in metastatic melanoma? Cancer Immunol Immunother. 2019;68(2):297–303.

    CAS  PubMed  Google Scholar 

  58. Di Giacomo AM, Calabro L, Danielli R, Fonsatti E, Bertocci E, Pesce I, Fazio C, Cutaia O, Giannarelli D, Miracco C, et al. Long-term survival and immunological parameters in metastatic melanoma patients who responded to ipilimumab 10 mg/kg within an expanded access programme. Cancer Immunol Immunother. 2013;62(6):1021–8.

    CAS  PubMed  Google Scholar 

  59. Teulings HE, Limpens J, Jansen SN, Zwinderman AH, Reitsma JB, Spuls PI, Luiten RM. Vitiligo-like depigmentation in patients with stage III-IV melanoma receiving immunotherapy and its association with survival: a systematic review and meta-analysis. J Clin Oncol. 2015;33(7):773–81.

    CAS  PubMed  Google Scholar 

  60. Wong ANM, McArthur GA, Hofman MS, Hicks RJ. The advantages and challenges of using FDG PET/CT for response assessment in melanoma in the era of targeted agents and immunotherapy. Eur J Nucl Med Mol Imaging. 2017;44(Suppl 1):67–77.

    PubMed  Google Scholar 

  61. Sznol M, Ferrucci PF, Hogg D, Atkins MB, Wolter P, Guidoboni M, Lebbé C, Kirkwood JM, Schachter J, Daniels GA, et al. Pooled analysis safety profile of nivolumab and ipilimumab combination therapy in patients with advanced melanoma. J Clin Oncol. 2017;35(34):3815–22.

    CAS  PubMed  Google Scholar 

Download references

Acknowledgments

We want to thank Xia Wan from the Peking Union Medical College in Beijing, China, for providing guidance on statistical analysis.

Funding

This study was supported by grants from the National Natural Science Fund (No. 81801633), Chinese Academy of Medical Sciences Young Medical Talent Award Fund (No. 2018RC320005), Beijing Natural Science Foundation (No. 7182132), Major Projects of the Beijing Municipal Science and Technology Commission (No. Z171100002017013), and Capital Special Project for Featured Clinical Application (No. Z151100004015157). We declare no conflicts of interest.

Availability of data and materials

All data generated or analyzed during this study are included in this published article and its supplementary information files.

Author information

Author notes

  1. Xiaoxiang Zhou and Zhuoran Yao contributed equally to this work.

Authors and Affiliations

  1. Department of Rheumatology and Clinical Immunology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, The Ministry of Education Key Laboratory, Beijing, 100730, China

    Xiaoxiang Zhou, Zhuoran Yao, Huaxia Yang, Xuan Zhang & Fengchun Zhang

  2. Department of Thoracic Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Science & Peking Union Medical College, Beijing, 100730, China

    Naixin Liang

Authors
  1. Xiaoxiang Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhuoran Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Huaxia Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Naixin Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xuan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Fengchun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

X.Zhou, Z.Y., X.Zhang, and FZ designed the study protocol, retrieved and selected the articles, analyzed and interpreted the data, and wrote the manuscript. H.Y. and N.L. designed the study protocol, solved all disagreements, and supervised the study. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Huaxia Yang or Naixin Liang.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Contains additional information about the methods, literature search and data analyses. Table S1. Additional characteristics of the eligible studies. Table S2. The Newcastle-Ottawa Scale (NOS) quality assessment of the enrolled studies. Figure S1. Subgroup analysis stratified by class of immune checkpoint inhibitors in the melanoma cohort. Figure S2. Forest plot (fixed effects model) of the association between immune-related adverse event development and progression-free survival. Figure S3. Subgroup analyses of the association between immune-related adverse event development and progression-free survival. Figure S4. Sensitivity analysis of the impact of each individual study on the pooled effect. A) Overall survival; B) Progression-free survival. Figure S5. Funnel plots of the overall survival results. (A) Without trim and fill; (B) With trim and fill. Figure S6. Funnel plots of the overall survival results in large sample size studies. Figure S7. Funnel plots of the progression-free survival results.

Additional file 2.

Log file of trim and fill method in Figure S5.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhou, X., Yao, Z., Yang, H. et al. Are immune-related adverse events associated with the efficacy of immune checkpoint inhibitors in patients with cancer? A systematic review and meta-analysis. BMC Med 18, 87 (2020). https://doi.org/10.1186/s12916-020-01549-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-020-01549-2

Keywords

BMC Medicine

ISSN: 1741-7015

Contact us