- Research article
- Open Access
- Open Peer Review
Influenza vaccination in patients with end-stage renal disease: systematic review and assessment of quality of evidence related to vaccine efficacy, effectiveness, and safety
BMC Medicine volume 12, Article number: 244 (2014)
Vaccination against influenza is recommended in patients with end-stage renal disease (ESRD). However, so far, no systematic review has summarized the available evidence on the effectiveness and safety of influenza vaccination in this patient group.
We conducted a systematic review and meta-analysis and assessed the quality of evidence using the GRADE methodology. We searched MEDLINE, EMBASE, Cochrane Library databases, ClinicalTrials.gov, and reference lists for studies on efficacy, effectiveness, and/or safety of seasonal influenza vaccination in patients with ESRD receiving dialysis. All reported clinical outcomes were considered, including all-cause mortality, cardiac death, infectious death, all-cause hospitalization, hospitalization due to influenza or pneumonia, hospitalization due to bacteremia, viremia, or septicemia, hospitalization due to respiratory infection, ICU admission, and influenza-like illness.
Five observational studies and no randomized-controlled trial were identified. In four studies, risk of bias was high regarding all reported outcomes. Strong residual confounding was likely to be present in one study reporting on three outcomes, as indicated by significant protective effects of vaccination outside influenza seasons. Therefore, the statistically significant protective effects on all-cause mortality (vaccine effectiveness (VE), 32%; 95% CI, 24–39%), cardiac death (VE, 16%; 95% CI, 1–29%), hospitalization due to influenza or pneumonia (VE, 14%; 95% CI, 7–20%), ICU admission (VE, 81%; 95% CI, 63–86%), and influenza-like illness (VE, 12%; 95% CI, 10–14%) have to be taken with caution. According to GRADE, the quality of the body of evidence was considered very low for all outcomes. No study reported on laboratory-confirmed influenza virus infections or on safety endpoints.
Evidence on the protective effects of influenza vaccination in patients with ESRD is limited and of very low quality. Since VE estimates in the available literature are prone to unmeasured confounding, studies using randomization or quasi-experimental designs are needed to determine the extent by which vaccination prevents influenza and related clinical outcomes in this at-risk population. However, given the high rates of health-endangering events in these patients, even a low VE can be considered as sufficient to recommend annual influenza vaccination.
Worldwide, about 1.9 million patients undergo renal replacement therapy (hemodialysis, peritoneal dialysis, kidney transplantation) due to end-stage renal disease (ESRD) . Although rates of incident ESRD have decreased in some countries, the burden of ESRD is increasing globally , mainly driven by an increase in the prevalence of major risk factors such as diabetes and hypertension . Due to multifactorial causes, patients with ESRD have an impaired innate and adaptive immune system, including defects in complement activation and B- and T-cell function -. This functional abnormality contributes to higher incidences and severe courses of infectious diseases ,. For example, pulmonary infection-related mortality is up to 10-fold higher in ESRD patients compared with the general population . To reduce influenza disease burden among these patients, the World Health Organization and many national immunization technical advisory groups recommend annual vaccination against seasonal influenza -.
Although studies suggest that immunogenicity might be reduced among ESRD patients , antibody levels regarded as protective have been found in 53 to 90% of dialysis patients ,. However, it is unclear to which degree these antibody levels finally translate into the prevention of clinical outcomes. A recent methodological study indicated that no systematic review has been published thus far on the efficacy, effectiveness, and safety of seasonal influenza vaccination in patients with ESRD receiving dialysis . We therefore performed a respective systematic review and meta-analysis and used the methodology suggested by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) working group to rate the quality of the body of evidence for each outcome.
Search strategy and selection criteria
This systematic review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) statement . The literature search was performed irrespective of study design (experimental and observational) and publication language. The electronic databases searched were MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, Cochrane Database of Systematic Reviews, and Database of Abstracts of Reviews of Effects (date of last search: 07 May 2014). The complete search strategy is shown in Additional file 1. In addition, we searched for unpublished or ongoing studies in ClinicalTrials.gov. Electronic searches were complemented by manually searching all reference lists of identified studies and reviews for additional studies.
Studies had to meet the following a priori defined inclusion criteria: i) original report on efficacy, effectiveness, and/or safety of vaccines against seasonal influenza in patients with ESRD receiving either hemodialysis or peritoneal dialysis, and ii) control participants had to be either unvaccinated or must have received placebo. We excluded studies in which participants in the intervention arm had received more than one influenza dose in a given season.
Data extraction and risk of bias assessment
Two reviewers (CR and TH) independently screened titles and abstracts to identify potentially eligible studies which were then reviewed as full text. Disagreements were resolved by discussions until consensus was achieved. From eligible studies, two independent investigators (CR and TH) extracted study characteristics and assessed risk of bias, using standardized forms. Disagreements between extractors were resolved by discussion. From each study, the following information was extracted: study design, country, study period, data source(s), population size, inclusion and exclusion criteria for participants, age at vaccination, sex, mean duration on dialysis, ethnicity, duration of follow-up, reported comorbidities, source of information on vaccination, vaccine used, circulating influenza strains, match/mismatch between vaccine and circulating strain, relative risk (RR), odds ratio (OR) or hazard ratio (HR) for defined outcomes, risk difference (RD), confounder-adjusted estimates, confounders considered, and control period (off-season) estimates. We used the tool developed by the Critical Appraisal Skills Programme  to assess risk of bias in the included studies. According to the suggestions by the Cochrane Collaboration , we made this assessment separately for each outcome and expressed the result as a considered judgment, using the categories “high risk of bias”, “low risk of bias”, and “unclear risk of bias”.
Assessment of the quality of a body of evidence
For each outcome, the quality of the respective body of evidence (i.e., across all included studies) was assessed using the GRADE methodology ,. According to GRADE, evidence on the effects of an intervention is categorized into four levels of quality: very low, low, moderate, and high. Bodies of evidence from randomized controlled trials (RCTs) start as high quality evidence, whereas those from studies with other designs (observational studies) start as low quality evidence. According to a set of predefined criteria, evidence quality can be increased or decreased. Further details on GRADE can be found elsewhere ,. In order to assess the best available evidence, we used the results of the confounder-adjusted analyses to determine GRADE evidence quality.
Data synthesis and statistical analysis
RRs, ORs, HRs, and RDs and corresponding 95% confidence intervals (95% CIs) were either calculated or extracted directly from the publications. Vaccine effectiveness (VE) was calculated as 1 – RR × 100. To express the number of individuals needed to be vaccinated to prevent one case of a particular outcome, we calculated the number needed to vaccinate (NNV) as 1/RD.
Where data from more than one study for a given outcome were available, we performed a meta-analysis, using a random-effects model to account for heterogeneity. If a single study reported data from more than one season, these point estimates were pooled prior to meta-analysis. I2 was used to quantify the extent of heterogeneity. Confounder-adjusted in-season estimates were pooled if they were adjusted at least for age, sex, and comorbidities. Since two studies covered patients that might be different compared to the patients on continuous hemodialysis included in the remaining studies, namely patients with newly diagnosed ESRD  or patients on peritoneal dialysis , we conducted a sensitivity analysis by stepwise excluding data from i) patients on peritoneal dialysis and ii) with newly diagnosed ESRD from the meta-analysis on all-cause mortality and hospitalization due to influenza or pneumonia.
We evaluated the presence of residual confounding by contrasting estimates of VE measured during the influenza season to VE estimates measured during “control periods” outside the influenza season in the same studies (so-called “pseudo-effectiveness”). This approach makes the assumption that vaccination is effective against influenza-related outcomes only during the influenza season when influenza virus is circulating. Consequently, all differences in outcomes between vaccinated and non-vaccinated participants measured outside the influenza season cannot be attributed to vaccination, but must be due to other factors which differ between groups. The aim of adjustment for confounders in statistical analyses is to eliminate the influence of such factors. Residual confounding was therefore defined as present if the confounder-adjusted estimate showed a statistically significant effect of vaccination on a given outcome in the absence of virus circulation, i.e., during a control period.
Formal testing for publication bias was not performed because of the small number of identified studies. Calculations were done using STATA 12 (StataCorp, College Station, TX, USA) and RevMan 5.2 (Cochrane Collaboration). GRADE evidence profiles were created using the GRADEpro software (GRADE working group).
Selection of studies and study characteristics
We identified, in the initial search, 1,541 records in electronic databases (Figure 1) and finally included a total of five studies in this review after applying the inclusion and exclusion criteria. Details on the excluded studies are reported in Additional file 2.
All included studies were retrospective cohort studies -. No RCTs, experimental, or quasi-experimental studies were identified. Four studies were conducted in the US and one in Taiwan; Table 1 presents the baseline characteristics of the studies. All four studies from the US identified patients with ESRD through dialysis facility networks (US Renal Data System, USRDS) during different influenza seasons -. The study from Taiwan used data from a National Health Insurance program. Three studies included patients on hemodialysis only ,,, and the other two studies , comprised patients on hemodialysis and patients on peritoneal dialysis. In all studies, the main cause of ESRD was underlying diabetes mellitus. Two studies provided data on the proportion of patients with previous kidney transplantation , and one study censored patients at the time of transplantation .
Two US studies reported data of the same influenza season ,. To avoid analyzing data from overlapping populations, we decided to analyze data from hemodialysis patients from the more recent publication  and those from patients on peritoneal dialysis from the older publication .
Overall, nine different clinical outcomes were reported (Table 2). All-cause mortality, all-cause hospitalization, and hospitalization due to influenza or pneumonia were addressed by at least two studies, whereas the remaining outcomes were reported by one study each.
For the assessment of risk of bias, two studies measured “pseudo-effectiveness” of influenza-related outcomes outside influenza seasons ,. From the article of Bond et al.  we extracted off-season estimates calculated for the months June to August; from the article McGrath et al.  we used off-season estimates that were calculated for the pre-influenza period, when, according to the national influenza surveillance data, less than 10% of isolates were positive for influenza. In addition, one study compared vaccinated patients in vaccine-well-matched years with those in mismatched years . The latter study exploits the year-to-year variation of match of the vaccine virus to the circulating wild virus strain and assumes that vaccination was effective only during seasons with a good match, whereas it had only minimal effect during mismatched seasons. In season 1997/1998, which was covered by this study, circulating A(H3N2) influenza strains did not match the vaccine strain ,.
Risk of bias assessment in individual studies
Risk of bias assessment of the included studies is shown in Table 3. In four studies, risk of bias was high regarding all reported outcomes ,,,, and was mainly influenced by missing baseline data of the vaccinated vs. unvaccinated cohort , and insufficient controlling for confounders, as, for example, indicated by significant VE estimates during “control periods” or during “mismatched” seasons (see above) . In one study, risk of bias was unclear  owing to self-reported vaccination status.
Vaccine effectiveness and vaccine safety
Crude and adjusted ORs for all reported outcomes are shown in Table 3. Forest plots are shown in Figure 2 and variables that were used in the final multivariate model are reported in Additional file 3. Regarding mortality, statistically significant estimates indicating a protective effect of vaccination were found for all-cause mortality (pooled confounder-adjusted VE, 32%; 95% CI, 24–39%; I2 = 83%; NNV: 15) and cardiac death (adjusted VE, 16%; 95% CI, 2–29%; NNV: 125), but not for death due to infection (adjusted VE, 17%; 95% CI, −5%–35%) (for definition of outcomes, see footnotes in Table 3). However, one of two studies  showed a significant protective effect of vaccination for all-cause mortality also in the absence of influenza virus circulation (VE, 55%; 95% CI, 50–59%), indicating residual confounding. The other study that provided a point estimate during the off-season showed no statistically significant effects .
Regarding hospitalization, significant protective effects of influenza vaccination were observed for the outcomes hospitalization due to influenza or pneumonia (pooled adjusted VE, 14%; 95% CI, 7–20%; I2 = 58%; NNV: 42) and ICU admission (adjusted VE, 81%; 95% CI, 63–86%; NNV: 18). No significant effects were found for all-cause hospitalization (pooled adjusted VE, 12%; 95% CI, −6–26%; I2 = 70%), hospitalization due to bacteremia, viremia, or septicemia (adjusted VE, 27%; 95% CI, −32–68%) and hospitalization due to respiratory infection (adjusted VE, 13%; 95% CI, −9–31%). A significant off-season estimate indicated the presence of residual confounding for the effect on hospitalization due to influenza or pneumonia (adjusted off-season VE, 26%; 95% CI, 15–36%). Likewise, effect on influenza-like illness was likely to be prone to residual confounding, indicated by a significant off-season VE which was even higher than the in-season VE (Table 3).
The sensitivity analysis revealed that the removal of data of patients on peritoneal dialysis  or of those with newly diagnosed ESRD  did not affect point estimates significantly (Additional file 4).
Laboratory-confirmed influenza infections were not reported. None of the studies provided data on vaccine safety, neither on local nor on systemic adverse events.
Quality of evidence
The body of evidence on influenza VE regarding all reported outcomes was rated as being of very low quality due to serious risk of bias (see Table 4 for GRADE evidence profile). Since data on vaccine safety could not be extracted, no rating of evidence quality could be performed.
Our results indicate that there is only very low quality evidence that influenza vaccination of patients with ESRD can prevent mortality, hospitalization, or other clinical outcomes. Although pooled estimates showed small to moderate protective effects against all-cause mortality and hospitalization due to influenza or pneumonia in this patient sub-group, VE that was measured outside influenza seasons showed even greater protective effects, thereby strongly indicating residual confounding. Protective effects against other clinical outcomes were either not statistically significant or only reported by single studies with a high risk of bias.
There are a few immunogenicity studies published that suggested that ESRD patients might have an impaired immune-response to inactivated influenza vaccines . However, other studies showed contradicting results and it remains unclear how well seroprotection rates translate into protection against clinical outcomes in general and how well humoral response is sufficient for protection in this patient sub-group in particular ,. Recently, the European Medicines Agency has changed its policy in the approval of seasonal influenza vaccines and has withdrawn the “Note for Guidance on Harmonisation of Requirements for Influenza Vaccines (CPMP/BWP/214/96)” . According to the European Medicines Agency, post-marketing studies monitoring the clinical benefit and risk profile of seasonal influenza vaccines should be strengthened, whereas providing immunogenicity data from small clinical trials should no longer be conducted, since these data might not correlate to the expected efficacy and safety of the vaccine . These arguments highlight the need to critically evaluate and summarize the available evidence by focusing on clinical outcomes rather than using surrogate markers of vaccine effectiveness. However, our review also shows the challenges that are related with the conduct of observational studies on influenza VE and when making decisions on regulatory aspects or vaccine recommendations based on only low or very low quality of evidence.
In our study, pooled VE estimates against all-cause mortality and hospitalization due to pneumonia and influenza were derived from four studies. If they were free of bias and confounding, they would indicate protective, albeit small to moderate effects in patients with ESRD. Given the high rates of respective events in this at-risk group, even a low effectiveness of 32% and 14% against all-cause mortality and hospitalization due to influenza or pneumonia, respectively, would correspond to a NNV of 15 and 42, respectively. Although differences between ESRD subpopulations are likely as, for example, shown in one study  by statistical significant differences in baseline characteristics between patients on hemodialysis and those on peritoneal dialysis, removal of patients on peritoneal dialysis or with newly diagnosed ESRD from the meta-analysis did not affect point estimates significantly. This was due to the large power of the study by McGrath et al. , which mainly influenced the results. Therefore, further conclusions from this sensitivity analysis have to be taken with caution.
When interpreting the VE results on clinical outcomes reported here, several issues have to be taken into account. First, risk of bias was high in four studies and unclear in the remaining one. This was due to inappropriate adjustment for confounders, unclear baseline imbalances of vaccinated and unvaccinated subpopulations, or strong indicators of residual confounding such as significant or even stronger protective vaccine effects outside influenza seasons. Second, since unspecific outcomes tend to ‘dilute’ the effectiveness of (influenza) vaccines , it remains unclear why VE was found to be higher for all-cause mortality than for the more specific outcome influenza/pneumonia hospitalization.
Interestingly, from a methodological perspective, was the approach used by McGrath et al.  when comparing VE in a year when the vaccine strains did not match with the circulating strain (unmatched season) with VE during a well-matched year. This approach can be used as an additional or alternative strategy to the “pseudo-effectiveness approach outside seasons” to assess the risk of bias in observational studies on influenza VE. Using the unmatched season as ‘working placebo’ did not reveal a protective effect of influenza vaccination against any clinical outcome. The authors concluded that the potential benefit of the influenza vaccine in patients with ESRD is small to negligible and protective effects measured using the conventional approach are likely to be biased. This issue might be driven by the ‘healthy vaccine effect’ and has been discussed previously for influenza vaccines . It has been suggested that estimating off-season estimates in observational studies could be helpful to assess the extent of unmeasured confounding . However, a recently conducted study found that even adjusting for more than 100 variables did not eliminate unmeasured confounding and that, instead, using the instrumental variable analysis method is effective in producing less-biased estimates . Furthermore, outcome misclassification could be prevented by using laboratory-confirmed influenza as an outcome, rather than unspecific indicators of mortality and morbidity.
Remarkably, we did not identify studies that compared safety outcomes between vaccinated and unvaccinated patients with ESRD. In healthy adults, vaccination against seasonal influenza is not associated with an increased risk of serious adverse events ,. However, in patients with ESRD, studies comparing reactogenicity of two different influenza vaccines  (subunit vs. virosomal) or assessing the immunogenicity among vaccinated participants , did not show any serious adverse events. In addition, two studies did not find differences in adverse event rates after influenza vaccination between patients with ESRD compared with healthy adults ,. Although limited by the lack of control groups and sample size, there is no clear evidence of an increased risk of severe adverse events following influenza vaccination in patients with ESRD.
Our study has several strengths. It is the first systematic review on this topic, covering all data published so far. In addition, by searching the largest respective data base (ClinicalTrials.gov) we also aimed at identifying unpublished studies. We performed an outcome-specific quality assessment of individual studies and considered the quality of the body of evidence for each outcome by using GRADE. The limitations of our systematic review were mainly due to the limitations of the included studies. Surprisingly, we identified studies from two countries only, although the number of patients with ESRD requiring dialysis is increasing worldwide -. Four of five included studies were conducted in the US, using the same data source. The USRDS database comprises the largest population of dialysis patients worldwide; however, the composition of this population might differ substantially from ESRD patients from other countries. Moreover, the USRDS is based on administrative claims data and some important variables, including the vaccination exposure might have not been adequately captured. For example, three studies - assessed the potential of exposure misclassification: Bond et al.  reported that, in a subsample, vaccination was reported by patients themselves and was not validated through clinical records. However, the authors argued that the mortality rate was higher among patients with self-reported (compared to database-documented) vaccination status and that therefore incorrect self-reports of having received vaccination would have biased the results towards the null. Gilbertson et al.  concluded that the low vaccination rate observed in their study might reflect a low sensitivity of the billing data that was used to determine vaccination status but that interpretation here is difficult. McGrath et al.  assumed that the number of vaccinations missed (e.g., if patients received a vaccine that was paid out of pocket) would be low given the fact that the vaccine is paid by the health maintenance organization covering the study population. In addition, at least partial overlap of the study population of the four different US studies cannot be ruled out, although the studies analyzed different seasons and the outcomes should be mutually exclusive for each season. However, multiple inclusions of the same patients could have artificially equalized point estimates from different studies. Finally, since our study sample was too small to formally test for publication bias, this form of bias cannot be ruled out.
In conclusion, our systematic review indicates that evidence on the protective effects of influenza vaccination in patients with ESRD is limited and of very low quality. Evidence on vaccine safety is absent. Therefore, studies using randomization or quasi-experimental designs are needed to determine the extent by which vaccination prevents influenza and related clinical outcomes in this important risk group. In addition, whether other vaccine types, such as adjuvant vaccines or high-dose vaccines, could have larger effects in this population compared to trivalent inactivated vaccines should also be assessed. Given the high rates of health-endangering events in these patients, even a low VE can be considered as sufficient to recommend annual influenza vaccination. However, physicians should consider influenza in their differential diagnosis if ESRD patients present with influenza-like illness symptoms regardless of whether they are vaccinated or not.
End-stage renal disease
Grading of Recommendations Assessment Development and Evaluation
Number needed to vaccinate
Randomized controlled trial
US Renal Data System
Anand S, Bitton A, Gaziano T: The gap between estimated incidence of end-stage renal disease and use of therapy. PLoS One. 2013, 8: e72860-10.1371/journal.pone.0072860.
U.S. Renal Data System: USRDS 2012 Annual Data Report: Atlas of Chronic Kidney Disease and End-Stage Renal Disease in the United States. Bethesda, MD: National Institutes of Health, National Institute of Diabetes and Digestive and Kidney Diseases; 2013.
White SL, Chadban SJ, Jan S, Chapman JR, Cass A: How can we achieve global equity in provision of renal replacement therapy?. Bull World Health Organ. 2008, 86: 229-237. 10.2471/BLT.07.041715.
Descamps-Latscha B: The immune system in end-stage renal disease. Curr Opin Nephrol Hypertens. 1993, 2: 883-891. 10.1097/00041552-199311000-00005.
Hauser AB, Stinghen AE, Kato S, Bucharles S, Aita C, Yuzawa Y, Pecoits-Filho R: Characteristics and causes of immune dysfunction related to uremia and dialysis. Perit Dial Int. 2008, 28: S183-S187.
Kato S, Chmielewski M, Honda H, Pecoits-Filho R, Matsuo S, Yuzawa Y, Tranaeus A, Stenvinkel P, Lindholm B: Aspects of immune dysfunction in end-stage renal disease. Clin J Am Soc Nephrol. 2008, 3: 1526-1533. 10.2215/CJN.00950208.
Naqvi SB, Collins AJ: Infectious complications in chronic kidney disease. Adv Chronic Kidney Dis. 2006, 13: 199-204. 10.1053/j.ackd.2006.04.004.
Sarnak MJ, Jaber BL: Mortality caused by sepsis in patients with end-stage renal disease compared with the general population. Kidney Int. 2000, 58: 1758-1764. 10.1111/j.1523-1755.2000.00337.x.
Sarnak MJ, Jaber BL: Pulmonary infectious mortality among patients with end-stage renal disease. Chest. 2001, 120: 1883-1887. 10.1378/chest.120.6.1883.
Centers for Disease Control and Prevention (CDC): Prevention and control of seasonal influenza with vaccines. Recommendations of the Advisory Committee on Immunization Practices--United States, 2013–2014. MMWR Recomm Rep. 2013, 62: 1-43.
Public Health England: Chapter 19: Influenza. In The Green Book; 2013. Updated 11 September 2013. [https://www.gov.uk/government/publications/influenza-the-green-book-chapter-19]. Accessed on 20 March 2014
National Advisory Committee on Immunization (NACI): Statement on Seasonal Influenza Vaccine for 2013–2014. In Canada Communicable Disease Report. October 2013, Volume 39, ACS-4; 2013. [http://www.phac-aspc.gc.ca/publicat/ccdr-rmtc/13vol39/acs-dcc-4/index-eng.php]. Accessed on 19 March, 2014.
German Standing Committee on Vaccination (STIKO): Empfehlungen der Ständigen Impfkommission (STIKO) am Robert Koch-Institut/Stand: August 2013. In Epidemiologisches Bulletin 34/2013; 2013. [http://www.rki.de/DE/Content/Infekt/EpidBull/Archiv/2013/Ausgaben/34_13.pdf?__blob=publicationFile]. Accessed on 19 March 2014
Mastalerz-Migas A, Steciwko A, Brydak LB: Immune response to influenza vaccine in hemodialysis patients with chronic renal failure. Adv Exp Med Biol. 2013, 756: 285-290. 10.1007/978-94-007-4549-0_35.
Vogtlander NP, Brown A, Valentijn RM, Rimmelzwaan GF, Osterhaus AD: Impaired response rates, but satisfying protection rates to influenza vaccination in dialysis patients. Vaccine. 2004, 22: 2199-2201. 10.1016/j.vaccine.2003.11.046.
Scharpe J, Peetermans WE, Vanwalleghem J, Maes B, Bammens B, Claes K, Osterhaus AD, Vanrenterghem Y, Evenepoel P: Immunogenicity of a standard trivalent influenza vaccine in patients on long-term hemodialysis: an open-label trial. Am J Kidney Dis. 2009, 54: 77-85. 10.1053/j.ajkd.2008.11.032.
Remschmidt C, Wichmann O, Harder T: Methodological quality of systematic reviews on influenza vaccination. Vaccine. 2014, 32: 1678-1684. 10.1016/j.vaccine.2014.01.060.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009, 151: 264-269. 10.7326/0003-4819-151-4-200908180-00135. W264
CASP UK: Critical Appraisal Skills Programme (CASP) 2014. 2014, CASP Checklists, Oxford
Higgins J, Green S: Cochrane Handbook of Systematic Reviews of Interventions. Cochrane Collaboration; 2011
Guyatt GH, Oxman AD, Schunemann HJ, Tugwell P, Knottnerus A: GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. J Clin Epidemiol. 2011, 64: 380-382. 10.1016/j.jclinepi.2010.09.011.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schunemann HJ, Group GW: GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008, 336: 924-926. 10.1136/bmj.39489.470347.AD.
Wang IK, Lin CL, Lin PC, Liang CC, Liu YL, Chang CT, Yen TH, Morisky DE, Huang CC, Sung FC: Effectiveness of influenza vaccination in patients with end-stage renal disease receiving hemodialysis: a population-based study. PLoS One. 2013, 8: e58317-10.1371/journal.pone.0058317.
Gilbertson DT, Unruh M, McBean AM, Kausz AT, Snyder JJ, Collins AJ: Influenza vaccine delivery and effectiveness in end-stage renal disease. Kidney Int. 2003, 63: 738-743. 10.1046/j.1523-1755.2003.00787.x.
Bond TC, Spaulding AC, Krisher J, McClellan W: Mortality of dialysis patients according to influenza and pneumococcal vaccination status. Am J Kidney Dis. 2012, 60: 959-965. 10.1053/j.ajkd.2012.04.018.
McGrath LJ, Kshirsagar AV, Cole SR, Wang L, Weber DJ, Sturmer T, Brookhart MA: Influenza vaccine effectiveness in patients on hemodialysis: an analysis of a natural experiment. Arch Intern Med. 2012, 172: 548-554. 10.1001/archinternmed.2011.2238.
Slinin Y, Foley RN, Collins AJ: Clinical epidemiology of pneumonia in hemodialysis patients: the USRDS waves 1, 3, and 4 study. Kidney Int. 2006, 70: 1135-1141. 10.1038/sj.ki.5001714.
Centers for Disease C, Prevention: Update: influenza activity--United States and worldwide, 1997–98 season, and composition of the 1998–99 influenza vaccine. MMWR Morb Mortal Wkly Rep. 1998, 47: 280-284.
Centers for Disease C, Prevention: Update: influenza activity--United States, 1997–98 season. MMWR Morb Mortal Wkly Rep. 1998, 47: 196-200.
European Medicines Agency: Explanatory Note on the Withdrawal of the Note for Guidance on Harmonisation of Requirements for Influenza Vaccines and of the Core SmPC/PL for Inactivated Seasonal Influenza Vaccines; 2014. [http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2014/07/WC500170300.pdf]. Accessed on 6 June, 2014.
Reber A, Katz J: Immunological assessment of influenza vaccines and immune correlates of protection. Expert Rev Vaccines. 2013, 12: 519-536. 10.1586/erv.13.35.
Beyer WE: Heterogeneity of case definitions used in vaccine effectiveness studies–and its impact on meta-analysis. Vaccine. 2006, 24: 6602-6604. 10.1016/j.vaccine.2006.05.038.
Lau D, Eurich DT, Majumdar SR, Katz A, Johnson JA: Effectiveness of influenza vaccination in working-age adults with diabetes: a population-based cohort study. Thorax. 2013, 68: 658-663. 10.1136/thoraxjnl-2012-203109.
Jackson ML, Yu O, Nelson JC, Naleway A, Belongia EA, Baxter R, Narwaney K, Jacobsen SJ, Shay DK, Jackson LA: Further evidence for bias in observational studies of influenza vaccine effectiveness: the 2009 influenza A(H1N1) pandemic. Am J Epidemiol. 2013, 178: 1327-1336. 10.1093/aje/kwt124.
Wong K, Campitelli MA, Stukel TA, Kwong JC: Estimating influenza vaccine effectiveness in community-dwelling elderly patients using the instrumental variable analysis method. Arch Intern Med. 2012, 172: 484-491. 10.1001/archinternmed.2011.2038.
Demicheli V, Jefferson T, Al-Ansary LA, Ferroni E, Rivetti A, Di Pietrantonj C: Vaccines for preventing influenza in healthy adults. Cochrane Database Syst Rev. 2014, 3.
Jefferson T, Di Pietrantonj C, Al-Ansary LA, Ferroni E, Thorning S, Thomas RE: Vaccines for preventing influenza in the elderly. Cochrane Database Syst Rev. 2010, 2.
Evison J, Farese S, Seitz M, Uehlinger DE, Furrer H, Muhlemann K: Randomized, double-blind comparative trial of subunit and virosomal influenza vaccines for immunocompromised patients. Clin Infect Dis. 2009, 48: 1402-1412. 10.1086/598193.
Brydak LB, Roszkowska-Blaim M, Machala M, Leszczynska B, Sieniawska M: Antibody response to influenza immunization in two consecutive epidemic seasons in patients with renal diseases. Vaccine. 2000, 18: 3280-3286. 10.1016/S0264-410X(00)00126-2.
Tanzi E, Amendola A, Pariani E, Zappa A, Colzani D, Logias F, Perego A, Zanetti AR: Lack of effect of a booster dose of influenza vaccine in hemodialysis patients. J Med Virol. 2007, 79: 1176-1179. 10.1002/jmv.20936.
Nikoskelainen J, Vaananen P, Forsstrom J, Kasanen A: Influenza vaccination in patients with chronic renal failure. Scand J Infect Dis. 1982, 14: 245-251. 10.3109/inf.1982.14.issue-4.01.
Cavdar C, Sayan M, Sifil A, Artuk C, Yilmaz N, Bahar H, Camsari T: The comparison of antibody response to influenza vaccination in continuous ambulatory peritoneal dialysis, hemodialysis and renal transplantation patients. Scand J Urol Nephrol. 2003, 37: 71-76. 10.1080/00365590310008749.
All authors declare that there is not conflict of interest related to the topic presented in this paper.
CR was responsible for the study design, performed the literature search, data extraction, statistical analysis and interpretation of the data, and drafted the manuscript. TH was responsible for the study design, performed the literature search, data extraction, statistical analysis and interpretation of the data, and drafted the manuscript. OW interpreted the data, gave important intellectual content, and revised the manuscript critically. All authors read and approved the final manuscript.