Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Vaccine effectiveness against referral to hospital after SARS-CoV-2 infection in St. Petersburg, Russia, during the Delta variant surge: a test-negative case-control study

BMC Medicine volume 20, Article number: 312 (2022) Cite this article

Abstract

Background

The results of a randomised trial showed the safety and efficacy of Gam-COVID-Vac against COVID-19. However, compared to other vaccines used across the globe, the real-world data on the effectiveness of Gam-COVID-Vac, especially against the disease caused by the Delta variant of concern, was limited. We aimed to assess the effectiveness of vaccination mainly conducted with Gam-COVID-Vac in St. Petersburg, Russia.

Methods

We designed a case-control study to assess the vaccine effectiveness (VE) against referral to hospital. Self-reported vaccination status was collected for individuals with confirmed SARS-CoV-2 infection who were referred for initial low-dose computed tomography (LDCT) triage in two outpatient centres in July 3–August 9, 2021, in St. Petersburg, Russia. We used logistic regression models to estimate the adjusted (for age, sex, and triage centre) VE for complete (14 days or more after the second dose) vaccination. We estimated the VE against referral for hospital admission, COVID-19-related lung injury assessed with LDCT, and decline in oxygen saturation.

Results

In the final analysis, 13,893 patients were included, 1291 (9.3%) patients met our criteria for complete vaccination status, and 495 (3.6%) were referred to hospital. In the primary analysis, the adjusted VE against referral to hospital was 81% (95% confidence interval: 68–88) for complete vaccination. The VE against referral to hospital was more pronounced in women (84%, 95% CI: 66–92) compared to men (76%, 95% CI: 51–88). Vaccine protective effect increased with increasing lung injury categories, from 54% (95% CI: 48–60) against any sign of lung injury to 76% (95% CI: 59–86) against more than 50% lung involvement. A sharp increase was observed in the probability of hospital admission with age for non-vaccinated patients in relation to an almost flat relationship for the completely vaccinated group.

Conclusions

COVID-19 vaccination was effective against referral to hospital in patients with symptomatic SARS-CoV-2 infection in St. Petersburg, Russia. This protection is probably mediated through VE against lung injury associated with COVID-19.

Peer Review reports

Background

Vaccination proved to be an effective pharmaceutical control measure during the COVID-19 pandemic. More than 4 billion doses have been already administered, but real-world evidence is not equally available for all vaccines used globally. Even though the results from clinical trials of Gam-COVID-Vac [1, 2] suggested safety and efficacy similar to other COVID-19 vaccines used in population-based programmes across the globe [3, 4], this finding was met with scepticism and criticism [5,6,7,8,9]. Despite adoption of Gam-COVID-Vac in 49 countries, the independent safety data for this vaccine is available only from San Marino and Argentina [10, 11]. The real-world evidence on Gam-COVID-Vac vaccine effectiveness (VE) from population-based studies is also limited [12,13,14,15,16].

A case-control study design and its modifications are the core methods to assess the effectiveness of vaccination in real-world settings [17]. Multiple case-control studies of COVID-19 vaccines have been published [18, 19]. The study that explored the VE of vaccines available in Scotland showed diminished protection against the Delta variant of concern (VOC) infection and hospital admission [20]. The COVID-19 pandemic in Russia has claimed more than 500,000 excess deaths by the spring of 2021 [21], while the lack of real-world evidence on the VE became a public health issue in Russia. Vaccination uptake in the country was undermined by vaccine hesitancy [22], partly driven by the lack of independent research exploring vaccine safety and effectiveness and failures to communicate the balance of benefits and harms of COVID-19 vaccination.

St. Petersburg is the second most populated city in Russia and the fourth in Europe. More than 45% of the population have contracted the SARS-CoV-2 infection by the end of April, 2021 [23]. However, only 10% received at least one dose of any vaccine by April, 2021, which is below the levels seen in other countries [23]. Low uptake by the spring of 2021 failed to stop the spread of the new Delta VOC in May–June 2021 in St. Petersburg. The spread of the Delta VOC, in turn, caused the rise in vaccination demand in the summer of 2021. As reported by the city government, by July 23, 2021, approximately 27% of the adult population of St. Petersburg received at least one dose of any vaccine, and 19% received two doses [24]. Consequently, this increase in the vaccination uptake has led to an increase in the absolute number of vaccinated individuals who reported to have a breakthrough infection or hospital admission. Such anecdotal evidence has caused further mistrust in the vaccination programme without reliable scientific reports.

This paper presents the first independent assessment of the VE in Russia. We designed a case-control study to assess the VE against referral to hospital in the individuals who reported symptoms and were referred for initial computed tomography assessment in two outpatient centres in St. Petersburg, Russia.

Methods

Population and study design

St. Petersburg and other cities in Russia have established a triage service for symptomatic patients with COVID-19. Symptomatic patients with confirmed SARS-CoV-2 (using polymerase chain reaction (PCR) test) are referred to outpatient triage, including brief physical examination and low-dose computed tomography (LDCT). The decision about hospital admission is based on symptoms, i.e. shortness of breath, oxygen saturation, overall clinical condition, and lung injury assessed with LDCT. We aimed to determine the VE against hospital referral and COVID-19 lung injury in symptomatic patients with confirmed SARS-CoV-2 infection, who were referred to the LDCT triage. VE in our study is defined as the reduction in odds of several severe outcomes (hospitalisation and lung injury) in patients with confirmed COVID-19, and it does not approximate the VE against infection or severe outcomes in comparison with healthy controls. We used a test-negative case-control study design, which is also defined as case-control with “other patient” control [25]. This study design is traditionally used to estimate VE against infection. However, in several instances, it was also used to estimate the protection or harmful effect of drugs against severe disease in symptomatic patients [26, 27].

We retrospectively collected individual-level patient data from two outpatient triage centres of the Medical Institute named after Berezin Sergey (MIBS), a private medical facility contracted by the city government to provide triage service for nearly half of the city districts. All patients referred to LDCT triage underwent brief physical examination, including pulse oximetry. A local computed tomography score (CT-score) was implemented in Russia [28]. It has five gradations (0, 1, 2, 3, 4) which are related to the volume of involved lung segments (0, less than 25%, 25–50%, 50–75%, 75–100%). It is used in the country to define the severity of COVID-19 lung injury and to triage patients. CT-score of 3 and 4 mean more than 50% of lung volume involvement and is often used as an indication for hospital admission. Patients with CT-score less than 3, i.e. less than 50% lung injury seen on the LDCT, and in the absence of severe symptoms, are normally sent to out-patient treatment or follow-up.

Vaccination status and outcomes

The information about self-reported vaccination status was collected at the time of appointment to the LDCT. The patients reported the number of doses and the dates of vaccination, the type of vaccine data was not collected. The majority of vaccinated residents in St. Petersburg received Gam-COVID-Vac. Other vaccines used in Russia were EpiVacCorona and CoviVac, but efficacy studies for them are not available. The proportion of the population that received other vaccines was 10% or less in St. Petersburg [16, 24].

We used several definitions of the vaccination status. Complete vaccination status was assigned to the patients who had reported receiving two doses at least 14 days before the referral to the LDCT triage. Partial vaccination status was assigned to the patients who failed to meet the above criteria for complete vaccination, but had reported receiving one dose at least 14 days prior to the referral. In addition, for the complete vaccination status, we stratified the period after the second dose to the period of 14 to 55 days and the period of 56 or more days.

In our primary analysis, cases were all patients referred to hospital after triage starting from July 3, 2021, till August 9, 2021, during the Delta VOC surge in St. Petersburg. Controls were the patients referred to outpatient treatment and follow-up after the LDCT triage in the same period.

In the secondary analyses, we used the CT-score [28] and oxygen saturation as the secondary outcomes to assess the VE against COVID-19 lung injury. Oxygen saturation was grouped in the ranges according to the NEWS2 score [29], which was well-validated in non-COVID-19 settings. It has four gradations (0, 1, 2, 3) which are related to the oxygen saturation in the following categories: more than 95, 94–95, 92–93, less than 92.

Statistical analysis

We modelled our study plan following the WHO interim guidance to evaluate COVID-19 vaccine effectiveness [30]. We collected information on all patients referred to the LDCT triage, as most patients were sent for out-patient treatment and outpatient follow-up. We used unconditional logistic regression for our primary and secondary outcomes to estimate odds ratios (ORs) for vaccination status among cases and controls, which approximates ORs for the outcomes (hospital admission, different levels of lung injury, and decline in oxygen saturation) among the vaccinated and non-vaccinated patients. For several levels of the outcome (e.g. lung injury categories), we used several models with binary outcomes sharing the same reference group (e.g. patients without any lung injury). The VE was calculated as 100%×(1−OR) adjusted for age (continuous variable), sex, and the triage LDCT centre. We abstained from post hoc sample size calculations [31].

All standard errors and confidence intervals were adjusted for heteroskedasticity with the Huber-Eicker-White sandwich estimator. Finally, we investigated the relationship between the outcomes and the thin plate regression spline of the patient age by vaccination status in a semiparametric logistic regression.

Results

Overall, 13,893 patients were included in the final analysis. Patient characteristics are presented in Table 1. Among all patients, 1964 (14.1%) received at least one dose, 1379 (9.9%) received two doses, 1291 (9.3%) met our criteria for complete vaccination status, and additionally, 448 (3.2%) met our criteria for partial vaccination status (one dose at least 14 days prior to the referral). Four hundred ninety-five (3.6%) patients were referred to hospital after the LDCT triage (232 or 4.1% from the one outpatient triage centre and 263 or 3.2% from the other). The majority of referred patients (63.1%) had CT-score 3–4 or > 50% lung involvement on LDCT. Patients referred to hospital were also older (66.1% were older than 60 years). Only 17 (3.4%) patients who were referred for hospital admission met the criteria for complete vaccination.

Table 1 Characteristics of patients with COVID-19 referred to triage centres
Full size table

In the primary analysis, the adjusted VE against referral to hospital admission was 81% (95% confidence interval: 68–88) for complete vaccination (Table 2). The effect of the partial vaccination against referral to hospital was 35% (95% CI: − 21–65).

Table 2 Effectiveness of complete vaccination against referral to hospital, overall and according to age group, sex, and triage centre
Full size table

The crude vaccine effect again any lung injury was 36% (28–43) and 54% (48–60) after adjustment for age, sex and triage centre. VE estimates against other outcomes related to severe diseases were in line with the main results. Crude and adjusted VE against severe lung injury were 58% (31–74) and 76% (59–86). Crude and adjusted vaccine effect against less than 96% oxygen saturation were 53% (22–72) and 70% (49–82). Only a few patients had more than 75% of lung involvement and none in the vaccination group, so we calculated the VE for the combined category, which included patients with more than 50% of lung involvement.

The VE against hospital admission was more pronounced in women (84%, 95% CI: 66–92) compared to men (76%, 95% CI: 51–88) and older age groups (77%, 95% CI: 62–86) (Table 2). We observed a sharp increase in the probability of hospital admission with age for non-vaccinated patients in relation to an almost flat relationship between age and the probability of hospital admission for the completely vaccinated group of patients (Fig. 1 and Fig. A1 in Supplementary material). We observed an increase in the probability of any lung injury with age in both groups with similar VE estimates across different age groups (Figs. A2 and A3 in Supplementary material). The adjusted VE by the time elapsed from the second dose was 60% (95% CI: 5–83) for the 14–55 day period and 85% (95% CI: 72–92) for the 56+ days. There was no difference in the VE by the LDCT triage centre. Crude VE estimates were lower compared to the adjusted VE.

Fig. 1
figure 1

Probability of referral to hospital, according to age and vaccination status (shaded areas are 95% CI)

Full size image

Discussion

This is the first study examining the real-world effectiveness of COVID-19 vaccination in Russia and one of the first studies globally to provide information about the vaccine protective effect against COVID-19-associated lung injury. Vaccination showed 81% (95% CI: 68–88) protection against referral to hospital in patients with symptomatic SARS-CoV-2 infection during the third wave of COVID-19 pandemic caused by Delta VOC in St. Petersburg. It is similar to the VE against Delta VOC reported for other COVID-19 vaccines [20].

The clear strength of this study is the availability of independent lung injury assessment using the LDCT. The radiologists did not have information on the vaccination status, while the computed tomography was applied as a triage method for all symptomatic patients. The protective effect of vaccination was consistent against all grades of lung injury. We did not observe 75% or more lung tissue involvement during the LDCT in the group of fully vaccinated patients, suggesting a strong and consistent protective effect. The protective effect was also observed against the decline in oxygen saturation. It was clear that both secondary outcomes (lung injury and decline in oxygen saturation) are closely related, but the oxygen saturation and LDCT were independently evaluated at the triage centres. Both factors independently influence the decision to refer to hospital, thus explaining the greater VE against hospital admission than for CT-score and oxygen saturation alone. These results further support the findings of the primary analysis.

Since all the patients in our study had COVID-19, our results provide specific information on vaccination impact on disease severity and its clinical course. When breakthrough infections are evolving as a cause of major concern, our data is assuring that the vaccine effect is going beyond the risk of contracting the infection. It shows that vaccination significantly diminishes disease severity and protects the lungs from virus-induced injury.

While SARS-CoV-2 is likely converting from a pandemic virus to an endemic one, the role of vaccination is also evolving from pandemic control to damage control. Our data shows that it is feasible. The infection fatality rate for COVID-19 is progressively increasing with age in St. Petersburg [23]. Our data shows that it is an effective way of protecting the most vulnerable elderly persons from the devastating consequences of the pandemic.

Lung injury is not only observed in COVID-19 but also in many other respiratory viral infections [32]. Lung injury leading to pneumonia and acute respiratory distress syndrome is a major cause of morbidity and mortality in these diseases. Lung imaging with computed tomography was used for assessment and risk stratification in COVID-19 [33]. However, in the USA and Europe, computed tomography was discouraged by the professional societies as the primary imaging modality in mild COVID-19 due to high cost and transmission risk, with emphasis placed on clinical assessment instead [34]. In Russia, due to less developed primary care and the low cost of the LDCT, it became the primary imaging modality used for COVID-19 triage. This offered the unique opportunity to assess the VE against lung injury detected with LDCT.

Our study does not provide direct evidence on the VE against SARS-CoV-2 infection. However, some indirect inferences can be made when analysing the characteristics of the overall patient group in our study. By July 23, 2021, the city government reported that at least one dose of vaccine was given to 1,178,266 residents of St. Petersburg (26.5% of the adult population), and 819,768 received two doses (18.5% of the adult population) [24]. In our study, among 13,893 symptomatic patients referred to the LDCT triage, only 12.5% received at least one dose, and 9.3% received two doses. In the absence of individual-level data, we can only estimate crude effectiveness against the symptomatic disease at around 50%. Our following case-control study confirmed that VE against symptomatic disease is likely higher than the estimated 56% due to bias arising from the high prevalence of the past COVID-19 in St. Petersburg [16].

Partial vaccination yields especially unreliable VE estimates due to low prevalence. The VE against Delta VOC for one dose of vaccine was lower than for two doses, and the effect did not clearly manifest until at least 28 days after the first one [20]. We obtained similar results in our study. The point estimate for partial vaccination was 34%, but the confidence interval for the corresponding OR included unity, suggesting an inadequate sample size. In Russia, the recommended 21-day interval between the first and the second dose of Gam-COVID-Vac is usually strictly followed.

In contrast to another study [18], we did not find any indications of waning efficacy. The VE was higher in patients with a longer period after the second dose. However, these results should be interpreted with caution, as possible biases can intervene in the stratified analysis of observational data. It is also important to distinguish between protection against infection and severe disease.

There are several important limitations of our study. The small number of vaccinated prevents us from conducting an adequately powered stratified analysis or estimating VE for one dose. It is also making the estimates less precise than ideal. We did not have the information on the vaccine type, so the estimated VE represent an average effect of vaccination in St. Petersburg. However, in its response to an inquiry by a member of St. Petersburg Legislative Assembly, the city health committee revealed that, by July 23, 2021, in St. Petersburg, among 1,227,496 individuals who received at least one vaccine dose, 1,178,266 or 96% received Gam-COVID-Vac, and the rest is distributed between the other two vaccines (EpiVacCorona—21,943 or 1.7% and CoviVac 27,287 or 2.2%) [24]. The October 2021 survey showed that only about 10% of responders in St. Petersburg received a vaccine other than Gam-COVID-Vac [16]. It is safe to assume that our study approximates the effectiveness of Gam-COVID-Vac. The effectiveness for EpiVacCorona and CoviVac would be difficult to derive from observational case-control studies due to low uptake.

Another important limitation of our study is possible referral bias. Patients were referred to the triage centres if they had positive PCR tests and disease symptoms, but the decision to refer was left at the physician’s and patients’ discretion. We cannot rule out that the vaccination status influenced this decision. If this is the case, we would observe more severely ill vaccinated individuals than the unvaccinated ones in our data.

Alternatively, the physicians may fully rely on vaccine protection and never refer the vaccinated patients to the triage. However, we observed many vaccinated individuals at the triage centres. Therefore, we believe that the referral bias would result in the underestimation of the VE. Vaccination could also influence patients’ medical care-seeking behaviour. We assume that self-assurance on vaccine protection would predominantly prevent patients with a mild disease from seeking medical care. This would also lead to underestimating the VE against severe disease in our study. The study results may also be biased if the triage centre referred symptomatic patients to the hospital based on their vaccination status. To the best of our knowledge, this decision was solely based on physical examination and the LDCT results. The vaccination status was collected for research purposes and was not a part of any official medical records. However, we cannot rule out this bias completely. There was a slight difference between triage centres in the proportion of referred symptomatic patients to the hospital. Still, it was consistent with the difference in the proportion of patients with severe lung injury and unlikely to reflect inconsistency between the centres. Our study could definitely benefit from information on the time from onset of the disease to visit the triage centre and underlying medical conditions. Still, unfortunately, this information was not collected.

Another limitation is related to the self-reported vaccination status collected in our study. As a result, possible misclassification could have biased study results. However, most of the vaccinated study participants received their doses in the same year, so we believe the recall bias was insignificant. Furthermore, we consider the population-based proportion of possible fake vaccinations negligible in July 2021, as the most strict control measures were introduced in St. Petersburg later in 2021.

The data we used in our study was collected at the triage centres and not in hospitals. Even though all patients triaged for inpatient treatment were followed-up by the LDCT centre’s personnel from the moment they were referred to the hospital till hospital admission, we do not know the length or the outcome of the hospital admission itself. It is also possible that the patients triaged for outpatient treatment were later admitted. Our study covers only one point in their disease course and traces only the decisions made in the triage centres.

Finally, misclassification could occur when patients with chronic lung diseases and SARS-CoV-2 infection become misdiagnosed with COVID-19 pneumonia. We believe that this misclassification would be non-differential and could underestimate VE. However, future effectiveness studies will benefit from past medical history collected.

Additional observational studies are needed to assess the vaccination effectiveness against SARS-CoV-2 infection and COVID-19 associated death. Given the limitations of our data, we were only able to estimate the protective effect against COVID-19 severe disease. However, it is safe to assume that those outcomes pose as a surrogate for COVID-19-associated death. Our study does not provide any information on the vaccine safety, but at least for Gam-COVID-Vac, the safety data are available from independent sources [10, 11].

Conclusions

We showed that COVID-19 vaccination is effective against referral to hospital in patients with symptomatic SARS-CoV-2 infection in St. Petersburg, Russia. The protection against hospital admission is probably mediated through protection against lung injury associated with COVID-19. Real-world evidence on the VE against COVID-19 should be integrated into population-based vaccination programmes to negotiate the balance of benefits and harms of this effective COVID-19 control measure, which is likely gaining even more importance in the light of the gradual ceasing of non-pharmaceutical interventions against COVID-19 and calls for a “return to normality”.

Availability of data and materials

All analyses were conducted in R; study data and code is available online https://github.com/eusporg/spb_covid_study20).

References

  1. Logunov DY, Dolzhikova IV, Zubkova OV, Tukhvatullin AI, Shcheblyakov DV, Dzharullaeva AS, Grousova DM, Erokhova AS, Kovyrshina AV, Botikov AG, et al. Safety and immunogenicity of an rAd26 and rAd5 vector-based heterologous prime-boost COVID-19 vaccine in two formulations: two open, non-randomised phase 1/2 studies from Russia. Lancet. 2020; 396(10255):887–97.

    Article  CAS  Google Scholar 

  2. Logunov DY, Dolzhikova IV, Shcheblyakov DV, Tukhvatulin AI, Zubkova OV, Dzharullaeva AS, Kovyrshina AV, Lubenets NL, Grousova DM, Erokhova AS, et al. Safety and efficacy of an rAd26 and rAd5 vector-based heterologous prime-boost covid-19 vaccine: an interim analysis of a randomised controlled phase 3 trial in Russia. Lancet. 2021; 397(10275):671–81.

    Article  CAS  Google Scholar 

  3. Voysey M, Clemens SAC, Madhi SA, Weckx LY, Folegatti PM, Aley PK, Angus B, Baillie VL, Barnabas SL, Bhorat QE, et al.Safety and efficacy of the ChAdOx1 nCoV-19 vaccine (AZD1222) against SARS-CoV-2: an interim analysis of four randomised controlled trials in Brazil, South Africa, and the UK. Lancet. 2021; 397(10269):99–111.

    Article  CAS  Google Scholar 

  4. Polack FP, Thomas SJ, Kitchin N, Absalon J, Gurtman A, Lockhart S, Perez JL, Marc GP, Moreira ED, Zerbini C, et al. Safety and efficacy of the BNT162b2 mRNA Covid-19 vaccine. N Engl J Med. 2020; 383:2603–15.

    Article  CAS  Google Scholar 

  5. Baraniuk C. Covid-19: What do we know about Sputnik V and other Russian vaccines? BMJ. 2021;372:n743. https://doi.org/10.1136/bmj.n743.

    Article  PubMed  Google Scholar 

  6. Bucci E, Andreev K, Björkman A, Calogero RA, Carafoli E, Carninci P, Castagnoli P, Cossarizza A, Mussini C, Guerin P, et al. Safety and efficacy of the Russian COVID-19 vaccine: more information needed. Lancet. 2020; 396(10256):53.

    Article  Google Scholar 

  7. Bucci EM, Berkhof J, Gillibert A, Gopalakrishna G, Calogero RA, Bouter LM, Andreev K, Naudet F, Vlassov V. Data discrepancies and substandard reporting of interim data of Sputnik V phase 3 trial. Lancet. 2021; 397(10288):1881–83.

    Article  CAS  Google Scholar 

  8. Logunov DY, Dolzhikova IV, Tukhvatullin AI, Shcheblyakov DV. Safety and efficacy of the Russian COVID-19 vaccine: more information needed – Authors’ reply. Lancet. 2020; 396(10256):54–55.

    Article  Google Scholar 

  9. Logunov DY, Dolzhikova IV, Shcheblyakov DV. Data discrepancies and substandard reporting of interim data of Sputnik V phase 3 trial – Authors’ reply. Lancet. 2021; 397(10288):1883–84.

    Article  CAS  Google Scholar 

  10. Montalti M, Soldà G, Di Valerio Z, et al. ROCCA observational study: Early results on safety of Sputnik V vaccine (Gam-COVID-Vac) in the Republic of San Marino using active surveillance. EClinicalMedicine. 2021;38:101027. https://doi.org/10.1016/j.eclinm.2021.101027. Published 2021 Jul 8.

  11. Pagotto V, Ferloni A, Mercedes Soriano M, et al. Active monitoring of early safety of Sputnik V vaccine in Buenos Aires, Argentina. Monitoreo activo de la seguridad temprana de la vacunación con Sputnik V en Buenos Aires, Argentina. Medicina (B Aires). 2021;81(3):408–14.

  12. Rearte A, Castelli JM, Rearte R, Fuentes N, Pennini V, Pesce M, Barbeira PB, Iummato LE, Laurora M, Bartolomeu ML, et al. Effectiveness of rAd26-rAd5, ChAdOx1 nCoV-19, and BBIBP-CorV vaccines for risk of infection with SARS-CoV-2 and death due to COVID-19 in people older than 60 years in argentina: a test-negative, case-control, and retrospective longitudinal study. Lancet. 2022; 399(10331):1254–64.

    Article  CAS  Google Scholar 

  13. Vokó Z, Kiss Z, Surján G, Surján O, Barcza Z, Pályi B, Formanek-Balku E, Molnár GA, Herczeg R, Gyenesei A, et al. Nationwide effectiveness of five SARS-CoV-2 vaccines in Hungary—the HUN-VE study. Clin Microbiol Infect. 2022; 28(3):398–404.

    Article  Google Scholar 

  14. González S, Olszevicki S, Salazar M, Calabria A, Regairaz L, Marín L, Campos P, Varela T, Martínez VVG, Ceriani L, et al. Effectiveness of the first component of Gam-COVID-Vac (Sputnik V) on reduction of SARS-CoV-2 confirmed infections, hospitalisations and mortality in patients aged 60-79: a retrospective cohort study in argentina. EClinicalMedicine. 2021; 40:101126.

    Article  Google Scholar 

  15. Horváth KJ, Ferenci T, Ferenczi A, Túri G, Röst G, Oroszi B. Real-time monitoring of the effectiveness of six COVID-19 vaccines in Hungary in 2021 using the screening method. medRxiv. 2022.

  16. Barchuk A, Bulina A, Cherkashin M, Berezina N, Rakova T, Kuplevatskaya D, Stanevich O, Skougarevskiy D, Okhotin A. COVID-19 vaccines effectiveness against symptomatic SARS-CoV-2 delta variant infection: a population-based case-control study in St. Petersburg, Russia. medRxiv. 2022.

  17. Evans SJW, Jewell NP. Vaccine effectiveness studies in the field. N Engl J Med Editorial. 2021. https://doi.org/10.1056/NEJMe2110605. http://arxiv.org/abs/https://doi.org/10.1056/NEJMe2110605.

  18. Lopez Bernal J, Andrews N, Gower C, et al. Effectiveness of the Pfizer-BioNTech and Oxford-AstraZeneca vaccines on covid-19 related symptoms, hospital admissions, and mortality in older adults in England: test negative case-control study. BMJ. 2021;373:n1088. https://doi.org/10.1136/bmj.n1088. Published 2021 May 13.

  19. Hitchings MD, Ranzani OT, Torres MSS, de Oliveira SB, Almiron M, Said R, Borg R, Schulz WL, de Oliveira RD, da Silva PV, et al.Effectiveness of CoronaVac among healthcare workers in the setting of high SARS-CoV-2 gamma variant transmission in Manaus, Brazil: a test-negative case-control study. Lancet Reg Health — Am. 2021.

  20. Sheikh A, McMenamin J, Taylor B, Robertson C. SARS-CoV-2 Delta VOC in Scotland: demographics, risk of hospital admission, and vaccine effectiveness. Lancet. 2021; 397(10293):2461–62.

    Article  CAS  Google Scholar 

  21. Karlinsky A, Kobak D. Tracking excess mortality across countries during the COVID-19 pandemic with the World Mortality Dataset. eLife. 2021; 10:69336.

    Article  Google Scholar 

  22. Arce JS, Warren SS, Meriggi NF, Scacco A, McMurry N, Voors M, Syunyaev G, Malik AA, Aboutajdine S, Armand A, et al.Covid-19 vaccine acceptance and hesitancy in low and middle income countries, and implications for messaging. Nat Med. 2021.

  23. Barchuk A, Skougarevskiy D, Kouprianov A, Shirokov D, Dudkina O, Tursun-zade R, Sergeeva M, Tychkova V, Komissarov A, Zheltukhina A, et al. Covid-19 pandemic in saint petersburg, russia: combining surveillance and population-based serological study data in may, 2020–april, 2021. PLoS ONE. 2022; 17(6):0266945.

    Article  Google Scholar 

  24. Fontanka Ru. V Smolnom rasskazali, kakaya iz treh vaktsin zaschitila peterburzhtsev ot koronavirusa lutshe vsego. 2021. https://www.fontanka.ru/2021/08/02/70057487/. Accessed on 21 Apr 2022.

  25. Vandenbroucke JP, Pearce N. Test-negative designs: differences and commonalities with other case–control studies with “other patient” controls. Epidemiology. 2019; 30(6):838–44.

    Article  Google Scholar 

  26. Bloemenkamp KW, Rosendaal FR, Büller HR, Helmerhorst FM, Colly LP, Vandenbroucke JP. Risk of venous thrombosis with use of current low-dose oral contraceptives is not explained by diagnostic suspicion and referral bias. Arch Intern Med. 1999; 159(1):65–70.

    Article  CAS  Google Scholar 

  27. Forsyth BW, Horwitz RI, Acampora D, Shapiro ED, Viscoli CM, Feinstein AR, Henner R, Holabird NB, Jones BA, Karabelas AD, et al. New epidemiologic evidence confirming that bias does not explain the aspirin/reye’s syndrome association. JAMA. 1989; 261(17):2517–24.

    Article  CAS  Google Scholar 

  28. Morozov SP, Chernina VY, Blokhin AI, Gombolevskiy VA. Chest computed tomography for outcome prediction in laboratory-confirmed COVID-19: a retrospective analysis of 38,051 cases. Digit Diagn. 2020; 1(1):27–36.

    Article  Google Scholar 

  29. Williams B. The National Early Warning Score 2 (NEWS2) in patients with hypercapnic respiratory failure. Clin Med. 2019; 19(1):94.

    Article  Google Scholar 

  30. WHO. Evaluation of COVID-19 vaccine effectiveness: interim guidance, 17 March 2021. Technical documents. Geneva: World Health Organization; 2021. 

  31. Althouse AD. Post hoc power: not empowering, just misleading. J Surg Res. 2021; 259:3–6.

    Article  Google Scholar 

  32. Franquet T, Jeong YJ, Lam HYS, Wong HYF, Chang Y-C, Chung MJ, Lee KS. Imaging findings in coronavirus infections: SARS-CoV, MERS-CoV, and SARS-CoV-2. Br J Radiol. 2020; 93(1112):20200515. https://doi.org/10.1259/bjr.20200515.

    Article  Google Scholar 

  33. Desmet J, Biebaû C, De Wever W, Cockmartin L, Viktor V, Coolen J, Verschakelen J, Dubbeldam A. Performance of low-dose chest CT as a triage tool for suspected COVID-19 patients. J Belg Soc Radiol. 2021; 105(1):1–8. https://doi.org/10.5334/jbsr.2319.

    Article  Google Scholar 

  34. Rubin GD, Ryerson CJ, Haramati LB, Sverzellati N, Kanne JP, Raoof S, Schluger NW, Volpi A, Yim J-J, Martin IBK, Anderson DJ, Kong C, Altes T, Bush A, Desai SR, Goldin O, Goo JM, Humbert M, Inoue Y, Kauczor H-U, Luo F, Mazzone PJ, Prokop M, Remy-Jardin M, Richeldi L, Schaefer-Prokop CM, Tomiyama N, Wells AU, Leung AN. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner Society. Radiology. 2020;296(1):172–80 https://doi.org/10.1148/radiol.2020201365.

    Article  Google Scholar 

Download references

Acknowledgements

We thank Alexandra Vasilieva, Alla Samoletova, and Maria Batygina (European University at St. Petersburg) for the science communication and administrative support. We also thank Evgeny Bakin for his insightful comments and Ivan Moiseev for study support. We thank the nurses and other personnel of the MIBS. We also thank all study participants.

Funding

The study team was entirely responsible for the study design and for collecting and analysing the data. There was no additional funding for the study provided.

Author information

Authors and Affiliations

  1. Institute for Interdisciplinary Health Research, European University at St. Petersburg, Shpalernaya Ulitsa 1, St. Petersburg, 191187, Russia

    Anton Barchuk, Anna Bulina, Oksana Stanevich & Dmitriy Skougarevskiy

  2. Medical Institute named after Berezin Sergey, Esenina Ulitsa 2-3a, St. Petersburg, 194354, Russia

    Mikhail Cherkashin, Natalia Berezina, Tatyana Rakova & Darya Kuplevatskaya

  3. Tarusa Hospital, Karla Libknekhta Ulitsa 16, Tarusa, 249100, Russia

    Artemiy Okhotin

  4. ITMO University, Kronverksky Prospekt 49, St. Petersburg, 197101, Russia

    Oksana Stanevich & Artemiy Okhotin

Authors
  1. Anton Barchuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mikhail Cherkashin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anna Bulina
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Natalia Berezina
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tatyana Rakova
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Darya Kuplevatskaya
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Oksana Stanevich
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Dmitriy Skougarevskiy
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Artemiy Okhotin
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Anton Barchuk, Artemy Okhotin, Mikhail Cherkashin, and Oksana Stanevich conceived the study. Anton Barchuk, Artemy Okhotin, Mikhail Cherkashin, and Oksana Stanevich coordinated the study. Anton Barchuk, Artemy Okhotin, Dmitriy Skougarevskiy, and Anna Bulina drafted the first version of the manuscript. Mikhail Cherkashin, Natalia Berezina, Tatyana Rakova, Darya Kuplevatskaya, and Oksana Stanevich contributed to drafting the sections of the manuscript. Mikhail Cherkashin, Natalia Berezina, Tatyana Rakova, and Darya Kuplevatskaya collected data for analysis. Anna Bulina, Dmitriy Skougarevskiy, and Anton Barchuk did the data analyses. All authors participated in the study design, helped to draft the manuscript, contributed to the interpretation of data, and read and approved the final manuscript.

Corresponding author

Correspondence to Anton Barchuk.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee of the MIBS approved the study on June 21, 2021. The Ethics Committee of the Pavlov First Saint Petersburg State Medical University approved the joint study of COVID-19 vaccine effectiveness in St. Petersburg on July 15, 2021. All research was performed following the relevant guidelines and regulations. All participants signed the informed consent upon referral to the LDCT triage. The joint study of COVID-19 vaccine effectiveness in St. Petersburg was registered at ClinicalTrials.gov (NCT04981405, date of registration — Aug 4, 2021). This publication covers the data collected at the two outpatient centres of the MIBS that contributed to the study data.

Consent for publication

Not applicable.

Competing interests

Anton Barchuk reports personal fees from AstraZeneca, MSD, and Biocad outside the submitted work. Other authors have no conflict of interest or competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

 Figure A1. Vaccine effectiveness against referral to hospital, according to age. Figure A2. Probability of any lung injury, according to age and vaccination status. Figure A3. Vaccine effectiveness against any lung injury, according to age.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Barchuk, A., Cherkashin, M., Bulina, A. et al. Vaccine effectiveness against referral to hospital after SARS-CoV-2 infection in St. Petersburg, Russia, during the Delta variant surge: a test-negative case-control study. BMC Med 20, 312 (2022). https://doi.org/10.1186/s12916-022-02509-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-022-02509-8

Keywords

BMC Medicine

ISSN: 1741-7015

Contact us