Skip to main content
Download PDF

Development and validation of the VitaL CLASS score to predict mortality in stage IV solid cancer patients with septic shock in the emergency department: a multi-center, prospective cohort study

BMC Medicine volume 18, Article number: 390 (2020) Cite this article

Abstract

Background

Clinical decision-making of invasive high-intensity care for critically ill stage IV cancer patients in the emergency department (ED) is challenging. A reliable and clinically available prognostic score for advanced cancer patients with septic shock presented at ED is essential to improve the quality of intensive care unit care. This study aimed to develop a new prognostic score for advanced solid cancer patients with septic shock available early in the ED and to compare the performance to the previous severity scores.

Methods

This multi-center, prospective cohort study included consecutive adult septic shock patients with stage IV solid cancer. A new scoring system for 28-day mortality was developed and validated using the data of development (January 2016 to December 2017; n = 469) and validation sets (January 2018 to June 2019; n = 428). The developed score’s performance was compared to that of the previous severity scores.

Results

New scoring system for 28-day mortality was based on six variables (score range, 0–8): vital signs at ED presentation (respiratory rate, body temperature, and altered mentation), lung cancer type, and two laboratory values (lactate and albumin) in septic shock (VitaL CLASS). The C-statistic of the VitaL CLASS score was 0.808 in the development set and 0.736 in the validation set, that is superior to that of the Sequential Organ Failure Assessment score (0.656, p = 0.01) and similar to that of the Acute Physiology and Chronic Health Evaluation II score (0.682, p = 0.08). This score could identify 41% of patients with a low-risk group (observed 28-day mortality, 10.3%) and 7% of patients with a high-risk group (observed 28-day mortality, 73.3%).

Conclusions

The VitaL CLASS score could be used for both risk stratification and as part of a shared clinical decision-making strategy for stage IV solid cancer patients with septic shock admitting at ED within several hours.

Peer Review reports

Background

Cancer is a major public health burden; both cancer incidence and mortality are expected to increase rapidly worldwide. Recent advances in cancer treatment have improved the overall survival rates; however, they have also increased the possibility of developing a critical illness requiring intensive care unit (ICU) management [1, 2]. Approximately 5% of the patients with solid cancer require ICU admission within 2 years after diagnosis [1, 2].

Sepsis and septic shock associated with cancer progression or chemo-radiation-therapy is a common life-threatening complication in cancer patients. Recent studies have demonstrated improved outcomes in cancer patients admitted to the ICU, and with appropriate patient selection, the outcomes of patients with or without cancer could be similar [3,4,5]. However, the decision of invasive ICU treatments for advanced cancer patients with septic shock is still challenging, especially in the emergency department (ED) setting. The clinical decision-making for advanced cancer patients with septic shock in the ED comprises more than 3 of health care specialties: critical care medicine, emergency medicine, oncology, and surgery. Treatment recommendations for these patients could be different depending on the specialties [6, 7]. Also, the patient-physician communication in such situations frequently leads to overutilization of invasive ICU treatments, which can produce more costly and invasive care without improving outcomes [8,9,10].

Sequential Organ Failure Assessment (SOFA) and Acute Physiology and Chronic Health Evaluation (APACHE) II scores are valid and widely used clinical prediction tools to determine the mortality risk, but they are designed to be calculated on the worst parameters recorded during the initial 24 h after admission and are not reliable at ED presentation [11, 12]. A reliable and clinically available prognostic score for advanced cancer patients with septic shock presented at ED is essential to improve the quality and efficiency of ICU care. To address this issue, we aimed to develop a new prognostic model for stage IV cancer patients who present with septic shock available at ED and compare its performance to existing scoring systems including SOFA score, APACHE II score, quick SOFA score, National Early Warning Score, and Modified Early Warning Score.

Methods

Study design and population

This multi-center, prospective observational study was conducted in the EDs of 11 Korean university-affiliated, tertiary referral centers using data from the Korean Shock Society septic shock registry, from January 2016 to December 2018. The Korean Shock Society is a Korean collaborative research network, established in 2013, for improving the quality of research, diagnosis, and management of sepsis [13]. Since October 2015, 11 EDs in the Korean Shock Society have been prospectively collecting data pertaining to patients with septic shock [13]. Adult patients (aged ≥ 19 years) who visited one of these EDs with suspected or confirmed infection and evidence of refractory hypotension or hypoperfusion were enrolled in the registry [14,15,16]. Refractory hypotension was defined as persistent systolic blood pressure < 90 mmHg, mean arterial pressure < 70 mmHg, or systolic blood pressure decrease > 40 mmHg after ≥ 20–30 mL/kg intravenous fluid administration or requiring vasopressors to maintain systolic blood pressure of ≥ 90 mmHg or mean arterial pressure of ≥ 70 mmHg [17]. Hypoperfusion was defined as serum lactate level of ≥ 4 mmol/L [18]. Exclusion criteria included patients who refused ICU management, patients who signed a “do not attempt resuscitation” order before ED arrival or at the time of diagnosis, patients who met the inclusion criteria 6 h after ED arrival, patients who were transferred from other hospitals after stabilization, patients who were directly transferred to other hospitals at ED, or patients who refused to enroll in the registry [13]. The institutional review boards of each participating institute approved the registry, and informed consent was obtained before data collection.

This study included patients with stage IV solid cancer who were enrolled in the septic shock registry and treated with intensive care between 1 January 2016 and 30 June 2019. The final cohort for this study included 897 patients; those selected from 1 January 2016 to 31 December 2017 were included in the development set (n = 469, 52.3%) and those selected from 1 January 2018 to 30 June 2019, in the validation set (n = 428, 47.7%).

Management and data collection

All patients were treated in accordance with then-current guidelines of the Surviving Sepsis Campaign including crystalloid administration, acquisition of blood cultures before antibiotic administration, and broad-spectrum antibiotic administration and vasopressor administration [17, 19]. The decision for subsequent intensive care was based on the intensivist according to institutional protocols. Empirical broad-spectrum antibiotics, such as piperacillin/tazobactam, cefepime, and meropenem, were administrated immediately after blood cultures at the ED, and after admission, further antibiotic treatments were adjusted.

The case report form of the Korean Shock Society septic shock registry includes standard definitions of 200 variables including demographic and clinical characteristics, therapeutic interventions, and outcomes. Data of the Korean Shock Society septic shock registry are collected via a standardized case report form and entered into a web-based electronic database [13]. The quality management committee monitors and reviews the completeness and consistency of data regularly and also gives feedback to the research coordinators and investigators of the results of the quality management process by using the web system’s query function or via a telephone call.

Data regarding age, sex, comorbid disease, focus of infection, laboratory findings, vital signs at ED presentation, and SOFA and APACHE II scores were retrieved from the registry. Mental status at ED presentation was assessed using the Alert/responsive to Voice/responsive to Pain/Unresponsive scale; unalert patients were considered to have altered mentation. Cancer type was reviewed additionally for this study using the diagnosis codes according to the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. We categorized the cases according to six common solid cancer types as follows: gastrointestinal cancer (C15-C20), hepatobiliary-pancreas cancer (C22-C25), lung cancer (C33-C34), gynecologic cancer (C53-C56), urologic cancer (C61-67), and “others/ill-defined” cancer. All blood samples for laboratory analysis including lactic acid were obtained from the patients at their initial presentation. SOFA and APACHE II scores were calculated using the worst parameters during the initial 24 h after ED admission. The quick SOFA score, National Early Warning Score, and Modified Early Warning Score were calculated using the initial vital signs at ED admission [20,21,22]. The primary endpoint of this study was 28-day mortality.

Statistical analysis

Categorical variables were presented as frequencies and percentages, and continuous variables as median with interquartile range (IQR). The χ2 test was used to compare categorical variables of development and validation sets, and the continuous variables for survivors and non-survivors of development and validation sets were compared using the t test or the Wilcoxon rank-sum test if the distribution was not normal. Lactic acid level was categorized into 3 groups (twice above the normal limit [≥ 4 mmol/L], 4 to 8 mmol/L, fourfold or more above the normal limit [≥ 8 mmol/L]) based on the previous guidelines and study [17, 23].

In the development set, univariate Cox proportional hazard analysis was performed to evaluate the prognostic ability of each variable. The variables in the scoring system were selected among all variables by using multivariable Cox proportional hazard analysis with backward elimination in 1000-fold bootstrap resampling [24]. Then, we counted how many times each candidate variable remained in the model in the 1000 bootstrap samples. If a variable appeared > 500 times in the final model, the variable was included in the scoring system. To allocate points in the scoring system, the bootstrapping method was used again to obtain bias-corrected regression coefficients to assign risk points in the scoring system. Risk points were obtained by bias-corrected regression coefficients multiplied by a reference value in the corresponding category. Each risk point was rescaled to designate the point of lung cancer as 1 (for example, the risk point for respiratory rate ≥ 22/min was 1, which was rounded from 0.891/0.617 = 1.444). A reference risk factor profile was chosen by selecting a base category for each risk factor, which was assigned 0 points in the scoring system. The total score was the weighted sum of those predictors of which the weights were defined as the rounded integer value of the quotient of regression coefficients divided by the regression coefficient of the reference predictor. The total scores based on patient profiles were converted into a risk estimate by using a specific formulation as below [25].

$$ \hat{p}=1-{S}_0{(t)}^{\exp \left({\sum}_{i=1}^p{\beta}_i{X}_i-{\sum}_{i=1}^p{\beta}_i{\overline{X}}_i\right)} $$

The calibration and discrimination of the final multivariable Cox proportional hazards model were assessed by calibration curve [26] and the Harrell C-statistic [27], respectively. The calibration measure compared the predicted and observed probability after data were partitioned into several groups. The discrimination index measured the concordance probability that predicted probabilities from a randomly selected pair of survivors and non-survivors. We categorized the groups based on the likelihood of 28-day mortality: low (score of 0–2, 7.07%), average (score of 3–5, 36.03%), and high (score of 6–8, 89.47%). Finally, we compared the C-index and Akaike information criterion of our new prognostic score with those of the SOFA and APACHE II scores using R package “compareC” [28].

All reported p values were 2-sided, and p < 0.05 was considered significant. All statistical analyses were performed using the SAS version 9.4 (SAS Institute Inc., Cary, NC, USA) and R (version 3.6.1; R Foundation for Statistical Computing, Vienna, Austria; https://www.R-project.org).

Results

During the study period, a total of 3486 patients with septic shock were enrolled in the Korean Shock Society septic shock registry, of which 897 (25.7%) patients with stage IV solid cancer were included. The overall 28-day mortality rate was 26.4% (237/897) and 499 (55.6%) patients admitted to ICU. The general characteristics of our study patients including those in the development (n = 469, 52.3%) and validation (n = 428, 47.7%) cohorts are presented in Table 1. The median age of our cohort was 66 years, and hepatobiliary-pancreas cancer (31.9%) and lung cancer (16.8%) were the dominant cancer types. Patients in the validation set showed significantly higher initial lactate level (median, 3.4 vs. 3.7 mmol/L, p = 0.03), SOFA (median, 7.0 vs. 8.0, p = 0.002), and APACHE II (median, 19.0 vs. 21.0, p = 0.04) scores.

Table 1 Characteristics of the patients in the development set and validation set
Full size table

The univariable Cox proportional hazards model for predicting the 28-day mortality in the development set is summarized in Table 2. The bootstrap resampling variable selection method provided six variables: respiratory rate, body temperature, altered mentation at ED presentation, lung cancer, lactic acid, and albumin. We performed a second multivariate Cox proportional hazards analysis using only those six final independent variables, and the final prediction model was developed based on the bias-corrected regression coefficients as shown in Tables 3 and 4. We named this new prognostic scoring system the VitaL CLASS score (vital signs-lung cancer-lactate-albumin in septic shock). The C-statistic for the VitaL CLASS score was 0.808 (95% confidence interval [CI], 0.772–0.845) in the development set and 0.736 (95% CI, 0.694–0.778) in the validation set (Table 5). In the development set, the C-static for the VitaL CLASS score was superior to that of the existing scoring systems such as the SOFA (0.713; 95% CI, 0.664–0.762; p = 0.001) and APACHE II (0.692; 95% CI, 0.643–0.741; p < 0.001). In the validation set, the C-statistic of the VitaL CLASS score (0.736) was superior to that of the SOFA score (0.656; p = 0.01) and similar to that of the APACHE II score (0.682; p = 0.08). The calibration curve of our new score demonstrated good correlation between the predicted and actual probability of 28-day mortality in both sets (Fig. 1). A subgroup analysis of the patients who fulfill the sepsis-3 criteria for septic shock was performed. Additional file 1: Table S1 shows there was no difference in general characteristics between development and validation subgroup cohorts. The VitaL CLASS score of the patients who fulfill the sepsis-3 criteria for septic shock demonstrated superior prognostic performance to the existing scoring systems in the development set (C-index, 0.806; 95% CI, 0.761–0.851), and similar performance to SOFA and APACHE II scores in the validation set (C-index, 0.702; 95% CI, 0.649–0.755) (Additional file 2: Table S2).

Table 2 Characteristics of the survivors and non-survivors and the univariable Cox proportional hazards model for 28-day mortality in the development set
Full size table
Table 3 Multivariable analysis model for 28-day mortality in the development set
Full size table
Table 4 The new prognostic scoring system named VitaL CLASS score (vital signs-lung cancer-lactate-albumin in septic shock) predicting for 28-day mortality
Full size table
Table 5 The C-indices for testing of the VitaL CLASS score and other pre-existing scoring systems
Full size table
Fig. 1
figure 1

Internal validation in the development set (a) and external validation in the validation set (b)

Full size image

Table 6 shows the performance of the final point score and risk groups according to the VitaL CLASS score in development and validation datasets. Based on the estimate of probability for 28-day mortality, the VitaL CLASS score classified the patients into 3 groups: low (0–2), average (3–5), and high (6–8) risk groups. In the validation set, the VitaL CLASS score identified 40.9% and 7.0% of the patients as having a low risk and high risk of 28-day mortality, respectively. The patients in the low-risk group had 10.3% (18/175) of mortality, whereas 73.3% (22/30) of the patients in the high-risk group died within 28 days after admission.

Table 6 Performance of the prognostic model in the development, validation, and combination sets
Full size table

Discussion

We developed and validated a simple and objective prognostic model, the VitaL CLASS score, which is applicable in the ED very early. This scoring system could identify stage IV cancer patients who present to the ED with septic shock as having low, average, or high risk of death within 28 days. Using this score, it would be helpful to triage patients in the high-risk group, who have a low possibility of benefitting from intensive care, and those in the low-risk group, who have a high likelihood of survival. This risk assessment would help physicians share information with patients and family and establish goals-of-care among physicians of different specialties as well as patients in the ED regarding life-sustaining treatments including mechanical ventilation, vasoactive infusions, new renal replacement therapy, or cardiopulmonary resuscitation and physician orders for life-sustaining treatment (POLST) orders. The VitaL CLASS score shows good prognostic performance and is simple and fast to use, comparing to existing scoring systems, SOFA and APACHE II scores.

The VitaL CLASS score to predict short-term mortality among stage IV cancer patients with septic shock consists of four clinical factors identified at ED presentation: cancer type (lung cancer and the other types of cancer), respiratory rate, body temperature and altered mentation, and two laboratory values reported within hours, i.e., lactic acid and albumin. This simple and objective prognostic model for stage IV cancer patients with septic shock uses data available within hours after ED admission. The majority of patients with advanced medical illness would prefer palliative approaches to invasive ICU treatments when they were informed of their therapeutic options, and such invasive ICU treatments should be aligned with patients’ values and prognostic information [10, 29,30,31]. Furthermore, the demand for ICU care usually exceeds supply, and consequently, the triage and allocation decisions for ICU care for critically ill patients are important. Although objective decision-making guidelines would facilitate the fair use of medical resources, these guidelines are imprecise and are not sufficiently validated for advanced cancer patients [32,33,34]. Recently, a new strategy for critically ill cancer patients has been introduced considering these limitations that consist of unlimited ICU management with a full-code status for a limited period [35, 36]. However, this is difficult to achieve in several hospitals with a chronic shortage of ICU resources. We believe that the VitaL CLASS score could help physicians identify those who are more likely to benefit from invasive ICU management from those with minimal anticipated benefit, to make better allocations of medical resources, and to discuss do-not-attempt-resuscitation or POLST orders in the ED before admission.

Cancer type is an important prognostic factor for cancer patients, and the mortality rate varies by cancer type in cancer patients with severe sepsis/septic shock [37]. Lung cancer was the second most common cancer type in our cohort (16.8%), following hepatobiliary-pancreas cancer (31.9%). In our study, lung cancer patients with septic shock had the highest 28-day mortality (48.1%) from septic shock, whereas the mortality rate of gynecologic cancer patients was the lowest (10.2%). These mortality rate differences are consistent with those reported in previous studies [37]. In our study, lung cancer was associated with 2.0-fold higher odds when compared with the other types of cancer. Previous studies demonstrated that infection focus, such as respiratory infection, was an important prognostic feature in septic shock patients, but it was not a significant prognostic factor in our study for stage IV solid cancer patients with septic shock [38, 39].

The VitaL CLASS score includes three vital signs at ED admission: respiratory rate, body temperature, and mentation. Tachypnea, i.e., respiratory rate ≥ 22, and altered mentation are commonly used as core poor prognostic factors, consistent with many previous studies on prognostic scoring systems such as quick SOFA, National Early Warning Score, and Modified Early Warning Score [20,21,22]. Body temperature < 38.0 °C (100.4 °F) was another poor prognostic factor in our prognostic model. Generally, fever is a poor prognostic sign for septic shock patients. However, for cancer patients with septic shock who have a suppressed immune system, fever implies a protective response, namely that their innate and adaptive immune system is functioning better than in those without fever, and such a paradoxical response has been reported in previous studies [40, 41].

The other two laboratory values were lactic acid and albumin levels. Serum lactate levels of ≥ 8.0 mmol/L and from 4.0–7.9 mmol/L were assigned 2 and 1 points, respectively. Lactate level is a reliable biomarker for outcome prediction and severity assessment in numerous conditions [42]. Septic shock according to the Third International Consensus was defined as refractory hypotension and serum lactate level of > 2 mmol/L [43]. A lactate level of > 4 mmol/L at ED admission is associated with mortality in patients with sepsis independent of organ failure, and we used higher cut-offs of 4.0 and 8.0 mmol/L at ED admission [18, 44]. Serum albumin is a surrogate marker of visceral protein function and nutritional status [45], but its synthesis is also suppressed by inflammation [46, 47]. Serum albumin level reflects both the acute and chronic health status of critically ill patients [45, 48]. The cut-off level of albumin (< 2.8 g/dL) in our prediction model is consistent with that used in previous studies, which showed that hypoalbuminemia, defined as < 2.7 or < 2.9 g/dL, was an independent risk factor for mortality in patients with sepsis [48, 49].

The strength of this study was that the VitaL CLASS score consisted of variables that are usually assessed within hours of ED presentation and can be calculated in the time period before admission. However, several limitations should be considered when interpreting the findings of the present study. First, we developed and validated a new prognostic model for stage IV solid cancer patients who present with septic shock to the ED using data from a prospectively collected registry; however, there was no detailed information on cancer-related characteristics such as cancer treatment (i.e., radiotherapy, chemotherapy, and surgery), response to therapy, performance status, and time from initial cancer diagnosis, which are known as major determinant for the short-term outcome. This was a significant limitation of our study. However, recent studies demonstrated that cancer-related characteristics were not associated with short-term mortality [2, 34, 50]. Additionally, performance status is still a valid prognostic factor, but its accurate determination at the ED is challenging due to subjectivity and irreproducibility [51, 52]. Second, the lack of an external validation sample is another main limitation of our study, and further studies for validation of our prognostic model, especially studies involving other races/ethnicities, are warranted. Third, we divided the development (January 2016 to December 2017) and validation sets (January 2018 to June 2019) according to time, and thus, the characteristics of the cohorts and treatments could vary according to the study period. Also, advances in cancer treatment would affect the outcome, which might be associated with the decrease of the predictive value in the validation cohort. However, most variables including outcomes did not show a significant difference, and the study period was only 3.5 years. Additionally, the statistically different variables between development and validation cohorts were not likely to have a clinically significant impact, e.g., body temperature (median, 37.8 vs. 37.6 °C, p = 0.005) and lactate level (median, 3.4 vs. 3.7 mmol/L, p = 0.03). Fourth, the lactate level could be affected by many clinical conditions such as liver cirrhosis, advanced heart failure, and metformin use. Fifth, all physicians treated patients according to the current Surviving Sepsis guidelines; however, in-hospital treatment strategies, such as ventilator application or continuous renal replacement therapy, and end-of-life decisions that could affect the outcome, were not standardized between the participating hospitals. Lastly, this study did not include the patients who signed a “do not attempt resuscitation” order before ED arrival or at the time of diagnosis, which may lead to a selection bias and limit the generalizability.

Conclusions

In summary, we developed and validated a simple and objective clinical prediction model, the VitaL CLASS score, for predicting the 28-day mortality in stage IV cancer patients who present with septic shock at the ED. The VitaL CLASS score identified 40.9% of the patients as having a very low likelihood of 28-day mortality (28-day mortality in 10.3%, 18/175) with appropriate critical care and 7.0% of the patients as a high-risk group with minimal anticipated benefit of invasive ICU treatment (28-day mortality in 73.3%, 22 of 30). We believe this prognostic model could provide useful information for patients, their families, and physicians of different specialties and can be used as part of a clinical decision-making strategy regarding aggressive life-sustaining treatments or POLST orders as well as the triage decision for ICU admission.

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

APACHE:

Acute Physiology and Chronic Health Evaluation

CI:

Confidence interval

ED:

Emergency department

ICU:

Intensive care unit

IQR:

Interquartile range

POLST:

Physician orders for life-sustaining treatment

SOFA:

Sequential Organ Failure Assessment

References

  1. Puxty K, McLoone P, Quasim T, Sloan B, Kinsella J, Morrison DS. Risk of critical illness among patients with solid cancers: a population-based observational study. JAMA Oncol. 2015;1(8):1078–85.

    Article  PubMed  Google Scholar 

  2. Soares M, Caruso P, Silva E, Teles JM, Lobo SM, Friedman G, Dal Pizzol F, Mello PV, Bozza FA, Silva UV. Characteristics and outcomes of patients with cancer requiring admission to intensive care units: a prospective multicenter study. Crit Care Med. 2010;38(1):9–15.

    Article  PubMed  Google Scholar 

  3. Larché J, Azoulay É, Fieux F, Mesnard L, Moreau D, Thiery G, Darmon M, Le Gall J-R, Schlemmer B. Improved survival of critically ill cancer patients with septic shock. Intensive Care Med. 2003;29(10):1688–95.

    Article  PubMed  Google Scholar 

  4. Pène F, Percheron S, Lemiale V, Viallon V, Claessens Y-E, Marqué S, Charpentier J, Angus DC, Cariou A, Chiche J-D. Temporal changes in management and outcome of septic shock in patients with malignancies in the intensive care unit. Crit Care Med. 2008;36(3):690–6.

    Article  PubMed  Google Scholar 

  5. Taccone FS, Artigas AA, Sprung CL, Moreno R, Sakr Y, Vincent J-L. Characteristics and outcomes of cancer patients in European ICUs. Crit Care. 2009;13(1):R15.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Schell CO, Wärnberg MG, Hvarfner A, Höög A, Baker U, Castegren M, Baker T. The global need for essential emergency and critical care. Crit Care. 2018;22(1):284.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Rivera DR, Gallicchio L, Brown J, Liu B, Kyriacou DN, Shelburne N. Trends in adult cancer–related emergency department utilization: an analysis of data from the nationwide emergency department sample. JAMA oncology. 2017;3(10):e172450.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Chang DW, Shapiro MF. Association between intensive care unit utilization during hospitalization and costs, use of invasive procedures, and mortality. JAMA Intern Med. 2016;176(10):1492–9.

    Article  PubMed  Google Scholar 

  9. Chang DW, Dacosta D, Shapiro MF. Priority levels in medical intensive care at an academic public hospital. JAMA Intern Med. 2017;177(2):280–1.

    Article  PubMed  Google Scholar 

  10. Chang D, Parrish J, Kamangar N, Liebler J, Lee M, Neville T. Time-limited trials among critically ill patients with advanced medical illnesses to reduce nonbeneficial intensive care unit treatments: protocol for a multicenter quality improvement study. JMIR Res Protoc. 2019;8(11):e16301.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Vincent J-L, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart C, Suter P, Thijs L. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med. 1996;22(7):707–10.

    Article  CAS  PubMed  Google Scholar 

  12. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–29.

    Article  CAS  PubMed  Google Scholar 

  13. Shin TG, Hwang SY, Kang GH, Kim WY, Ryoo SM, Kim K, Jo YH, Chung SP, Joo YS, Beom JH. Korean Shock Society septic shock registry: a preliminary report. Clin Exp Emerg Med. 2017;4(3):146.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Mouncey PR, Osborn TM, Power GS, Harrison DA, Sadique MZ, Grieve RD, Jahan R, Harvey SE, Bell D, Bion JF. Trial of early, goal-directed resuscitation for septic shock. N Engl J Med. 2015;372(14):1301–11.

    Article  CAS  PubMed  Google Scholar 

  15. Peake SL, Delaney A, Bailey M, Bellomo R, Cameron PA, Cooper DJ, Higgins AM, Holdgate A, Howe BD, Webb SA, et al. Goal-directed resuscitation for patients with early septic shock. N Engl J Med. 2014;371(16):1496–506.

    Article  CAS  PubMed  Google Scholar 

  16. Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, Terndrup T, Wang HE, Hou PC, LoVecchio F, et al. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370(18):1683–93.

    Article  CAS  PubMed  Google Scholar 

  17. Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive Care Med. 2013;39(2):165–228.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Casserly B, Phillips GS, Schorr C, Dellinger RP, Townsend SR, Osborn TM, Reinhart K, Selvakumar N, Levy MM. Lactate measurements in sepsis-induced tissue hypoperfusion: results from the Surviving Sepsis Campaign database. Crit Care Med. 2015;43(3):567–73.

    Article  CAS  PubMed  Google Scholar 

  19. Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, Sevransky JE, Sprung CL, Nunnally ME. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. 2017;43(3):304–77.

    Article  PubMed  Google Scholar 

  20. Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, Rubenfeld G, Kahn JM, Shankar-Hari M, Singer M. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):762–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84(4):465–70.

    Article  PubMed  Google Scholar 

  22. Subbe C, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in medical admissions. QJM. 2001;94(10):521–6.

    Article  CAS  PubMed  Google Scholar 

  23. Zhang Z, Chen K, Ni H, Fan H. Predictive value of lactate in unselected critically ill patients: an analysis using fractional polynomials. J Thorac Dis. 2014;6(7):995–1003.

    PubMed  PubMed Central  Google Scholar 

  24. Sauerbrei W, Schumacher M. A bootstrap resampling procedure for model building: application to the Cox regression model. Stat Med. 1992;11(16):2093–109.

    Article  CAS  PubMed  Google Scholar 

  25. Sullivan LM, Massaro JM, D'Agostino RB Sr. Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med. 2004;23(10):1631–60.

    Article  PubMed  Google Scholar 

  26. Crowson CS, Atkinson EJ, Therneau TM. Assessing calibration of prognostic risk scores. Stat Methods Med Res. 2016;25(4):1692–706.

    Article  PubMed  Google Scholar 

  27. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.

    Article  PubMed  Google Scholar 

  28. Kang L, Chen W, Petrick NA, Gallas BD. Comparing two correlated C indices with right-censored survival outcome: a one-shot nonparametric approach. Stat Med. 2015;34(4):685–703.

    Article  PubMed  Google Scholar 

  29. Curtis JR, Engelberg RA, Bensink ME, Ramsey SD. End-of-life care in the intensive care unit: can we simultaneously increase quality and reduce costs? Am J Respir Crit Care Med. 2012;186(7):587–92.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Angus DC, Barnato AE, Linde-Zwirble WT, Weissfeld LA, Watson RS, Rickert T, Rubenfeld GD. Use of intensive care at the end of life in the United States: an epidemiologic study. Crit Care Med. 2004;32(3):638–43.

    Article  PubMed  Google Scholar 

  31. Barnato AE, Anthony DL, Skinner J, Gallagher PM, Fisher ES. Racial and ethnic differences in preferences for end-of-life treatment. J Gen Intern Med. 2009;24(6):695–701.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Thiéry G, Azoulay É, Darmon M, Ciroldi M, De Miranda S, Lévy V, Fieux F, Moreau D, Le Gall JR, Schlemmer B. Outcome of cancer patients considered for intensive care unit admission: a hospital-wide prospective study. J Clin Oncol. 2005;23(19):4406–13.

    Article  PubMed  Google Scholar 

  33. Honiden S, Possick J. Should physicians new to a case counsel patients and their families to change course at the end of life? AMA J Ethics. 2018;20(8):699–707.

    Article  Google Scholar 

  34. Azoulay E, Schellongowski P, Darmon M, Bauer PR, Benoit D, Depuydt P, Divatia JV, Lemiale V, van Vliet M, Meert A-P. The Intensive Care Medicine research agenda on critically ill oncology and hematology patients. Intensive Care Med. 2017;43(9):1366–82.

    Article  PubMed  Google Scholar 

  35. Shrime MG, Ferket BS, Scott DJ, Lee J, Barragan-Bradford D, Pollard T, Arabi YM, Al-Dorzi HM, Baron RM, Hunink MM. Time-limited trials of intensive care for critically ill patients with cancer: how long is long enough? JAMA Oncol. 2016;2(1):76–83.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Lecuyer L, Chevret S, Guidet B, Aegerter P, Martel P, Schlemmer B, Azoulay E. Case-volume and mortality in hematological patients with acute respiratory failure. Eur Respir J. 2008;32(3):784–54.

    Article  Google Scholar 

  37. Williams MD, Braun LA, Cooper LM, Johnston J, Weiss RV, Qualy RL, Linde-Zwirble W. Hospitalized cancer patients with severe sepsis: analysis of incidence, mortality, and associated costs of care. Crit Care. 2004;8(5):R291.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Angus DC, Van der Poll T. Severe sepsis and septic shock. N Engl J Med. 2013;369(9):840–51.

    Article  CAS  PubMed  Google Scholar 

  39. Mayr FB, Yende S, Angus DC. Epidemiology of severe sepsis. Virulence. 2014;5(1):4–11.

    Article  PubMed  Google Scholar 

  40. Evans SS, Repasky EA, Fisher DT. Fever and the thermal regulation of immunity: the immune system feels the heat. Nat Rev Immunol. 2015;15(6):335–49.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Kim Y-J, Kang J, Ryoo SM, Ahn S, Huh JW, Kim WY. Platelet–lymphocyte ratio after granulocyte colony stimulating factor administration: an early prognostic marker in septic shock patients with chemotherapy-induced febrile neutropenia. Shock. 2019;52(2):160–5.

    Article  CAS  PubMed  Google Scholar 

  42. Kraut JA, Madias NE. Lactic acidosis. N Engl J Med. 2014;371(24):2309–19.

    Article  PubMed  CAS  Google Scholar 

  43. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche J-D, Coopersmith CM. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Mikkelsen ME, Miltiades AN, Gaieski DF, Goyal M, Fuchs BD, Shah CV, Bellamy SL, Christie JD. Serum lactate is associated with mortality in severe sepsis independent of organ failure and shock. Crit Care Med. 2009;37(5):1670–7.

    Article  CAS  PubMed  Google Scholar 

  45. Gupta D, Lis CG. Pretreatment serum albumin as a predictor of cancer survival: a systematic review of the epidemiological literature. Nutr J. 2010;9(1):69.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Ballmer PE, Ochsenbein AF, Schütz-Hofmann S. Transcapillary escape rate of albumin positively correlates with plasma albumin concentration in acute but not in chronic inflammatory disease. Metab Clin Exp. 1994;43(6):697–705.

    Article  CAS  PubMed  Google Scholar 

  47. Yeun JY, Kaysen GA. Factors influencing serum albumin in dialysis patients. Am J Kidney Dis. 1998;32(6):S118–25.

    Article  CAS  PubMed  Google Scholar 

  48. Tabak YP, Johannes RS. Prevalence and mortality impact of hypoalbuminemia among sepsis patients: analysis of 65,470 admissions between 2000–2003.: 104-M. Crit Care Med. 2005;33(12):A80.

    Article  Google Scholar 

  49. Sivayoham N, Rhodes A, Cecconi M. The MISSED score, a new scoring system to predict Mortality In Severe Sepsis in the Emergency Department: a derivation and validation study. Eur J Emerg Med. 2014;21(1):30–6.

    PubMed  Google Scholar 

  50. Azoulay E, Pène F, Darmon M, Lengliné E, Benoit D, Soares M, Vincent F, Bruneel F, Perez P, Lemiale V. Managing critically ill hematology patients: time to think differently. Blood Rev. 2015;29(6):359–67.

    Article  PubMed  Google Scholar 

  51. Laird BJ, Kaasa S, McMillan DC, Fallon M, Hjermstad M, Fayers P, Klepstad P. Prognostic factors in patients with advanced cancer: a comparison of clinicopathological factors and the development of an inflammation-based prognostic system. Clin Cancer Res. 2013;19(19):5456–64.

  52. Zimmermann C, Burman D, Bandukwala S, Seccareccia D, Kaya E, Bryson J, Rodin G, Lo C. Nurse and physician inter-rater agreement of three performance status measures in palliative care outpatients. Support Care Cancer. 2010;18(5):609–16.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We wish to express our sincere gratitude to the members of the Korean Shock Society for their dedication to this septic shock registry.

Funding

This research received no external funding.

Author information

Author notes

  1. Youn-Jung Kim and Jihoon Kang contributed equally to this work.

Authors and Affiliations

  1. Department of Emergency Medicine, University of Ulsan College of Medicine, Asan Medical Center, 88, Olimpic-ro 43-gil, Songpa-gu, Seoul, 05505, South Korea

    Youn-Jung Kim, Seung Mok Ryoo & Won Young Kim

  2. Department of Hematology/Oncology, Department of Internal Medicine, Kangbuk Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea

    Jihoon Kang

  3. Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, Seoul, South Korea

    Min-Ju Kim

  4. Department of Emergency Medicine, Hallym University College of Medicine, Seoul, South Korea

    Gu Hyun Kang

  5. Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea

    Tae Gun Shin

  6. Department of Emergency Medicine, Yonsei University College of Medicine, Seoul, South Korea

    Yoo Seok Park & Sung Phil Chung

  7. Department of Emergency Medicine, Guro Hospital, Korea University Medical Center, Seoul, South Korea

    Sung-Hyuk Choi

  8. Department of Emergency Medicine, Seoul National University College of Medicine, Seoul, South Korea

    Woon Yong Kwon

Authors
  1. Youn-Jung Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jihoon Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Min-Ju Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seung Mok Ryoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gu Hyun Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tae Gun Shin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yoo Seok Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Sung-Hyuk Choi
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Woon Yong Kwon
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Sung Phil Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Won Young Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

on behalf of the Korean Shock Society (KoSS) Investigators

Contributions

YJK, JK, and WYK planned the study and supervised the conduct of the study and data collection. GHK, TGS, YSP, SHC, WYK, SPC, and WYK undertook the recruitment of participating centers and patients and managed the data, including quality control. MJK provided statistical advice on the study design and analyzed the data. YJK and JK drafted the manuscript, and all authors contributed substantially to its revision. All authors read and approved the final manuscript. WYK takes responsibility for the paper as a whole.

Corresponding author

Correspondence to Won Young Kim.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the institutional review boards of each participating institute, and informed consent was obtained before data collection. The study has therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.

1) Asan Medical Center (2015-1253)

2) Gangnam Sacred Heart Hospital (2015-11-142)

3) Gangnam Severance Hospital (3-2015-0227)

4) Hanyang University Hospital (HYUH 2015-11-013-022)

5) Korea University Anam Hospital (HRPC2016-184)

6) Korea University Kuro Hospital (KUGH15358-001)

7) Samsung Medical Center (SMC2015-09-057-057)

8) Seoul National University Hospital (J-1408-003-599)

9) Seoul National University Bundang Hospital (B-1409/266-401)

10) Severance Hospital (4-2015-0929)

11) Seoul National University Boramae Hospital (IRB-16-2014-36)

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

Characteristics of the patients who fulfil the sepsis-3 criteria for septic shock in the development set and validation sets.

Additional file 2: Table S2.

The C-indices for testing of the VitaL CLASS score and other pre-existing scoring systems in the patients who fulfil the sepsis-3 criteria for septic shock.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Kim, YJ., Kang, J., Kim, MJ. et al. Development and validation of the VitaL CLASS score to predict mortality in stage IV solid cancer patients with septic shock in the emergency department: a multi-center, prospective cohort study. BMC Med 18, 390 (2020). https://doi.org/10.1186/s12916-020-01875-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-020-01875-5

Keywords

  • Septic shock
  • Sepsis
  • Neoplasms
  • Prognosis
  • Critical care

BMC Medicine

ISSN: 1741-7015

Contact us