- Research article
- Open Access
Development and validation of the VitaL CLASS score to predict mortality in stage IV solid cancer patients with septic shock in the emergency department: a multi-center, prospective cohort study
BMC Medicine volume 18, Article number: 390 (2020)
Clinical decision-making of invasive high-intensity care for critically ill stage IV cancer patients in the emergency department (ED) is challenging. A reliable and clinically available prognostic score for advanced cancer patients with septic shock presented at ED is essential to improve the quality of intensive care unit care. This study aimed to develop a new prognostic score for advanced solid cancer patients with septic shock available early in the ED and to compare the performance to the previous severity scores.
This multi-center, prospective cohort study included consecutive adult septic shock patients with stage IV solid cancer. A new scoring system for 28-day mortality was developed and validated using the data of development (January 2016 to December 2017; n = 469) and validation sets (January 2018 to June 2019; n = 428). The developed score’s performance was compared to that of the previous severity scores.
New scoring system for 28-day mortality was based on six variables (score range, 0–8): vital signs at ED presentation (respiratory rate, body temperature, and altered mentation), lung cancer type, and two laboratory values (lactate and albumin) in septic shock (VitaL CLASS). The C-statistic of the VitaL CLASS score was 0.808 in the development set and 0.736 in the validation set, that is superior to that of the Sequential Organ Failure Assessment score (0.656, p = 0.01) and similar to that of the Acute Physiology and Chronic Health Evaluation II score (0.682, p = 0.08). This score could identify 41% of patients with a low-risk group (observed 28-day mortality, 10.3%) and 7% of patients with a high-risk group (observed 28-day mortality, 73.3%).
The VitaL CLASS score could be used for both risk stratification and as part of a shared clinical decision-making strategy for stage IV solid cancer patients with septic shock admitting at ED within several hours.
Cancer is a major public health burden; both cancer incidence and mortality are expected to increase rapidly worldwide. Recent advances in cancer treatment have improved the overall survival rates; however, they have also increased the possibility of developing a critical illness requiring intensive care unit (ICU) management [1, 2]. Approximately 5% of the patients with solid cancer require ICU admission within 2 years after diagnosis [1, 2].
Sepsis and septic shock associated with cancer progression or chemo-radiation-therapy is a common life-threatening complication in cancer patients. Recent studies have demonstrated improved outcomes in cancer patients admitted to the ICU, and with appropriate patient selection, the outcomes of patients with or without cancer could be similar [3,4,5]. However, the decision of invasive ICU treatments for advanced cancer patients with septic shock is still challenging, especially in the emergency department (ED) setting. The clinical decision-making for advanced cancer patients with septic shock in the ED comprises more than 3 of health care specialties: critical care medicine, emergency medicine, oncology, and surgery. Treatment recommendations for these patients could be different depending on the specialties [6, 7]. Also, the patient-physician communication in such situations frequently leads to overutilization of invasive ICU treatments, which can produce more costly and invasive care without improving outcomes [8,9,10].
Sequential Organ Failure Assessment (SOFA) and Acute Physiology and Chronic Health Evaluation (APACHE) II scores are valid and widely used clinical prediction tools to determine the mortality risk, but they are designed to be calculated on the worst parameters recorded during the initial 24 h after admission and are not reliable at ED presentation [11, 12]. A reliable and clinically available prognostic score for advanced cancer patients with septic shock presented at ED is essential to improve the quality and efficiency of ICU care. To address this issue, we aimed to develop a new prognostic model for stage IV cancer patients who present with septic shock available at ED and compare its performance to existing scoring systems including SOFA score, APACHE II score, quick SOFA score, National Early Warning Score, and Modified Early Warning Score.
Study design and population
This multi-center, prospective observational study was conducted in the EDs of 11 Korean university-affiliated, tertiary referral centers using data from the Korean Shock Society septic shock registry, from January 2016 to December 2018. The Korean Shock Society is a Korean collaborative research network, established in 2013, for improving the quality of research, diagnosis, and management of sepsis . Since October 2015, 11 EDs in the Korean Shock Society have been prospectively collecting data pertaining to patients with septic shock . Adult patients (aged ≥ 19 years) who visited one of these EDs with suspected or confirmed infection and evidence of refractory hypotension or hypoperfusion were enrolled in the registry [14,15,16]. Refractory hypotension was defined as persistent systolic blood pressure < 90 mmHg, mean arterial pressure < 70 mmHg, or systolic blood pressure decrease > 40 mmHg after ≥ 20–30 mL/kg intravenous fluid administration or requiring vasopressors to maintain systolic blood pressure of ≥ 90 mmHg or mean arterial pressure of ≥ 70 mmHg . Hypoperfusion was defined as serum lactate level of ≥ 4 mmol/L . Exclusion criteria included patients who refused ICU management, patients who signed a “do not attempt resuscitation” order before ED arrival or at the time of diagnosis, patients who met the inclusion criteria 6 h after ED arrival, patients who were transferred from other hospitals after stabilization, patients who were directly transferred to other hospitals at ED, or patients who refused to enroll in the registry . The institutional review boards of each participating institute approved the registry, and informed consent was obtained before data collection.
This study included patients with stage IV solid cancer who were enrolled in the septic shock registry and treated with intensive care between 1 January 2016 and 30 June 2019. The final cohort for this study included 897 patients; those selected from 1 January 2016 to 31 December 2017 were included in the development set (n = 469, 52.3%) and those selected from 1 January 2018 to 30 June 2019, in the validation set (n = 428, 47.7%).
Management and data collection
All patients were treated in accordance with then-current guidelines of the Surviving Sepsis Campaign including crystalloid administration, acquisition of blood cultures before antibiotic administration, and broad-spectrum antibiotic administration and vasopressor administration [17, 19]. The decision for subsequent intensive care was based on the intensivist according to institutional protocols. Empirical broad-spectrum antibiotics, such as piperacillin/tazobactam, cefepime, and meropenem, were administrated immediately after blood cultures at the ED, and after admission, further antibiotic treatments were adjusted.
The case report form of the Korean Shock Society septic shock registry includes standard definitions of 200 variables including demographic and clinical characteristics, therapeutic interventions, and outcomes. Data of the Korean Shock Society septic shock registry are collected via a standardized case report form and entered into a web-based electronic database . The quality management committee monitors and reviews the completeness and consistency of data regularly and also gives feedback to the research coordinators and investigators of the results of the quality management process by using the web system’s query function or via a telephone call.
Data regarding age, sex, comorbid disease, focus of infection, laboratory findings, vital signs at ED presentation, and SOFA and APACHE II scores were retrieved from the registry. Mental status at ED presentation was assessed using the Alert/responsive to Voice/responsive to Pain/Unresponsive scale; unalert patients were considered to have altered mentation. Cancer type was reviewed additionally for this study using the diagnosis codes according to the International Statistical Classification of Diseases and Related Health Problems, Tenth Revision. We categorized the cases according to six common solid cancer types as follows: gastrointestinal cancer (C15-C20), hepatobiliary-pancreas cancer (C22-C25), lung cancer (C33-C34), gynecologic cancer (C53-C56), urologic cancer (C61-67), and “others/ill-defined” cancer. All blood samples for laboratory analysis including lactic acid were obtained from the patients at their initial presentation. SOFA and APACHE II scores were calculated using the worst parameters during the initial 24 h after ED admission. The quick SOFA score, National Early Warning Score, and Modified Early Warning Score were calculated using the initial vital signs at ED admission [20,21,22]. The primary endpoint of this study was 28-day mortality.
Categorical variables were presented as frequencies and percentages, and continuous variables as median with interquartile range (IQR). The χ2 test was used to compare categorical variables of development and validation sets, and the continuous variables for survivors and non-survivors of development and validation sets were compared using the t test or the Wilcoxon rank-sum test if the distribution was not normal. Lactic acid level was categorized into 3 groups (twice above the normal limit [≥ 4 mmol/L], 4 to 8 mmol/L, fourfold or more above the normal limit [≥ 8 mmol/L]) based on the previous guidelines and study [17, 23].
In the development set, univariate Cox proportional hazard analysis was performed to evaluate the prognostic ability of each variable. The variables in the scoring system were selected among all variables by using multivariable Cox proportional hazard analysis with backward elimination in 1000-fold bootstrap resampling . Then, we counted how many times each candidate variable remained in the model in the 1000 bootstrap samples. If a variable appeared > 500 times in the final model, the variable was included in the scoring system. To allocate points in the scoring system, the bootstrapping method was used again to obtain bias-corrected regression coefficients to assign risk points in the scoring system. Risk points were obtained by bias-corrected regression coefficients multiplied by a reference value in the corresponding category. Each risk point was rescaled to designate the point of lung cancer as 1 (for example, the risk point for respiratory rate ≥ 22/min was 1, which was rounded from 0.891/0.617 = 1.444). A reference risk factor profile was chosen by selecting a base category for each risk factor, which was assigned 0 points in the scoring system. The total score was the weighted sum of those predictors of which the weights were defined as the rounded integer value of the quotient of regression coefficients divided by the regression coefficient of the reference predictor. The total scores based on patient profiles were converted into a risk estimate by using a specific formulation as below .
The calibration and discrimination of the final multivariable Cox proportional hazards model were assessed by calibration curve  and the Harrell C-statistic , respectively. The calibration measure compared the predicted and observed probability after data were partitioned into several groups. The discrimination index measured the concordance probability that predicted probabilities from a randomly selected pair of survivors and non-survivors. We categorized the groups based on the likelihood of 28-day mortality: low (score of 0–2, 7.07%), average (score of 3–5, 36.03%), and high (score of 6–8, 89.47%). Finally, we compared the C-index and Akaike information criterion of our new prognostic score with those of the SOFA and APACHE II scores using R package “compareC” .
All reported p values were 2-sided, and p < 0.05 was considered significant. All statistical analyses were performed using the SAS version 9.4 (SAS Institute Inc., Cary, NC, USA) and R (version 3.6.1; R Foundation for Statistical Computing, Vienna, Austria; https://www.R-project.org).
During the study period, a total of 3486 patients with septic shock were enrolled in the Korean Shock Society septic shock registry, of which 897 (25.7%) patients with stage IV solid cancer were included. The overall 28-day mortality rate was 26.4% (237/897) and 499 (55.6%) patients admitted to ICU. The general characteristics of our study patients including those in the development (n = 469, 52.3%) and validation (n = 428, 47.7%) cohorts are presented in Table 1. The median age of our cohort was 66 years, and hepatobiliary-pancreas cancer (31.9%) and lung cancer (16.8%) were the dominant cancer types. Patients in the validation set showed significantly higher initial lactate level (median, 3.4 vs. 3.7 mmol/L, p = 0.03), SOFA (median, 7.0 vs. 8.0, p = 0.002), and APACHE II (median, 19.0 vs. 21.0, p = 0.04) scores.
The univariable Cox proportional hazards model for predicting the 28-day mortality in the development set is summarized in Table 2. The bootstrap resampling variable selection method provided six variables: respiratory rate, body temperature, altered mentation at ED presentation, lung cancer, lactic acid, and albumin. We performed a second multivariate Cox proportional hazards analysis using only those six final independent variables, and the final prediction model was developed based on the bias-corrected regression coefficients as shown in Tables 3 and 4. We named this new prognostic scoring system the VitaL CLASS score (vital signs-lung cancer-lactate-albumin in septic shock). The C-statistic for the VitaL CLASS score was 0.808 (95% confidence interval [CI], 0.772–0.845) in the development set and 0.736 (95% CI, 0.694–0.778) in the validation set (Table 5). In the development set, the C-static for the VitaL CLASS score was superior to that of the existing scoring systems such as the SOFA (0.713; 95% CI, 0.664–0.762; p = 0.001) and APACHE II (0.692; 95% CI, 0.643–0.741; p < 0.001). In the validation set, the C-statistic of the VitaL CLASS score (0.736) was superior to that of the SOFA score (0.656; p = 0.01) and similar to that of the APACHE II score (0.682; p = 0.08). The calibration curve of our new score demonstrated good correlation between the predicted and actual probability of 28-day mortality in both sets (Fig. 1). A subgroup analysis of the patients who fulfill the sepsis-3 criteria for septic shock was performed. Additional file 1: Table S1 shows there was no difference in general characteristics between development and validation subgroup cohorts. The VitaL CLASS score of the patients who fulfill the sepsis-3 criteria for septic shock demonstrated superior prognostic performance to the existing scoring systems in the development set (C-index, 0.806; 95% CI, 0.761–0.851), and similar performance to SOFA and APACHE II scores in the validation set (C-index, 0.702; 95% CI, 0.649–0.755) (Additional file 2: Table S2).
Table 6 shows the performance of the final point score and risk groups according to the VitaL CLASS score in development and validation datasets. Based on the estimate of probability for 28-day mortality, the VitaL CLASS score classified the patients into 3 groups: low (0–2), average (3–5), and high (6–8) risk groups. In the validation set, the VitaL CLASS score identified 40.9% and 7.0% of the patients as having a low risk and high risk of 28-day mortality, respectively. The patients in the low-risk group had 10.3% (18/175) of mortality, whereas 73.3% (22/30) of the patients in the high-risk group died within 28 days after admission.
We developed and validated a simple and objective prognostic model, the VitaL CLASS score, which is applicable in the ED very early. This scoring system could identify stage IV cancer patients who present to the ED with septic shock as having low, average, or high risk of death within 28 days. Using this score, it would be helpful to triage patients in the high-risk group, who have a low possibility of benefitting from intensive care, and those in the low-risk group, who have a high likelihood of survival. This risk assessment would help physicians share information with patients and family and establish goals-of-care among physicians of different specialties as well as patients in the ED regarding life-sustaining treatments including mechanical ventilation, vasoactive infusions, new renal replacement therapy, or cardiopulmonary resuscitation and physician orders for life-sustaining treatment (POLST) orders. The VitaL CLASS score shows good prognostic performance and is simple and fast to use, comparing to existing scoring systems, SOFA and APACHE II scores.
The VitaL CLASS score to predict short-term mortality among stage IV cancer patients with septic shock consists of four clinical factors identified at ED presentation: cancer type (lung cancer and the other types of cancer), respiratory rate, body temperature and altered mentation, and two laboratory values reported within hours, i.e., lactic acid and albumin. This simple and objective prognostic model for stage IV cancer patients with septic shock uses data available within hours after ED admission. The majority of patients with advanced medical illness would prefer palliative approaches to invasive ICU treatments when they were informed of their therapeutic options, and such invasive ICU treatments should be aligned with patients’ values and prognostic information [10, 29,30,31]. Furthermore, the demand for ICU care usually exceeds supply, and consequently, the triage and allocation decisions for ICU care for critically ill patients are important. Although objective decision-making guidelines would facilitate the fair use of medical resources, these guidelines are imprecise and are not sufficiently validated for advanced cancer patients [32,33,34]. Recently, a new strategy for critically ill cancer patients has been introduced considering these limitations that consist of unlimited ICU management with a full-code status for a limited period [35, 36]. However, this is difficult to achieve in several hospitals with a chronic shortage of ICU resources. We believe that the VitaL CLASS score could help physicians identify those who are more likely to benefit from invasive ICU management from those with minimal anticipated benefit, to make better allocations of medical resources, and to discuss do-not-attempt-resuscitation or POLST orders in the ED before admission.
Cancer type is an important prognostic factor for cancer patients, and the mortality rate varies by cancer type in cancer patients with severe sepsis/septic shock . Lung cancer was the second most common cancer type in our cohort (16.8%), following hepatobiliary-pancreas cancer (31.9%). In our study, lung cancer patients with septic shock had the highest 28-day mortality (48.1%) from septic shock, whereas the mortality rate of gynecologic cancer patients was the lowest (10.2%). These mortality rate differences are consistent with those reported in previous studies . In our study, lung cancer was associated with 2.0-fold higher odds when compared with the other types of cancer. Previous studies demonstrated that infection focus, such as respiratory infection, was an important prognostic feature in septic shock patients, but it was not a significant prognostic factor in our study for stage IV solid cancer patients with septic shock [38, 39].
The VitaL CLASS score includes three vital signs at ED admission: respiratory rate, body temperature, and mentation. Tachypnea, i.e., respiratory rate ≥ 22, and altered mentation are commonly used as core poor prognostic factors, consistent with many previous studies on prognostic scoring systems such as quick SOFA, National Early Warning Score, and Modified Early Warning Score [20,21,22]. Body temperature < 38.0 °C (100.4 °F) was another poor prognostic factor in our prognostic model. Generally, fever is a poor prognostic sign for septic shock patients. However, for cancer patients with septic shock who have a suppressed immune system, fever implies a protective response, namely that their innate and adaptive immune system is functioning better than in those without fever, and such a paradoxical response has been reported in previous studies [40, 41].
The other two laboratory values were lactic acid and albumin levels. Serum lactate levels of ≥ 8.0 mmol/L and from 4.0–7.9 mmol/L were assigned 2 and 1 points, respectively. Lactate level is a reliable biomarker for outcome prediction and severity assessment in numerous conditions . Septic shock according to the Third International Consensus was defined as refractory hypotension and serum lactate level of > 2 mmol/L . A lactate level of > 4 mmol/L at ED admission is associated with mortality in patients with sepsis independent of organ failure, and we used higher cut-offs of 4.0 and 8.0 mmol/L at ED admission [18, 44]. Serum albumin is a surrogate marker of visceral protein function and nutritional status , but its synthesis is also suppressed by inflammation [46, 47]. Serum albumin level reflects both the acute and chronic health status of critically ill patients [45, 48]. The cut-off level of albumin (< 2.8 g/dL) in our prediction model is consistent with that used in previous studies, which showed that hypoalbuminemia, defined as < 2.7 or < 2.9 g/dL, was an independent risk factor for mortality in patients with sepsis [48, 49].
The strength of this study was that the VitaL CLASS score consisted of variables that are usually assessed within hours of ED presentation and can be calculated in the time period before admission. However, several limitations should be considered when interpreting the findings of the present study. First, we developed and validated a new prognostic model for stage IV solid cancer patients who present with septic shock to the ED using data from a prospectively collected registry; however, there was no detailed information on cancer-related characteristics such as cancer treatment (i.e., radiotherapy, chemotherapy, and surgery), response to therapy, performance status, and time from initial cancer diagnosis, which are known as major determinant for the short-term outcome. This was a significant limitation of our study. However, recent studies demonstrated that cancer-related characteristics were not associated with short-term mortality [2, 34, 50]. Additionally, performance status is still a valid prognostic factor, but its accurate determination at the ED is challenging due to subjectivity and irreproducibility [51, 52]. Second, the lack of an external validation sample is another main limitation of our study, and further studies for validation of our prognostic model, especially studies involving other races/ethnicities, are warranted. Third, we divided the development (January 2016 to December 2017) and validation sets (January 2018 to June 2019) according to time, and thus, the characteristics of the cohorts and treatments could vary according to the study period. Also, advances in cancer treatment would affect the outcome, which might be associated with the decrease of the predictive value in the validation cohort. However, most variables including outcomes did not show a significant difference, and the study period was only 3.5 years. Additionally, the statistically different variables between development and validation cohorts were not likely to have a clinically significant impact, e.g., body temperature (median, 37.8 vs. 37.6 °C, p = 0.005) and lactate level (median, 3.4 vs. 3.7 mmol/L, p = 0.03). Fourth, the lactate level could be affected by many clinical conditions such as liver cirrhosis, advanced heart failure, and metformin use. Fifth, all physicians treated patients according to the current Surviving Sepsis guidelines; however, in-hospital treatment strategies, such as ventilator application or continuous renal replacement therapy, and end-of-life decisions that could affect the outcome, were not standardized between the participating hospitals. Lastly, this study did not include the patients who signed a “do not attempt resuscitation” order before ED arrival or at the time of diagnosis, which may lead to a selection bias and limit the generalizability.
In summary, we developed and validated a simple and objective clinical prediction model, the VitaL CLASS score, for predicting the 28-day mortality in stage IV cancer patients who present with septic shock at the ED. The VitaL CLASS score identified 40.9% of the patients as having a very low likelihood of 28-day mortality (28-day mortality in 10.3%, 18/175) with appropriate critical care and 7.0% of the patients as a high-risk group with minimal anticipated benefit of invasive ICU treatment (28-day mortality in 73.3%, 22 of 30). We believe this prognostic model could provide useful information for patients, their families, and physicians of different specialties and can be used as part of a clinical decision-making strategy regarding aggressive life-sustaining treatments or POLST orders as well as the triage decision for ICU admission.
Availability of data and materials
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
Acute Physiology and Chronic Health Evaluation
Intensive care unit
Physician orders for life-sustaining treatment
Sequential Organ Failure Assessment
Puxty K, McLoone P, Quasim T, Sloan B, Kinsella J, Morrison DS. Risk of critical illness among patients with solid cancers: a population-based observational study. JAMA Oncol. 2015;1(8):1078–85.
Soares M, Caruso P, Silva E, Teles JM, Lobo SM, Friedman G, Dal Pizzol F, Mello PV, Bozza FA, Silva UV. Characteristics and outcomes of patients with cancer requiring admission to intensive care units: a prospective multicenter study. Crit Care Med. 2010;38(1):9–15.
Larché J, Azoulay É, Fieux F, Mesnard L, Moreau D, Thiery G, Darmon M, Le Gall J-R, Schlemmer B. Improved survival of critically ill cancer patients with septic shock. Intensive Care Med. 2003;29(10):1688–95.
Pène F, Percheron S, Lemiale V, Viallon V, Claessens Y-E, Marqué S, Charpentier J, Angus DC, Cariou A, Chiche J-D. Temporal changes in management and outcome of septic shock in patients with malignancies in the intensive care unit. Crit Care Med. 2008;36(3):690–6.
Taccone FS, Artigas AA, Sprung CL, Moreno R, Sakr Y, Vincent J-L. Characteristics and outcomes of cancer patients in European ICUs. Crit Care. 2009;13(1):R15.
Schell CO, Wärnberg MG, Hvarfner A, Höög A, Baker U, Castegren M, Baker T. The global need for essential emergency and critical care. Crit Care. 2018;22(1):284.
Rivera DR, Gallicchio L, Brown J, Liu B, Kyriacou DN, Shelburne N. Trends in adult cancer–related emergency department utilization: an analysis of data from the nationwide emergency department sample. JAMA oncology. 2017;3(10):e172450.
Chang DW, Shapiro MF. Association between intensive care unit utilization during hospitalization and costs, use of invasive procedures, and mortality. JAMA Intern Med. 2016;176(10):1492–9.
Chang DW, Dacosta D, Shapiro MF. Priority levels in medical intensive care at an academic public hospital. JAMA Intern Med. 2017;177(2):280–1.
Chang D, Parrish J, Kamangar N, Liebler J, Lee M, Neville T. Time-limited trials among critically ill patients with advanced medical illnesses to reduce nonbeneficial intensive care unit treatments: protocol for a multicenter quality improvement study. JMIR Res Protoc. 2019;8(11):e16301.
Vincent J-L, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart C, Suter P, Thijs L. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Med. 1996;22(7):707–10.
Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–29.
Shin TG, Hwang SY, Kang GH, Kim WY, Ryoo SM, Kim K, Jo YH, Chung SP, Joo YS, Beom JH. Korean Shock Society septic shock registry: a preliminary report. Clin Exp Emerg Med. 2017;4(3):146.
Mouncey PR, Osborn TM, Power GS, Harrison DA, Sadique MZ, Grieve RD, Jahan R, Harvey SE, Bell D, Bion JF. Trial of early, goal-directed resuscitation for septic shock. N Engl J Med. 2015;372(14):1301–11.
Peake SL, Delaney A, Bailey M, Bellomo R, Cameron PA, Cooper DJ, Higgins AM, Holdgate A, Howe BD, Webb SA, et al. Goal-directed resuscitation for patients with early septic shock. N Engl J Med. 2014;371(16):1496–506.
Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, Terndrup T, Wang HE, Hou PC, LoVecchio F, et al. A randomized trial of protocol-based care for early septic shock. N Engl J Med. 2014;370(18):1683–93.
Dellinger RP, Levy MM, Rhodes A, Annane D, Gerlach H, Opal SM, Sevransky JE, Sprung CL, Douglas IS, Jaeschke R. Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012. Intensive Care Med. 2013;39(2):165–228.
Casserly B, Phillips GS, Schorr C, Dellinger RP, Townsend SR, Osborn TM, Reinhart K, Selvakumar N, Levy MM. Lactate measurements in sepsis-induced tissue hypoperfusion: results from the Surviving Sepsis Campaign database. Crit Care Med. 2015;43(3):567–73.
Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, Sevransky JE, Sprung CL, Nunnally ME. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock: 2016. Intensive Care Med. 2017;43(3):304–77.
Seymour CW, Liu VX, Iwashyna TJ, Brunkhorst FM, Rea TD, Scherag A, Rubenfeld G, Kahn JM, Shankar-Hari M, Singer M. Assessment of clinical criteria for sepsis: for the Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA. 2016;315(8):762–74.
Smith GB, Prytherch DR, Meredith P, Schmidt PE, Featherstone PI. The ability of the National Early Warning Score (NEWS) to discriminate patients at risk of early cardiac arrest, unanticipated intensive care unit admission, and death. Resuscitation. 2013;84(4):465–70.
Subbe C, Kruger M, Rutherford P, Gemmel L. Validation of a modified Early Warning Score in medical admissions. QJM. 2001;94(10):521–6.
Zhang Z, Chen K, Ni H, Fan H. Predictive value of lactate in unselected critically ill patients: an analysis using fractional polynomials. J Thorac Dis. 2014;6(7):995–1003.
Sauerbrei W, Schumacher M. A bootstrap resampling procedure for model building: application to the Cox regression model. Stat Med. 1992;11(16):2093–109.
Sullivan LM, Massaro JM, D'Agostino RB Sr. Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med. 2004;23(10):1631–60.
Crowson CS, Atkinson EJ, Therneau TM. Assessing calibration of prognostic risk scores. Stat Methods Med Res. 2016;25(4):1692–706.
Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.
Kang L, Chen W, Petrick NA, Gallas BD. Comparing two correlated C indices with right-censored survival outcome: a one-shot nonparametric approach. Stat Med. 2015;34(4):685–703.
Curtis JR, Engelberg RA, Bensink ME, Ramsey SD. End-of-life care in the intensive care unit: can we simultaneously increase quality and reduce costs? Am J Respir Crit Care Med. 2012;186(7):587–92.
Angus DC, Barnato AE, Linde-Zwirble WT, Weissfeld LA, Watson RS, Rickert T, Rubenfeld GD. Use of intensive care at the end of life in the United States: an epidemiologic study. Crit Care Med. 2004;32(3):638–43.
Barnato AE, Anthony DL, Skinner J, Gallagher PM, Fisher ES. Racial and ethnic differences in preferences for end-of-life treatment. J Gen Intern Med. 2009;24(6):695–701.
Thiéry G, Azoulay É, Darmon M, Ciroldi M, De Miranda S, Lévy V, Fieux F, Moreau D, Le Gall JR, Schlemmer B. Outcome of cancer patients considered for intensive care unit admission: a hospital-wide prospective study. J Clin Oncol. 2005;23(19):4406–13.
Honiden S, Possick J. Should physicians new to a case counsel patients and their families to change course at the end of life? AMA J Ethics. 2018;20(8):699–707.
Azoulay E, Schellongowski P, Darmon M, Bauer PR, Benoit D, Depuydt P, Divatia JV, Lemiale V, van Vliet M, Meert A-P. The Intensive Care Medicine research agenda on critically ill oncology and hematology patients. Intensive Care Med. 2017;43(9):1366–82.
Shrime MG, Ferket BS, Scott DJ, Lee J, Barragan-Bradford D, Pollard T, Arabi YM, Al-Dorzi HM, Baron RM, Hunink MM. Time-limited trials of intensive care for critically ill patients with cancer: how long is long enough? JAMA Oncol. 2016;2(1):76–83.
Lecuyer L, Chevret S, Guidet B, Aegerter P, Martel P, Schlemmer B, Azoulay E. Case-volume and mortality in hematological patients with acute respiratory failure. Eur Respir J. 2008;32(3):784–54.
Williams MD, Braun LA, Cooper LM, Johnston J, Weiss RV, Qualy RL, Linde-Zwirble W. Hospitalized cancer patients with severe sepsis: analysis of incidence, mortality, and associated costs of care. Crit Care. 2004;8(5):R291.
Angus DC, Van der Poll T. Severe sepsis and septic shock. N Engl J Med. 2013;369(9):840–51.
Mayr FB, Yende S, Angus DC. Epidemiology of severe sepsis. Virulence. 2014;5(1):4–11.
Evans SS, Repasky EA, Fisher DT. Fever and the thermal regulation of immunity: the immune system feels the heat. Nat Rev Immunol. 2015;15(6):335–49.
Kim Y-J, Kang J, Ryoo SM, Ahn S, Huh JW, Kim WY. Platelet–lymphocyte ratio after granulocyte colony stimulating factor administration: an early prognostic marker in septic shock patients with chemotherapy-induced febrile neutropenia. Shock. 2019;52(2):160–5.
Kraut JA, Madias NE. Lactic acidosis. N Engl J Med. 2014;371(24):2309–19.
Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, Bernard GR, Chiche J-D, Coopersmith CM. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA. 2016;315(8):801–10.
Mikkelsen ME, Miltiades AN, Gaieski DF, Goyal M, Fuchs BD, Shah CV, Bellamy SL, Christie JD. Serum lactate is associated with mortality in severe sepsis independent of organ failure and shock. Crit Care Med. 2009;37(5):1670–7.
Gupta D, Lis CG. Pretreatment serum albumin as a predictor of cancer survival: a systematic review of the epidemiological literature. Nutr J. 2010;9(1):69.
Ballmer PE, Ochsenbein AF, Schütz-Hofmann S. Transcapillary escape rate of albumin positively correlates with plasma albumin concentration in acute but not in chronic inflammatory disease. Metab Clin Exp. 1994;43(6):697–705.
Yeun JY, Kaysen GA. Factors influencing serum albumin in dialysis patients. Am J Kidney Dis. 1998;32(6):S118–25.
Tabak YP, Johannes RS. Prevalence and mortality impact of hypoalbuminemia among sepsis patients: analysis of 65,470 admissions between 2000–2003.: 104-M. Crit Care Med. 2005;33(12):A80.
Sivayoham N, Rhodes A, Cecconi M. The MISSED score, a new scoring system to predict Mortality In Severe Sepsis in the Emergency Department: a derivation and validation study. Eur J Emerg Med. 2014;21(1):30–6.
Azoulay E, Pène F, Darmon M, Lengliné E, Benoit D, Soares M, Vincent F, Bruneel F, Perez P, Lemiale V. Managing critically ill hematology patients: time to think differently. Blood Rev. 2015;29(6):359–67.
Laird BJ, Kaasa S, McMillan DC, Fallon M, Hjermstad M, Fayers P, Klepstad P. Prognostic factors in patients with advanced cancer: a comparison of clinicopathological factors and the development of an inflammation-based prognostic system. Clin Cancer Res. 2013;19(19):5456–64.
Zimmermann C, Burman D, Bandukwala S, Seccareccia D, Kaya E, Bryson J, Rodin G, Lo C. Nurse and physician inter-rater agreement of three performance status measures in palliative care outpatients. Support Care Cancer. 2010;18(5):609–16.
We wish to express our sincere gratitude to the members of the Korean Shock Society for their dedication to this septic shock registry.
This research received no external funding.
Ethics approval and consent to participate
This study was approved by the institutional review boards of each participating institute, and informed consent was obtained before data collection. The study has therefore been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.
1) Asan Medical Center (2015-1253)
2) Gangnam Sacred Heart Hospital (2015-11-142)
3) Gangnam Severance Hospital (3-2015-0227)
4) Hanyang University Hospital (HYUH 2015-11-013-022)
5) Korea University Anam Hospital (HRPC2016-184)
6) Korea University Kuro Hospital (KUGH15358-001)
7) Samsung Medical Center (SMC2015-09-057-057)
8) Seoul National University Hospital (J-1408-003-599)
9) Seoul National University Bundang Hospital (B-1409/266-401)
10) Severance Hospital (4-2015-0929)
11) Seoul National University Boramae Hospital (IRB-16-2014-36)
Consent for publication
The authors declare that they have no competing interests.
Characteristics of the patients who fulfil the sepsis-3 criteria for septic shock in the development set and validation sets.
The C-indices for testing of the VitaL CLASS score and other pre-existing scoring systems in the patients who fulfil the sepsis-3 criteria for septic shock.
About this article
Cite this article
Kim, YJ., Kang, J., Kim, MJ. et al. Development and validation of the VitaL CLASS score to predict mortality in stage IV solid cancer patients with septic shock in the emergency department: a multi-center, prospective cohort study. BMC Med 18, 390 (2020). https://doi.org/10.1186/s12916-020-01875-5
- Septic shock
- Critical care