Skip to main content

Development and validation of the MMCD score to predict kidney replacement therapy in COVID-19 patients

Abstract

Background

Acute kidney injury (AKI) is frequently associated with COVID-19, and the need for kidney replacement therapy (KRT) is considered an indicator of disease severity. This study aimed to develop a prognostic score for predicting the need for KRT in hospitalised COVID-19 patients, and to assess the incidence of AKI and KRT requirement.

Methods

This study is part of a multicentre cohort, the Brazilian COVID-19 Registry. A total of 5212 adult COVID-19 patients were included between March/2020 and September/2020. Variable selection was performed using generalised additive models (GAM), and least absolute shrinkage and selection operator (LASSO) regression was used for score derivation. Accuracy was assessed using the area under the receiver operating characteristic curve (AUC-ROC).

Results

The median age of the model-derivation cohort was 59 (IQR 47–70) years, 54.5% were men, 34.3% required ICU admission, 20.9% evolved with AKI, 9.3% required KRT, and 15.1% died during hospitalisation. The temporal validation cohort had similar age, sex, ICU admission, AKI, required KRT distribution and in-hospital mortality. The geographic validation cohort had similar age and sex; however, this cohort had higher rates of ICU admission, AKI, need for KRT and in-hospital mortality. Four predictors of the need for KRT were identified using GAM: need for mechanical ventilation, male sex, higher creatinine at hospital presentation and diabetes. The MMCD score had excellent discrimination in derivation (AUROC 0.929, 95% CI 0.918–0.939) and validation (temporal AUROC 0.927, 95% CI 0.911–0.941; geographic AUROC 0.819, 95% CI 0.792–0.845) cohorts and good overall performance (Brier score: 0.057, 0.056 and 0.122, respectively). The score is implemented in a freely available online risk calculator (https://www.mmcdscore.com/).

Conclusions

The use of the MMCD score to predict the need for KRT may assist healthcare workers in identifying hospitalised COVID-19 patients who may require more intensive monitoring, and can be useful for resource allocation.

Peer Review reports

Background

Coronavirus disease 19 (COVID-19) is mild in most cases, but it can be severe and critical, with multiple organ dysfunction, septic shock and death [1]. Kidney disease among patients with COVID-19 can manifest as acute kidney injury (AKI), hematuria or proteinuria, and it has been associated with an increased risk of mortality [2].

The incidence of AKI among hospitalised patients with COVID-19 has shown to be variable, depending upon the severity of the disease and whether they are outpatient, in the ward or intensive care unit (ICU) environment. A recent systematic review, which included 30 studies and 18,043 patients with COVID-19, observed an overall incidence of AKI of 9.2% (95% confidence interval [CI] 4.6–13.9%), and 32.6% (95% CI 8.5–56.6%) in the ICU [3]. Another systematic review from the beginning of the pandemic included 79 studies and 49,692 patients, and observed a significant variation in the incidence of AKI and kidney replacement therapy (KRT) and the risk of death in patients who develop AKI depending on the continent. The incidence of AKI, KRT requirement and death in patients with AKI was 4.3, 1.4 and 33.3% in Asia, 11.6, 5.7 and 29.4% in Europe and 22.6, 4.0 and 7.4% in North America, respectively [4]. There is a lack of studies from large cohorts in Latin America, which was severely hit by the pandemic.

Previous studies have explored the factors associated with AKI development in COVID-19 patients, including advanced age; black race; underlying medical conditions such as diabetes mellitus, cardiovascular disease, chronic kidney disease and hypertension; COVID-19 severity; use of vasopressor medications and mechanical ventilation requirement [4, 5]. However, most studies are limited to univariate analysis or have small sample sizes and there is a lack of studies analysing independent risk factors for KRT requirement.

A risk score to predict KRT requirement during hospitalisation, using clinical and laboratory data upon hospital presentation may be very useful aiming at a better allocation of health resources. However, there is a lack of evidence in this context. Fang et al. used a score created before the pandemic (UCSD-Mayo risk score) and analysed its efficiency in predicting hospital-acquired AKI in patients with COVID-19, but the performance of the score in patients in ICUs or under mechanical ventilation was not satisfactory [6].

Therefore, we aimed to assess the incidence of AKI and KRT requirement in COVID-19 in-hospital patients, as well as to develop and validate a score to predict the risk of the need for KRT.

Methods

Source of data and participants

This cohort study is a substudy of the Brazilian COVID-19 Registry, which included consecutive patients ≥18 years old, hospitalised with COVID-19 confirmed by laboratory test according to WHO criteria, admitted from March to September 2020 in 37 Brazilian hospitals, located in 17 cities, from five Brazilian states. Additionally, patients from the COVID-19 and Frailty (CO-FRAIL) Study were included as the external (geographic) validation cohort [7]. This cohort includes patients > 50 years old, admitted to Sao Paulo University Hospital from March 30 to July 7, 2020.

For the present analysis, patients with chronic kidney disease stage 5 in dialysis previous to COVID-19, pregnant women, undergoing palliative care, admitted with another diagnosis and developed COVID-19 after admission and/or those who were transferred to other hospitals (not part of the multicenter study) during hospitalisation were not included. Two hospitals that did not comply with the study protocol were excluded (Fig. 1).

Fig. 1
figure 1

Flowchart of COVID-19 patients included in the study

Model development, validation and reporting followed guidance from the Transparent Reporting of a Multivariable Prediction Model for Individual Prediction or Diagnosis (TRIPOD) checklist (Additional file 1: Table S1) and Prediction model Risk Of Bias Assessment Tool (PROBAST) [8, 9].

Data collection

Data were extracted from the medical records in participant hospitals, including patient demographic information, comorbidities, laboratory results, treatments (including KRT) and outcomes, as it was previously published in the study protocol [10]. Data were collected by using a prespecified case report form applying Research Electronic Data Capture (REDCap) tools. Variables used in the risk score were obtained at hospital presentation, with the exception of the need for invasive mechanical ventilation, which may have occurred at any time during the hospital stay, except in those patients in which it was initiated after KRT requirement. Indications for invasive mechanical ventilation were defined according to the recommendations of the Brazilian Guidelines [11].

Clinical outcome

The primary endpoint was KRT requirement. Secondary endpoints were the incidence of AKI and mortality in patients who required KRT.

AKI was defined by an increase in serum creatinine level ≥ 0.3 mg/dl within 48 h or by 50% within 7 days [12]. Indications for acute KRT included clinical manifestations of uremia (such as pericarditis, encephalopathy or an otherwise unexplained decline in mental status); refractory laboratorial abnormalities composed of azotemia (blood urea nitrogen [BUN] >100 mg/dL), a serum potassium level of 6.0 mmol or more per litre, a pH of 7.20 or less and a serum bicarbonate level of 12 mmol per litre or less; or evidence of severe respiratory failure based on a ratio of the partial pressure of arterial oxygen to the fraction of inspired oxygen of 150 or less and clinical perception of volume overload [13]. The indication for the need of KRT was defined by the nephrologist of each participating hospital, as well as the prescription of dialysis treatment.

Statistical analysis

In the descriptive analyses, categorical variables were described as absolute and relative frequency, and continuous variables by median and quartiles.

The dataset was split into development and validation, according to the date of hospital admission, using July 21, 2020, as the temporal cut (temporal validation).

All analyses were performed using R software version 4.0.2, with the mgcv, finalfit, mice, glmnet, pROC, rms, rmda and psfmi packages. A p-value<0.05 was considered statistically significant for all analyses and 95% confidence intervals were reported.

Missing data

Predictors were imputed if they had up to two thirds of complete values. Variables with a higher proportion of missing values than that were not included in the analysis. After analysing missing data patterns, multiple imputation with chained equations (MICE) was used to handle missing values on candidate variables, considering missing at random. Outcomes were not imputed. Predictive mean matching (PMM) method was used for imputation of continuous predictors and polytomous regression for categorical variables. The results of ten imputed datasets, each with ten iterations, were then combined, following Rubin’s rules [14].

Development of the risk score model

Predictor selection was based on clinical reasoning and literature review before modelling, as recommended [8]. The development cohort included patients admitted before July 21, 2020.

Variable selection was performed using generalised additive models (GAM), evaluating the relationships between KRT requirement and continuous (through penalised thin plate splines) and categorical (as linear components) predictors and calculating D1- (multivariate Wald test) and D2-statistic (pools test statistics from the repeated analyses).

As our aim was to develop a score for easy application at bedside, continuous variables were categorised on cut-off points, based on evidence from an established score for sepsis [9, 15].

Subsequently, least absolute shrinkage and selection operator (LASSO) logistic regression was used to derive the score by scaling the (L1 penalised) shrunk coefficients (Additional file 2: Table S2). Ten-fold cross-validation methods based on mean squared error criterion were used to choose the penalty parameter λ in LASSO.

Lastly, risk groups were proposed based on predicted probabilities: non-high (up to 14.9%), high (15.0–49.9%) and very high risk (≥50.0%).

The specific risks can be easily assessed using the developed MMCD risk score web-based calculator (https://www.mmcdscore.com), which is freely available to the public, and it can also be assessed through infographics (Additional file 3: Figure S1).

Model validation

External validation comprehended temporal and geographic validation. Patients who were admitted in participant hospitals from July 22, 2020, to September 2020 were included as the temporal validation cohort.

Independent external (geographic) validation was also performed. The analysis included a cohort of patients from São Paulo University Hospital, admitted from March 30 to July 7, 2020 [7]. Inclusion and exclusion criteria were the same as aforementioned.

Performance measures

To assess model calibration, predicted dialysis probabilities were plotted against the observed values. To assess model discrimination, the area under the receiver operating characteristic curve (AUROC) was calculated, with the respective confidence interval (95% CI), obtained through 2000 bootstrap samples. Positive and negative predictive values of the derived risk groups were also calculated. The Brier score was used to assess the overall performance [16].

Results

Participants

The derivation cohort included 3680 COVID-19 patients admitted to the 35 participating hospitals, from March 1, 2020, to July 21, 2020. Those patients were from 159 cities in Brazil (Fig. 2). The median age was 59 (IQR 47–70) years, 54.5% were men, 20.9% evolved with AKI, 9.3% required KRT, and 15.1% died during hospitalisation. Patient demographics, underlying medical conditions, clinical characteristics and laboratory values upon hospital presentation for the derivation and validation cohorts are displayed in Table 1.

Fig. 2
figure 2

City of residence of patients from a development and b temporal validation cohorts

Table 1 Demographic and clinical characteristics for derivation and validation cohorts of patients admitted to participant hospitals with COVID-19 (n=6490)

Among the patients in the derivation cohort, 1261 (34.3%) required ICU admission. Of those,16.7% developed AKI and 9.1% required KRT, with a mortality rate of 64.7% and 76.7%, respectively.

Model development

Sixty-three potential risk predictor variables collected at hospital presentation were identified (Additional file 4: Table S3) [17,18,19,20,21,22,23,24,25,26]. Of those, 20 were excluded for high collinearity and 11 for high number of missings variables. Consequently, 32 variables were tested.

Four important predictors of the need for KRT during hospitalization were identified using GAM: need for mechanical ventilation, male sex, higher creatinine at hospital presentation and diabetes. Continuous selected predictors were categorised for LASSO logistic regression due to the need for a bedside use score (Table 2). Serum creatinine levels were categorised according to the Sequential Organ Failure Assessment Score (SOFA) [15]. The sum of the prediction scores ranges between 0 and 23, with a high score indicating higher risk of dialysis. Three risk groups were defined based on predicted probabilities of KRT requirement: non-high risk (0–10 score, observed KRT rate 0.4%), high risk (11–14 score, 32.8%) and very high risk (15–23 score, 68.0%), as shown in Table 3. Mortality in each risk strata is also shown in Table 3.

Table 2 MMCD score for in-hospital KRT requirement in COVID-19 patients
Table 3 Predicted probability of dialysis; and dialysis and mortality rates for MMCD score risk groups

Model performance

Discrimination and model overall performance in derivation and validation cohorts for GAM, LASSO and MMCD score are shown in Table 4. Within the derivation cohort, the MMCD risk score showed excellent discrimination (AUROC= 0.929; 95% CI 0.918–0.939) and good overall performance (Brier score: 0.057) (Fig. 3).

Table 4 Discrimination and model overall performance in derivation and validation cohorts
Fig. 3
figure 3

ROC curve from derivation cohort

Model validation

A total of 1532 patients admitted between July 22, 2020, and September 31, 2020 were included in the temporal validation cohort. The median age was 62 (IQR 48–72) years; 56.7% were male, 19.8% evolved with AKI, 8.4% required KRT and 14.9% died during hospitalisation. From the total sample, 515 (33.6%) required ICU admission. Of those, 14.6% developed AKI and 8.1% required KRT, with a mortality rate of 65.5% and 82.3%, respectively.

The geographic validation cohort included 1378 patients admitted to São Paulo University Hospital, between March 30 and July 7, 2020. The median age was 64 (IQR 58–72) years; 58.9% were male, 20.2% required KRT, and 33.5% died during hospitalisation (Table 1).

The MMCD Score had a good calibration and performance under temporal and geographic validation cohorts (temporal validation: AUROC 0.927, 95% CI 0.911–0.941, slope = 0.849, Brier score = 0.056 intercept= −0.186; geographic validation: AUROC 0.819, 95% CI 0.792–0.845, slope = 0.560, Brier score = 0.122, intercept = −0.367) (Fig. 4, Additional file 5: Figures S2-S5).

Fig. 4
figure 4

ROC curves from and temporal and geographic validation cohorts

Discussion

This study included more than 5000 patients hospitalised from a robust cohort of COVID-19 patients from 35 Brazilian hospitals, with external validation in an independent cohort with over 1000 patients. One in every five patients evolved with AKI and 9.3% required KRT. Among the analysed predictors, four variables were related to progression to AKI and KRT requirement, including the need for mechanical ventilation, sex, creatinine upon hospital presentation and diabetes mellitus. The MMCD score had excellent discrimination in derivation and temporal validation cohorts, with AUROC higher than 0.9, a good overall performance.

Renal involvement in COVID-19 infection is complex and probably occurs due to several factors, including direct injury to the renal endothelium, tubular epithelium and podocytes [27]; cytokine storm, with the release of several interleukins and cytokines [3]; cardiorenal syndrome, caused by right ventricular dysfunction secondary to pulmonary infection; hypercoagulable statea; and release of nephrotoxic substances such as creatine phosphokinase secondary to rhabdomyolysis [2].

The need for mechanical ventilation at any time during hospitalisation was an important predictor of progression to AKI and the need for KRT, being the variable with the highest points in the risk score. Scoring mechanical ventilation by itself changed patients’ category to “high risk” for evolving to AKI and KRT requirement. This finding confirms findings from studies carried out in other countries to assess the risk of progression of AKI to KRT in COVID-19 patients, such as USA (OR 10.7 [95% CI 6.81–16.70]) [5] and UK (HR 4.1 [95% CI 1.61–10.49]) [24]. There is a close relationship between alveolar and tubular damage (lung-kidney axis) in acute respiratory distress syndrome (ARDS), often progressing to different degrees of AKI [28]. This is a complex and not fully understood mechanism, probably multifactorial, in which inflammatory mediators are released by ventilated lungs into the systemic circulation [29]. The relationship between mechanical ventilation (MV) and AKI has been widely recognised before the COVID-19 pandemic. Husain-Syed et al. had demonstrated the occurrence of physiological changes triggered by increased intrathoracic pressure secondary to invasive mechanical ventilation that are harmful to the renal function. These changes can cause reduced renal blood flow, glomerular filtration rate and sodium excretion, with a consequent predisposition to progression to AKI and need for KRT [29]. It is difficult to define the specific role that each mechanism plays in the pathogenesis. They are usually observed simultaneously in critically ill patients, which limits the possibility to develop preventive strategies [30].

In studies published by Chan L et al. (n=3993) and Fisher M et al. (n=3345) with hospitalised patients with COVID-19 in the USA, male sex was considered an independent predictor of progression to AKI and KRT requirement [31, 32], what is in line with our findings. Male sex has been previously observed to be associated with other adverse outcomes in COVID-19 patients.

Creatinine levels upon hospital presentation may be evidence of previous chronic kidney disease or an early manifestation of AKI caused by COVID-19 infection. Chronic kidney disease is a global health problem and a silent disease [33]. Several risk classifications included serum creatinine levels in mortality scores in patients admitted to an intensive care unit (APACHE II, SAPS 3, Sequential Organ Failure Assessment Score [SOFA]), demonstrating the importance of creatinine levels as a marker of severity [15, 34, 35]. In the present analysis, creatinine levels were categorised according to the SOFA score [15] to comply with TRIPOD guidelines, which advises not to use a data-driven method, to avoid model overfitting [9]. Our finding is consistent with a recent systematic review and meta-analysis with 22 studies (n=17,391), which observed an increased incidence of AKI in COVID-19 patients hospitalised in the USA who had abnormal baseline serum creatinine levels due to pre-existing chronic kidney disease [36]. Hansrivijit P et al. in their meta-analysis described abnormal basal serum creatinine levels as predictors of progression to AKI [37]. A meta-analysis with 10,335 patients showed that severe cases of COVID-19 had higher serum levels of creatinine and BUN. In severe cases, the risk of progression to need for KRT was 12.99-fold higher compared to non-severe cases, and among patients who died, there was a higher prevalence of AKI, high levels of creatinine and need for KRT [38].

The association between diabetes mellitus and renal dysfunction is well known, in the form of diabetic nephropathy and non inflammatory glomerular damage [39, 40]. In the present analysis, diabetes proved to be a predictor of risk of progression to AKI and KRT requirement in patients hospitalised with COVID-19, which was in line with a recent meta-analysis (26 studies, n=5497) [37].

In Brazil, a country severely hit by the pandemic, there is lack of evidence on the association among AKI, need for KRT, mortality and COVID-19. The scarce existing studies are based in small databases. A study published with 200 ICU patients showed a high incidence of AKI (about 50%) and 17% of patients requiring KRT, with significantly higher mortality in patients with AKI and needing KRT, in contrast to patients without AKI and KRT requirement [23]. In our study, the incidence of AKI and need for KRT in ICU patients were lower (about 16 and 9%, respectively), although with higher in-hospital death in this group, similarly to finds in this article. As shown in Table 3, there was a progressive increase in the mortality rate associated with the increase in the score. Patients classified as non-high risk had a mortality of 1.6% in the derivation cohort and 1.9% in the validation cohort, while patients classified as very high risk had a mortality of 80.0% in the derivation cohort and 76.7% in the temporal validation cohort.

The MMCD model retrieved an AUROC of 0.96, which was classified as an excellent discrimination. An American study (n=2256) developed prediction models for mechanical ventilation, KRT and readmission in COVID-19 patients using machine learning techniques. Logistic L1 had the best accuracy, although the discrimination results were inferior than the one observed in the present analysis (0.847 [95% CI, 0.772-0.936]). Additionally, the model uses too many risk predictor variables, hindering its applicability in clinical practice [25].

External validation was performed with a cohort of patients referred to a tertiary hospital, most of which were critically ill, with a high rate of ICU admission, use of mechanical ventilation and need for KRT and mortality. As the accuracy of a prediction model is always high, whether the model is validated on the development cohort used to derive the model only, the assessment of accuracy in those studies may be overoptimistic [9].

The criteria for orotracheal intubation evolved over time. Still, we believe it has not affected our findings. The first wave of COVID-19 pandemic in Brazil was in June 2020, late in relation to Europe, which was affected in March 2020. Therefore, when the country faced its first wave, the knowledge about intubation criteria and outcomes had already evolved. The fact that the score’s high accuracy was not reduced in the temporal validation cohort (cut-off on July 21, 2020) is evidence of no significant influence on the results obtained in the temporal validation sample (AUROC 0.927 CI 95% 0.911–0.941).

Strengths and limitations

Our study used a large patients database to develop a risk score to predict the need for KRT in patients admitted with COVID-19. A major strength of the MMCD score is its simplicity; the use of objective parameters, which may reduce the variability; and easy availability, even in under-resourced settings. Then, the MMCD score may help clinicians to make a prompt and reasonable decision to optimise the management of COVID-19 patients with AKI and potentially reduce mortality. Additionally, its development and validation strictly followed the TRIPOD recommendations [9].

This study has limitations. Indication and timing of initiation of the KRT may differ according to institutional protocols; however, there is a consensus on the criteria on which KRT should be initiated [13]. We did not collect information on patients who did not perform dialysis due to limited resources. Still, this has not affected the accuracy of the score. Additionally, as any other score, MMCD may not be directly generalised to populations from other countries without further validation.

With regard to AKI assessment, it was not possible to use the criterion based on diuresis due to unavailability of this data, as well as the baseline creatinine value to identify AKI due to the lack of data on previous serum creatinine of patients admitted to participating hospitals. Instead, we used the increase of >0.3 mg/dl in creatinine values over 48 h or 1.5-fold increase within 7 days during the hospitalisation, when compared to creatinine at hospital presentation. Therefore, the real incidence of AKI may be underestimated.

Finally, external validation of the MMCD score in other countries should be performed with more recent data on COVID-19 infection, considering the multiple temporal aspects of the pandemic and changes in disease management.

Possible applications

Using predictors available at baseline and within the first hours of the admission, we could objectively predict the probability of KRT of a COVID-19 patient with AKI. With an accurate prediction, it may help to organise resource allocation to patients who are at the highest risk of KRT requirement [25], in addition to selecting patients who may benefit from renal protection strategies, close assessment and follow-up by a nephrologist [41].

Conclusions

In conclusion, we developed and validated a clinical prediction score named MMCD, to predict the need for KRT in COVID-19 patients. This score used a few predictors available at baseline and mechanical ventilation anytime during hospital admission, and retrieved a good accuracy. This could be an inexpensive tool to predict the need for KRT objectively and accurately. Additionally, it may be used to inform clinical decisions and the assignment to the appropriate level of care and treatment for COVID-19 patients with AKI.

Availability of data and materials

Any additional data pertaining to this manuscript are available from the corresponding author upon reasonable request.

Abbreviations

AKI:

Acute kidney injury

ARDS:

Acute respiratory distress syndrome

AUROC:

Area under the receiver operating characteristic

BMI:

Body mass index

BPM1:

Beats per minute

BPM2:

Breaths per minute

BUN:

Blood urea nitrogen

CI:

Confidence interval

COPD:

Chronic obstructive pulmonary disease

COVID-19:

Coronavirus disease 19

GAM:

Generalised additive models

GBT:

Gradient boosted trees

ICU:

Intensive care unit

IL-6:

Interleukin-6

IQR:

Interquartile range

KDIGO:

Kidney Disease: Improving Global Outcomes

KRT:

Kidney replacement therapy

LASSO:

Lleast absolute shrinkage and selection operator

MICE:

Multiple imputation with chained equations

MMCD:

Mechanical ventilation, male, creatinine, diabetes

MV:

Mechanical ventilation

pCO2 :

Partial pressure of carbon dioxide

PEEP:

Positive end-expiratory pressure

PMM:

Predictive mean matching

PO2 :

Partial pressure of oxygen

PROBAST:

Prediction model Risk Of Bias Assessment Tool

REDCap:

Research Electronic Data Capture

SBP:

Systolic blood pressure

SF ratio:

SpO2/FiO2 ratio

SOFA:

Sepsis-related Organ Failure Assessment

TRIPOD:

Transparent Reporting of a Multivariable Prediction Model for Individual Prediction or Diagnosis

USA:

United States of America

References

  1. Wu Z, McGoogan JM. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China. JAMA. 2020;323(13):1239–42.

    CAS  Article  Google Scholar 

  2. Ronco C, Reis T, Husain-Syed F. Management of acute kidney injury in patients with COVID-19. Lancet Respir Med. 2020;8(7):738–42.

    CAS  Article  Google Scholar 

  3. Passoni R, Lordani TVA, Peres LAB, Carvalho AR da S. Occurrence of acute kidney injury in adult patients hospitalized with COVID-19: a systematic review and meta-analysis. Nefrología. 2022;42(4):404–14.

  4. Lin L, Wang X, Ren J, Sun Y, Yu R, Li K, et al. Risk factors and prognosis for COVID-19-induced acute kidney injury: a meta-analysis. BMJ Open. 2020;10(11):e042573.

    Article  Google Scholar 

  5. Hirsch JS, Ng JH, Ross DW, Sharma P, Shah HH, Barnett RL, et al. Acute kidney injury in patients hospitalized with COVID-19. Kidney Int. 2020;98(1):209–18.

    CAS  Article  Google Scholar 

  6. Fang Z, Gao C, Cai Y, Lu L, Yu H, Hussain HMJ, et al. A validation study of UCSD-Mayo risk score in predicting hospital-acquired acute kidney injury in COVID-19 patients. Ren Fail. 2021;43(1):1115–23.

    CAS  Article  Google Scholar 

  7. Aliberti MJR, Szlejf C, Avelino-Silva VI, Suemoto CK, Apolinario D, Dias MB, et al. COVID-19 is not over and age is not enough: using frailty for prognostication in hospitalized patients. J Am Geriatr Soc. 2021;69(5):1116–27.

    Article  Google Scholar 

  8. Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. 2019;170(1):51.

    Article  Google Scholar 

  9. Collins GS, Reitsma JB, Altman DG, Moons K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13(1):1.

    Article  Google Scholar 

  10. Marcolino MS, Ziegelmann PK, Souza-Silva MVR, Nascimento IJB, Oliveira LM, Monteiro LS, et al. Clinical characteristics and outcomes of patients hospitalized with COVID-19 in Brazil: results from the Brazilian COVID-19 registry. Int J Infect Dis. 2021;107:300–10.

    CAS  Article  Google Scholar 

  11. Ministério da Saúde. Diretrizes Para diagnóstico e tratamento da covid-19; 2020. p. 1–73.

    Google Scholar 

  12. Kellum JA, Lameire N. Diagnosis, evaluation, and management of acute kidney injury: a KDIGO summary (part 1). Crit Care. 2013;17(1):204.

    Article  Google Scholar 

  13. Bagshaw SM, Wald R, Adhikari NK, Bellomo R, Da Costa B, Dreyfuss D, et al. Timing of initiation of renal-replacement therapy in acute kidney injury. N Engl J Med. 2020;383(3):240–51.

    CAS  Article  Google Scholar 

  14. Rubin DB. Multiple imputation for nonresponse in surveys: Wiley; 2004. p. 0–258.

    Google Scholar 

  15. Vincent JL, de Mendonca A, Cantraine F, Moreno R, Takala J, Suter PM, et al. Use of the SOFA score to assess the incidence of organ dysfunction/failure in intensive care units. Crit Care Med. 1998;26(11):1793–800.

    CAS  Article  Google Scholar 

  16. Rufibach K. Use of brier score to assess binary predictions. J Clin Epidemiol. 2010;63(8):938–9.

    Article  Google Scholar 

  17. See YP, Young BE, Ang LW, Ooi XY, Chan CP, et al. Risk factors for development of acute kidney injury in COVID-19 patients: a retrospective observational cohort study. Nephron. 2021;145(3):256–64.

    CAS  Article  Google Scholar 

  18. Diebold M, Schaub S, Landmann E, Steiger J, Dickenmann M. Acute kidney injury in patients with COVID-19: a retrospective cohort study from Switzerland. Swiss Med Wkly. 2021;151:w20482.

    PubMed  Google Scholar 

  19. Vaid A, Chan L, Chaudhary K, Jaladanki SK, Paranjpe I, et al. Predictive approaches for acute dialysis requirement and death in COVID-19. Clin J Am Soc Nephrol. 2021;16(8):1158–68.

    CAS  Article  Google Scholar 

  20. Flechet M, Güiza F, Schetz M, Wouters P, Vanhorebeek I, et al. AKIpredictor, an online prognostic calculator for acute kidney injury in adult critically ill patients: development, validation and comparison to serum neutrophil gelatinase-associated lipocalin. Intensive Care Med. 2021;43(6):764–73.

    Article  Google Scholar 

  21. Obi Y, Nguyen DV, Zhou H, Soohoo M, Zhang L, et al. Development and validation of prediction scores for early mortality at transition to dialysis. Mayo Clin Proc. 2018;9(93):1224–35.

    Article  Google Scholar 

  22. Wang F, Ran L, Qian C, Hua J, Luo Z, et al. Epidemiology and outcomes of acute kidney injury in COVID-19 patients with acute respiratory distress syndrome: a multicenter retrospective study. Blood Purif. 2021;50(4-5):499–505.

    CAS  Article  Google Scholar 

  23. Doher MP, Torres de Carvalho FR, Scherer PF, et al. Acute kidney injury and renal replacement therapy in critically ill COVID-19 patients: risk factors and outcomes - a single-center experience in Brazil. Blood Purif. 2021;50(4-5):520–30.

    CAS  Article  Google Scholar 

  24. Lumlertgul N, Pirondini L, Cooney E, Kok W, Gregson J, Camporota L, et al. Acute kidney injury prevalence, progression and long-term outcomes in critically ill patients with COVID-19: a cohort study. Ann Intensive Care. 2021;11(1):1–11.

    Article  Google Scholar 

  25. Rodriguez VA, Bhave S, Chen R, et al. Development and validation of prediction models for mechanical ventilation, renal replacement therapy, and readmission in COVID-19 patients. J Am Med Inform Assoc. 2021;28:1480–8.

    Article  Google Scholar 

  26. Yoo E, Percha B, Tomlinson M, Razuk V, Pan S, et al. Development and calibration of a simple mortality risk score for hospitalized COVID-19 adults. MedRxiv. 2020. https://doi.org/10.1101/2020.08.31.20185363.

    Article  Google Scholar 

  27. Su H, Yang M, Wan C, Yi L-X, Tang F, Zhu H-Y, et al. Renal histopathological analysis of 26 postmortem findings of patients with COVID-19 in China. Kidney Int. 2020;98(1):219–27.

    CAS  Article  Google Scholar 

  28. Panitchote A, Mehkri O, Hastings A, Hanane T, Demirjian S, Torbic H, et al. Factors associated with acute kidney injury in acute respiratory distress syndrome. Ann Intensive Care. 2019;9(1):1–10.

    Article  Google Scholar 

  29. Husain-Syed F, Slutsky AS, Ronco C. Lung–kidney cross-talk in the critically ill patient. Am J Respir Crit Care Med. 2016;194(4):402–14.

    CAS  Article  Google Scholar 

  30. Lombardi R, Nin N, Peñuelas O, Ferreiro A, Rios F, Marin MC, et al. Acute kidney injury in mechanically ventilated patients: the risk factor profile depends on the timing of Aki onset. Shock. 2017;48(4):411–7.

    Article  Google Scholar 

  31. Chan L, Chaudhary K, Saha A, Chauhan K, Vaid A, Zhao S, et al. AKI in hospitalized patients with COVID-19. J Am Soc Nephrol. 2021;32(1):151–60.

    CAS  Article  Google Scholar 

  32. Fisher M, Neugarten J, Bellin E, Yunes M, Stahl L, Johns TS, et al. AKI in hospitalized patients with and without COVID-19: a comparison study. J Am Soc Nephrol. 2020;31(9):2145–57.

    CAS  Article  Google Scholar 

  33. Hill NR, Fatoba ST, Oke JL, Hirst JA, O’Callaghan CA, Lasserson DS, et al. Global prevalence of chronic kidney disease – a systematic review and meta-analysis. PLoS One. 2016;11(7):e0158765.

    Article  Google Scholar 

  34. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13(10):818–29.

    CAS  Article  Google Scholar 

  35. Moreno RP, Metnitz PGH, Almeida E, Jordan B, Bauer P, Campos RA, et al. SAPS 3—from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 2005;31(10):1345–55.

    Article  Google Scholar 

  36. Kunutsor SK, Laukkanen JA. Renal complications in COVID-19: a systematic review and meta-analysis. Ann Med. 2020;52(7):345–53.

    CAS  Article  Google Scholar 

  37. Hansrivijit P, Qian C, Boonpheng B, Thongprayoon C, Vallabhajosyula S, Cheungpasitporn W, et al. Incidence of acute kidney injury and its association with mortality in patients with COVID-19: a meta-analysis. J Investig Med. 2020;68(7):1261–70.

    Article  Google Scholar 

  38. Ouyang L, Gong Y, Zhu Y, Gong J. Association of acute kidney injury with the severity and mortality of SARS-CoV-2 infection: a meta-analysis. Am J Emerg Med. 2021;43:149–57.

    Article  Google Scholar 

  39. Koye DN, Shaw JE, Reid CM, Atkins RC, Reutens AT, Magliano DJ. Incidence of chronic kidney disease among people with diabetes: a systematic review of observational studies. Diabet Med. 2017;34(7):887–901.

    CAS  Article  Google Scholar 

  40. Patschan D, Müller GA. Acute kidney injury in diabetes mellitus. Int J Nephrol. 2016;2016:1–7.

    Article  Google Scholar 

  41. Ponce D, Zorzenon CDPF, Santos NYD, Balbi AL. Early nephrology consultation can have an impact on outcome of acute kidney injury patients. Nephrol Dial Transplant. 2011;26(10):3202–6.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank the hospitals, which are part of this collaboration: Hospital das Clínicas da Faculdade de Medicina de Botucatu; Hospital Universitário de Santa Maria; Hospital São João de Deus; Hospital Regional Antônio Dias; Hospital Nossa Senhora da Conceição; Hospital Cristo Redentor; Hospital Risoleta Tolentino Neves; Hospital Júlia Kubitschek; Hospital Santo Antônio; Hospital Santa Rosália; Hospital João XXIII; Hospital UNIMED BH; Hospital Mãe de Deus; Hospital Universitário Canoas; Hospital SOS Cárdio; Hospital das Clínicas da Universidade Federal de Pernambuco; Hospital das Clínicas da UFMG; Hospital Universitário Ciências Médicas; Hospital São Lucas da PUCRS; Hospital Luxemburgo; Hospital Metropolitano Odilon Behrens; Hospital Moinhos de Vento; Hospital Bruno Born; Hospital Santa Cruz; Hospitais da Rede Mater Dei; Hospital Márcio Cunha; Hospital Eduardo de Menezes; Hospital Tacchini; Hospital Semper and Hospital Metropolitano Doutor Célio de Castro. We also thank all the clinical staff at those hospitals, who cared for the patients, and all students who helped with the data collection.

Funding

This study was supported in part by Minas Gerais State Agency for Research and Development (Fundação de Amparo à Pesquisa do Estado de Minas Gerais - FAPEMIG) [grant number APQ-00208-20] and National Institute of Science and Technology for Health Technology Assessment (Instituto de Avaliação de Tecnologias em Saúde – IATS)/ National Council for Scientific and Technological Development (Conselho Nacional de Desenvolvimento Científico e Tecnológico - CNPq) [grant number 465518/2014-1]. MJRA is also supported by a scholarship from HCFMUSP with funds donated by NUBANK under the #HCCOMVIDA initiative. Futhermore, PDP is supported by a scholarship from National Institute of Science and Technology for Health Technology Assessment (Instituto de Avaliação de Tecnologias em Saúde – IATS) with funding Coordination of Superior Level Staff Improvement (Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - CAPES, grant number: 88887.629451/2021000).

Author information

Authors and Affiliations

Authors

Contributions

Conception or design of the work: MSM and MCP. Data collection: DP, RLRC, AVS, AOM, ALBAS, AFG, BLF, BMG, CTCAS, CCRC, CAC, CSD, DVS, ERFM, EPAC, FA, FGA, FCA, FB, GGV, GFN, HCN, HD, HRV, HCG, JCA, JMC, JPDM, JMR, KBR, KPMPM, LSMM, LSFC, LCC, LAN, MASC, MAF, MDS, MVRSS, MC, MFG, MACB, MCPBL, MCAN, MFLM, MHGJ, NCSS, NRO, PKZ, PGSA, PLA, PJLM, PDP, RCM, RMM, SCF, SFA, TFO, TCO, TLSS, YCR and MSM. Data analysis and interpretation: MSM, MCP, LEFR, RTS and FAF. Drafting the article: FAF, MSM, MCP, MJRA, TJAS, CSD and DP. Critical revision of the article: all authors. Final approval of the version to be published: all authors. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Flávio de Azevedo Figueiredo.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the National Research Ethics Committee (CAAE 30350820.5.1001.0008).

Consent for publication

Informed consent was waived due to the pandemic situation and the study design, based on data collection from medical records only.

Competing interests

The authors declare that they have no competing interests. The sponsors had no role in study design; data collection, management, analysis, and interpretation; writing the manuscript; and deciding to submit it for publication.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

TRIPOD checklist for transparent reporting on a multivariable prognostic model.

Additional file 2: Table S2.

L1 penalised shrunk coefficients for the MMCD score.

Additional file 3: Figure S1.

MMCD score risk for adult patients admitted to hospital with COVID-19 – MMCD score infographics.

Additional file 4: Table S3.

Assessment of potential predictors for the model development.

Additional file 5: Figure S2.

Calibration slope for the MMCD score. Figure S3. Combined decision curve for the MMCD score. Figure S4. Calibration slope for the MMCD score in geographic validation. Figure S5. Combined decision curve for the MMCD score in geographic validation.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Figueiredo, F.d., Ramos, L.E.F., Silva, R.T. et al. Development and validation of the MMCD score to predict kidney replacement therapy in COVID-19 patients. BMC Med 20, 324 (2022). https://doi.org/10.1186/s12916-022-02503-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-022-02503-0

Keywords

  • Acute kidney injury
  • COVID-19
  • Kidney replacement therapy
  • Score
  • Risk factors
  • Risk prediction