Skip to main content
Download PDF

Predicting mortality in sick African children: the FEAST Paediatric Emergency Triage (PET) Score

BMC Medicine volume 13, Article number: 174 (2015) Cite this article

Abstract

Background

Mortality in paediatric emergency care units in Africa often occurs within the first 24 h of admission and remains high. Alongside effective triage systems, a practical clinical bedside risk score to identify those at greatest risk could contribute to reducing mortality.

Methods

Data collected during the Fluid As Expansive Supportive Therapy (FEAST) trial, a multi-centre trial involving 3,170 severely ill African children, were analysed to identify clinical and laboratory prognostic factors for mortality. Multivariable Cox regression was used to build a model in this derivation dataset based on clinical parameters that could be quickly and easily assessed at the bedside. A score developed from the model coefficients was externally validated in two admissions datasets from Kilifi District Hospital, Kenya, and compared to published risk scores using Area Under the Receiver Operating Curve (AUROC) and Hosmer-Lemeshow tests. The Net Reclassification Index (NRI) was used to identify additional laboratory prognostic factors.

Results

A risk score using 8 clinical variables (temperature, heart rate, capillary refill time, conscious level, severe pallor, respiratory distress, lung crepitations, and weak pulse volume) was developed. The score ranged from 0–10 and had an AUROC of 0.82 (95 % CI, 0.77–0.87) in the FEAST trial derivation set. In the independent validation datasets, the score had an AUROC of 0.77 (95 % CI, 0.72–0.82) amongst admissions to a paediatric high dependency ward and 0.86 (95 % CI, 0.82–0.89) amongst general paediatric admissions. This discriminative ability was similar to, or better than other risk scores in the validation datasets. NRI identified lactate, blood urea nitrogen, and pH to be important prognostic laboratory variables that could add information to the clinical score.

Conclusions

Eight clinical prognostic factors that could be rapidly assessed by healthcare staff for triage were combined to create the FEAST Paediatric Emergency Triage (PET) score and externally validated. The score discriminated those at highest risk of fatal outcome at the point of hospital admission and compared well to other published risk scores. Further laboratory tests were also identified as prognostic factors which could be added if resources were available or as indices of severity for comparison between centres in future research studies.

Peer Review reports

Background

The admission burden to paediatric wards or the emergency room in African hospitals is very high, with many children presenting with complications of common infectious diseases such as sepsis and malaria. Life-threatening complications, including shock, are frequently present, and mortality is high, at 15–30 % [1–3]. Severe forms of pneumonia, sepsis, or malaria are amongst the most common causes of death [4], yet differentiation of the specific underlying cause is often unclear at point of admission since they share similar presenting clinical characteristics. Furthermore, most deaths occur within the first 24 h of admission [5]. The WHO integrated management guidelines recommend identifying children with ‘emergency’ or ‘priority’ features as a proxy for triage for immediate treatment in order to avert poor outcome; this approach has been shown to reduce mortality but implementation and consistency varies [6, 7]. At a clinical level, the key challenge facing health services in Africa is precisely how to distinguish those who are at greatest risk of poor outcome, using largely clinical criteria, in order to target parenteral antimicrobials and supportive therapies. Bedside clinical risk scores at admission can be used as part of triage systems to discriminate between children at high and low mortality risk. They can also be used to calculate risk-adjusted estimates of mortality in order to compare quality of care across hospitals or to stratify children entering clinical trials or other studies [8].

Paediatric risk scores have been developed in well-resourced countries, and are used to describe severity of illness in paediatric intensive care units in a variety of settings [9–12]. Examples include the Pediatric Risk of Mortality (PRISM) score, the Paediatric Index of Mortality score (PIM) [13, 14], the Pediatric Early Warning System score (PEWS), and Bedside PEWS [15]. These have helped with early identification for transfer to high dependency units and in research to enable between site and within study comparison of severity of illness. However, very few generic paediatric risk scores have been developed in resource-limited settings and those that are published have not been widely used or validated. The limited utility for general triage of some scores that focus on specific pathogens, such as malaria [16, 17] or meningococcal disease [18, 19], is due to the requirement of laboratory confirmation, therefore making them more suitable for retrospective risk stratification. Thus, there is a need for a practical risk score based only on clinical bedside measures that can be easily and quickly identified by busy healthcare workers on admission, that has an intuitive range, that does not need a specific disease or infection to be identified, that uses clinical signs that are found in populations in these settings, and that discriminates well between children at different risks of mortality. Such a score would also be useful in real-time stratification of children for trial enrolment and comparison of centres in these settings.

We identified prognostic factors for mortality in febrile children with signs of shock admitted to emergency care wards in East Africa and enrolled into the FEAST (Fluid Expansion as Supportive Therapy) trial, and used them to develop a bedside risk score for mortality. This score was then validated using data on children admitted to a rural district hospital in Kilifi, Kenya, and its performance compared to other published risk scores.

Methods

Study setting

Derivation data came from the FEAST trial which took place in six centres (both large regional referral hospitals and small district hospitals) across three countries (Kenya, Uganda, and Tanzania) from 2009 to 2011 and enrolled 3,170 sick febrile children aged between 2 months and 12 years with clinical evidence of impaired perfusion ([20], ISCRTN 69856593). FEAST was conducted in malaria endemic areas where national vaccination programmes included Haemophilus influenza type B vaccine, but not a pneumococcal vaccine. Prior and during the trial, admitting clinicians and nurses received Emergency Triage Assessment and Treatment training [21], which included the assessment of clinical features of shock. Eligible children had an abnormal temperature (pyrexia (≥37.5 °C) or hypothermia (<36 °C)), severe illness (presence of one or both of impaired consciousness (prostration, the inability of a child older than 8 months of age to sit upright or the inability of a child 8 months of age or younger to breast-feed; or coma, the inability to localize a painful stimulus) and respiratory distress) and clinical evidence of impaired perfusion (one or more of the following: capillary refill time >2 s; lower limb temperature gradient, defined as a notable temperature change from cold (dorsum of foot) to warm (knee) when running the back of hand from the toe to the knee; weak radial pulse or severe tachycardia, defined as heart rate >180 beats per min (bpm) for children <1 year old, >160 bpm for those 1 to 4 years old, >140 bpm for those ≥5 years old). Children with severe malnutrition, burns, trauma, gastroenteritis, or a presumed non-infectious cause of severe illness were excluded. Children were randomised to receive boluses of 20–40 mL/kg of 5 % human albumin solution or 0.9 % saline solution over one hour, or maintenance fluids only at 4 mL/kg/h (no bolus control group). Those with severe hypotension (systolic blood pressure <50 mmHg for those aged <1 year, <60 mmHg for those 1–4 years old, <70 mmHg for those ≥5 years old) were randomly assigned in a separate stratum to receive 40 mL/kg bolus of either albumin or saline. All children enrolled in both strata were included in this study. Standardised case report forms were completed at enrolment and at specific time points during the first 48 h. At enrolment, lactate, haemoglobin, oxygen saturation, and glucose were measured and an HIV antibody test and rapid diagnostic test for malaria were performed. An automated handheld blood analyser (i-STAT, Abbott Laboratories, Abbott Park, IL) was used for immediate analyses of pH level, potassium, base excess, blood urea nitrogen (BUN), sodium, chloride, TCO2, and PCO2. Children with haemoglobin <5 g/dL were routinely transfused according to national guidelines [22].

The validation data came from one of the FEAST trial sites, a rural district hospital in Kilifi, Kenya, which has a general paediatric ward and a high dependency ward. The Kenya Medical Research Institute Programme has established ward surveillance and used standardised forms to systematically collect clinical admission data on all infants and children entering the hospital wards since 1989, which has been linked to demographic surveillance in the district since 2002 [23]. Children were routinely transferred to the high dependency unit if they had impaired consciousness (prostration or coma) or deep-breathing (a clinical sign of metabolic acidosis), or if they required close medical supervision for life threatening complications such as status epilepticus, severe forms of shock, or a cardio-respiratory arrest. At admission to the high dependency unit (HDU) an extended set of clinical details were routinely collected.

The first validation datasets included children aged between 2 months and 12 years admitted to the general paediatric ward between March 2011 and December 2012 (5,173 children), and the second dataset is a subset of the first and includes all children contemporaneously admitted from the general ward to the HDU (1058/5173 children). These datasets did not include children from the FEAST trial, which finished enrolment at this centre in January 2011 and included information on the date, but not time, of death.

Other published paediatric risk scores were evaluated in the FEAST derivation and validation datasets. PRISM III was developed in paediatric intensive care units in the USA and has been validated in a variety of settings [10, 24–28]. The Bedside Pediatric Early Warning System score (PEWS) was developed in Canada to quantify severity of children in hospitalised children and help with referral to critical care experts [15]. For African paediatric populations, the AQUAMAT (African Quinine Artesunate Malaria Trial) prognostic score (0–5) was developed in a post hoc analysis from the trial dataset involving nine African countries as part of the AQUAMAT trial comparing anti-malarial treatments in children with severe malaria and included five parameters (base deficit, impaired consciousness, convulsions, elevated blood urea, and underlying chronic illness) which were independently associated with death [17, 29]. The Lamberéné Organ Dysfunction Score (LODS) was created using data from six African countries in children with malaria using only three parameters (deep breathing, coma, and prostration) [16, 30]. Berkley et al. [31] used Kilifi admission data from 1998 to 2001 to develop prognostic scores for deaths at different time points following admission, subsequently named during a published validation as the Pediatric Early Death Index for Africa (PEDIA). The AQUAMAT score has not been subject to external validation to date and PEDIA along with LODS have only recently been externally validated in Uganda in children with malaria and non-malarial illnesses [30].

Statistical analyses

The prognostic model for mortality by 48 h was built following published guidelines [32] and is described in Additional file 1: Table S1. There were 315 deaths; thus, up to 30 candidate predictors could reasonably be considered [33]. Variables selected for initial consideration were measured in >95 % of the included children, had been found to be predictive in other studies, or were a priori thought to be clinically important, and not highly correlated with other variables (Table 1). All variables were measured at or within 1 h of randomisation, which occurred at a median (IQR) of 15 min (0–25 min) following ward admission, and prior to the administration of any trial intervention. Model derivation was based on multivariable fractional polynomials with backwards elimination using Cox proportional hazards regression in complete cases (adjusted for randomisation arm) [34]. Time to death was measured in hours and minutes (from the time of randomisation) and follow-up was censored at 48 h or time of leaving hospital if earlier. Cox proportional hazards regression was used to allow for information from children that absconded prior to 48 h to be included in the analysis (n = 11). This identified the most predictive variables for death and the best functional form for continuous variables (exit and non-linearity threshold P = 0.05). Interactions with the randomisation arm were also considered in this model. We carried out sensitivity analyses using logistic regression to build the model and restricting the derivation dataset to control arm data only (n = 1,044 children, 76 deaths).

Table 1 Candidate predictors of mortality considered for building multivariable model
Full size table

A clinical bedside score (the FEAST Paediatric Emergency Triage (PET) score) was created by categorising the continuous variables using appropriate clinical cut-offs to use alongside already categorised variables in a Cox regression model. Coefficients for the categories of each variable in the model were then divided by the coefficient nearest zero and rounded to the nearest integer giving an initial score value [19]. These initial score values were then further modified to ensure a straightforward scale from 1–10 by assigning 2 to the initial value if it was >3, and 1 if it was ≤3, and dropping variables that added the least predictive ability to the model (assessed by using the Net Reclassification Index (NRI) [35]). A low score on this scale then indicated a low risk of mortality and a high score indicated a high risk of mortality.

The FEAST PET score was applied to the two validation datasets using the non-parametric area under the receiver operating curve (AUROC) to measure discriminative ability. Mortality was defined as death within 2 days of admission as time of death was not available in the two validation datasets. The FEAST data and two validation datasets were also used to validate other previously published scores. To validate the PEDIA score, immediate death (death within 4 h after admission, and calculated exactly in FEAST) was interpreted as death on the same day as admission, early death (death between 4 and 48 h) was interpreted as death within 2 calendar days of admission but not the same day, and late death (>48 h) as death occurring more than 2 days after admission. Calibration was measured by Hosmer-Lemeshow goodness-of-fit χ2 tests evaluated on groups defined by quintiles [36]. PRISM III, Bedside PEWS, AQUAMAT, and PEDIA scores were calculated using the available admission variables and unavailable variables in the scores were set to 0 (as recommended). Assessments at later time points were not available to use for PRISM III, although this score recommends using the worst clinical measurement in the first 24 h [13, 27].

We also considered whether laboratory candidate predictors (Table 1; with >5 % missing data) could improve the discriminatory ability of the score in situations where they could feasibly be measured (e.g. specific research studies). Multiple imputation by chained equations under the missing at random assumption, with predictive mean matching, was therefore used for imputation, including all factors in Table 1 in the imputation model and creating 25 imputed datasets [37]. Imputed and observed values were compared visually. The NRI [35] was calculated within each imputed dataset using mortality risk cut-offs at 5 %, 10 %, and 15 %, and the range and mean of this measure across the 25 imputed datasets was used to assess whether the additional laboratory variables could be usefully added to the clinical bedside variables already included in the score. The NRI assessed the ability of each additional variable to directly increase the discriminative ability of the model by looking at risk classification categories (with an increased NRI showing more children correctly classified). Backwards elimination (exit threshold mean P = 0.05 calculated from all imputed datasets) including all laboratory markers was then used to identify the laboratory variables with the largest NRIs across the imputed datasets. These were added to the clinical prognostic model to develop an extended score including laboratory markers identified as adding important information to risk scoring by the NRI. Rubin’s rules [38] were used to combine AUROCs from the multiply imputed datasets to validate the score including laboratory markers in the FEAST control arm data [39]. Finally, in an additional analysis, Cox regression was used to identify the best prognostic model for mortality based on best subsets regression in complete cases including all laboratory markers with <10 % missing data and considering all interactions. Statistical analyses were carried out in Stata (version 13.1).

Results

Overall, 3,170 children with median age 24 months (IQR, 13–38) were recruited to the FEAST trial, of whom 315 (11 %) died within 48 h. A total of 3,121 (98 %) children (2,815 (99 %) surviving children and 306 (97 %) who died) had complete clinical data on admission for calculation of clinical bedside score. Of these, 15 % were comatose, 59 % had a temperature gradient, 51 % severe pallor (manifested in tongue, gums, or inner eyelids), and 21 % a weak pulse volume; median heart rate was 169 beats per minute (Table 2).

Table 2 Baseline characteristics of FEAST dataset and validation datasets from Kilifi
Full size table

Twenty five variables were included in the model building process (Table 1) of which 10 were selected as independent predictors of mortality in the final model. The final prognostic model included axillary temperature, heart rate, weight, lung crepitations (added breath sounds heard on inspiration in one or both lung fields: any one of crackles, clicks or rattling (rales)), weak pulse, capillary refill time, conscious level, respiratory distress, deep breathing, and severe pallor. Identical independent predictors of mortality were also chosen using logistic regression (Additional file 1: Table S2). The strongest prognostic factors for mortality were coma, bradycardia (<80 beats per min), or severe tachycardia (>220 beats per min). Lower temperature and longer capillary refill times were also associated with an increased risk of death. Mortality risk increased as weight declined under <10 kg. As expected, weight and age were highly correlated (Spearman’s rho = 0.88, P <0.001), but age did not explain the mortality risk as well as weight (Akaike Information Criterion difference +4.8 for model including age rather than weight). Although weight-for-age z-score provided a similarly good model fit to weight, it was not included because it is not practical to calculate in an emergency setting. Weight and deep breathing in the presence of the other bedside factors were the least predictive (P >0.05 for their NRI values), and were therefore dropped in order to create a simple score ranging from 0–10 (Table 3). The FEAST PET score’s discriminative ability within the control arm (receiving maintenance fluids only, and selected as they were not affected by the adverse outcome of fluid boluses) of the FEAST derivation dataset was good with AUROC = 0.82 (95 % CI, 0.77–0.87) compared to 0.84 (95 % CI, 0.79–0.87) for full linear predictor from fitted regression coefficients, including all 10 variables and non-linearity. The median score in the control arm was 3 (IQR 2–4), while the maximum score was 9 out of a possible 10. Sensitivity analyses developing a score in the control arm data identified most of the 10 included variables as significant predictors, but failed to identify others with similar effect sizes in additional models due to reduced power (Additional file 1: Table S3).

Table 3 FEAST Paediatric Emergency Triage (PET) score and the FEAST Paediatric Emergency Triage and Laboratory (PETaL) score
Full size table

Multiple imputation with chained equations was used to assess the potential for the laboratory candidate predictors in Table 1 to add important information to a risk score, even if these might be evaluated on a smaller number of children. The NRI calculated in 25 imputed datasets with risk category cut-offs of 5 %, 10 %, and 15 % identified lactate, HIV status, TCO2, potassium, pH, BUN, and base excess as variables that significantly improved the mortality score (Additional file 1: Table S2). Using backwards elimination including the clinical factors and all laboratory markers, lactate, BUN, and pH added independent information to the score (lactate NRI range 10.7–14.2 %, mean P <0.001, BUN NRI range 2.8–8.9 %, mean P = 0.02, pH NRI range 4.8–9.1 %, mean P = 0.03; Additional file 1: Table S4). The NRI of adding all three laboratory variables to the clinical score was 24.7–28.9 %, all P <0.001. These variables were therefore categorised using appropriate clinical cut-offs and added to the FEAST score extending the range of the score to 0–14 (Table 3) and creating the FEAST Paediatric Emergency Triage and Laboratory (PETaL) score. The AUROC for the FEAST PETaL score in the control arm from the multiply imputed data was 0.86 (95 % CI, 0.82–0.90). Oxygen saturation, although considered important in other studies, was not shown to significantly improve the discriminative ability of the score in our dataset (NRI range 1.1–5.3 %, mean P = 0.08; Additional file 1: Table S4).

A Cox regression analysis using best subsets regression and including the 10 clinical variables from the model and the laboratory candidate predictors with <10 % missing data on complete cases only, identified lactate, haemoglobin, glucose, and malaria test results to be important additional predictors of mortality (although notably these factors did not all increase the ability to distinguish mortality risk between children). A positive malaria test result and high glucose were associated with a reduced mortality risk (Additional file 1: Table S5). We found an interaction between haemoglobin and lactate: rather than the mortality risk uniformly increasing with increasing lactate and uniformly decreasing with increasing haemoglobin, the higher risk associated with higher lactate (>7 mmol/L) values was restricted to those with high haemoglobin (>6 g/dL). For children with profound anaemia (haemoglobin <4 g/dL) there was a similar risk regardless of lactate level, compared to an average child enrolled who had a lactate of 5 mmol/L and a haemoglobin of 7 g/dL (Fig. 1).

Fig. 1
figure1

Plots of the relationship between haemoglobin and lactate and mortality estimated from the adjusted Cox regression model. a Contour plot of mortality risk by baseline haemoglobin and lactate estimated from Cox regression model. This shows in contrast to risk uniformly increasing with increasing lactate and uniformly decreasing with haemoglobin as might have been expected, we have observed increased risk (green to red) when haemoglobin is increasing and lactate is increasing relative to an average child enrolled who had a lactate of 5 mmol/L and a haemoglobin of 7 g/dL. b Scatter plot of observed baseline haemoglobin and lactate values

Full size image

The FEAST PET score was externally validated on the Kilifi HDU data (1,053 children, 98 (9 %) deaths), and showed a fair discriminative ability with AUROC of 0.77 (95 % CI, 0.72–0.82) and Hosmer-Lemeshow test P = 0.30 indicating good fit. The score’s discriminative ability improved in the general admissions dataset (5,098 children, 117 (2 %) deaths) giving an AUROC of 0.86 (95 % CI, 0.82–0.89) and Hosmer-Lemeshow test P = 0.51 (Fig. 2).

Fig. 2
figure2

Receiver operating characteristic curves for the FEAST PET score in (a) the Kilifi high dependency unit and (b) the Kilifi general admissions dataset

Full size image

In comparison with other scores, the FEAST PET score showed significantly better discriminative ability than Bedside PEWS, PRISM III, and the AQUAMAT scores (Fig. 3; P <0.05 test for equality between AUROC scores), and no evidence for a difference for LODS, and PEDIA on the two validation datasets (Table 4). LODS discriminated well in all the validation datasets and gave an AUROC of 0.76 (0.71–0.81) in the HDU and 0.87 (0.83–0.90) in the general admissions dataset. The AQUAMAT trial score discriminated better when restricted to children with malaria in the FEAST trial (AUROC 0.80; 95 % CI, 0.68–0.93) but did not discriminate as well when restricted to the Kilifi datasets.

Fig. 3
figure3

Discriminatory ability of different scores when applied to data from FEAST and Kilifi

Full size image
Table 4 Discriminatory ability of different scores when applied to data from FEAST and Kilifi
Full size table

Discussion

Herein, we have developed and externally validated a bedside clinical risk score for severely ill children presenting to emergency care wards in resource-limited settings in Africa that identifies those at greatest risk of mortality within 48 h of admission. The FEAST PET score is straightforward to use, includes only clinical variables that are measured at the bedside, does not rely on laboratory tests, and is not limited to children with specific diagnoses, but rather covers different presentation syndromes reflecting the population of children presenting to hospital in these settings.

Prognostic scores created in resource-limited settings have not often been externally validated, even though this is an important part of the development process [40]. This may explain why previous scores have not been widely implemented. The FEAST PET score had fair discriminative ability for HDU data and good discriminative ability for general admissions data, showing that it is generalizable to other clinical settings. The two validation cohorts were heterogeneous, one included more critically sick children that had been transferred to a HDU which also acted as a research ward and the other a more general paediatric admission population of which the majority had come through the emergency room. We have already highlighted the clinical and epidemiological challenge of differentiating the major causes of childhood illnesses since many have overlapping clinical presentations [41–43]. Interestingly, the FEAST PET score discriminated best in the general admissions dataset, likely because this included more children with low scores with very low mortality risk (Additional file 1: Figure S1). However, similar proportions with high scores died in both general admissions and HDU validation sets, demonstrating that the FEAST PET score is able to identify those children at particularly high mortality risk even within children presenting to the emergency room with a diverse set of underlying conditions. However, perhaps because of the diversity of underlying conditions among children in the FEAST trial, the FEAST PET score discriminated best in the general admissions dataset. This suggests that the emergency room or general admissions would be the most appropriate setting in which to explore implementation, perhaps in comparison to the simpler LODS score.

Comparing different scores for 48 h mortality in the two validation datasets, the FEAST PET score performed similarly well to the PEDIA immediate death and early death score, and the LODS score, and better than Bedside PEWS, PRISM III, and AQUAMAT scores, likely due to the FEAST PET score’s good generalisability and because all of the variables were easily recorded at the bedside. It is perhaps not surprising that the PEDIA immediate and early death scores performed well within these datasets, as PEDIA was based on data previously obtained from the same hospital, but it is interesting that the very simple LODS score (based on only three factors) also performed well. The three PEDIA scores have only been externally validated once in Uganda [30] and may be complex to implement since different prognostic factors predict scores for different times of death (immediate vs early vs late) and have different weighting within each score. The PEDIA score for late deaths (>48 h) in particular discriminated poorly.

A limitation of our validation is that many of the laboratory tests included in PIM and PRISM III, and commonly done in well-resourced settings (such as total bilirubin, calcium, potassium, arterial oxygen tension, creatinine, prothrombin time) are not measured in most African countries, and were not available in the FEAST or validation datasets. The PIM score could not be validated at all as none of its variables were recorded in the validation dataset [14]. The AQUAMAT score performed well in the FEAST trial subgroup with malaria, but performed poorly in the Kilifi validation dataset probably because two of the five severity measures in the score were not routinely recorded (BUN and base excess).

Nevertheless, it is interesting to consider how much additional discrimination could be obtained from wider use of laboratory test results in resource limited-settings. In our further analyses we added three laboratory measures (lactate, BUN, pH) to the PET score based on their NRI to create the PETaL score; however, this did not change discriminatory power in the derivation dataset, showing that clinical measures can be sufficient for a good score, and that improving prediction does not always improve ability to discriminate children at low and high risk. Unfortunately, we were not able to externally validate the PETaL score as the laboratory measures were not available in the Kilifi validation datasets.

However, the fuller prognostic model including laboratory tests (with <10 % missing data) can provide insights into underlying epidemiology of the acutely sick child in Africa. For example, we found that the increased risk of death associated with higher lactate, i.e. >7 mmol/L, was much greater among children with haemoglobin >6 g/dL. All those with low haemoglobin (<4 g/dL) had similar risk regardless of lactate, possibly because 89 % of these severely anaemic children were effectively treated with blood transfusion [22], whereas those with high haemoglobin had diverse underlying causes. This may also be due to different causes of high lactate in anaemic (reduced oxygen carrying capacity) compared to non-anaemic patients manifesting cardiovascular compromise of septic shock with diminished oxygen delivery (leading to anaerobic metabolism from shock) [44]. Moreover, acute onset of severe anaemia (to levels as low as 5 g/dL) can be well tolerated because of compensatory mechanisms to sustain tissue oxygenation [45].

Similarly, the association between reduced mortality and a positive malaria test in the present study may be due to asymptomatic P. falciparum infection being common in malaria endemic areas, and carrying lower overall mortality, especially compared to children with bacterial infections [46, 47]. Of interest, oxygen saturation, a predictor of mortality in other studies [48, 49], was not a significant predictor in our dataset, which may be due to its effect being captured by other clinical measures. Furthermore, the limited predicative ability of hypoxia compared to another clinical feature (crepitations) for identifying children with probable pneumonia supports WHO recommendations of the value of this sign reinforcing the diagnosis of pneumonia in children with severe breathing difficulties. Although crepitations could be considered a subjective sign dependent on the observer, a sensitivity analysis showed that excluding it worsened the discriminatory ability of the score (AUROC without lung crepitations 0.80 (0.75–0.86); P = 0.04 in FEAST control arm data). This indicates it is important to retain in the bedside score.

Advantages of using the FEAST dataset to develop a clinical bedside score are its large size, multi-centred and multi-disease nature with substantial subgroups with severe malaria and sepsis, and its high quality as it was collected during a randomised controlled trial [50, 51] with few missing data for bedside measures. The pragmatic nature of the trial design enabled it to be carried out in centres without a history of research and without many interventions at a site level. The standard-of-care for trial participants was thus very similar to the standard-of-care on the wards, but with increased monitoring by nurses over the first 48 h of admission. One important limitation is that, despite it being a useful prognostic factor in other studies [52], we were not able to consider mid-upper arm circumference in any analysis due to differences in data completeness between survivors and non-survivors (violating the missing at random assumption needed for multiple imputation), probably due to mid-upper arm circumference being of low priority to complete immediately upon admission.

We developed the FEAST PET score using the full clinical trial dataset (315 deaths) including intervention arm as a model factor in order to increase power. However, this raises potential concerns about interactions with randomised interventions: the alternative strategy is to restrict derivation models to the control arm only (76 deaths) with consequent power reductions. As no significant or important interactions had been identified [20], we chose the former. Repeating the score derivation process on control arm data as a sensitivity analysis, as suggested by a reviewer, gave broadly similar results, but un-intuitively identified fits as significantly protective and, despite similar effect sizes, failed to identify capillary refill time and pallor as significant predictors (Additional file 1: Table S3).

Conclusions

Although it would benefit from external validation in a multi-centre African population outside of the FEAST trial centres before implementation, there are several ways that the FEAST PET score could be used. One would be as an inclusion criterion for clinical trials, or to stratify children into groups or perform risk-adjusted comparisons of emergency care. For research studies recording laboratory data, the FEAST PETaL score could be used for inter-site or inter-centre comparisons. However, potentially the most valuable use of this standardised, validated score is to support the implementation of triage in resource-limited routine care settings, thereby facilitating rapid prioritisation of care, or closer monitoring, for the sickest children and hence improved outcomes. Improved triage has been shown to reduce mortality in these settings [6] and the FEAST PET score would work across specific syndromes and specific diseases to identify those that need prioritisation of any supportive therapies available. It would also help ensure consistent comparisons between patients by clinicians, compared to simple clinical opinion, and encourage better examination of clinical signs by all staff. Having a score that is simple to implement and uses commonly measured clinical signs could increase the number of hospitals in resource-limited settings that successfully implement the triage process.

Abbreviations

AQUAMAT:

African Quinine Artesunate Malaria Trial

AUROC:

Area under the receiver operating curve

BUN:

Blood urea nitrogen

FEAST:

Fluid Expansion as Supportive Therapy

HDU:

High dependency unit

LODS:

Lamberéné Organ Dysfunction Score

NRI:

Net Reclassification Index

PEDIA:

Pediatric Early Death Index for Africa

PET:

Paediatric Emergency Triage

PETaL:

Paediatric Emergency Triage and Laboratory

PEWS:

Pediatric Early Warning System score

PIM:

Paediatric Index of Mortality score

PRISM:

Pediatric Risk of Mortality

References

  1. 1.

    Nolan T, Angos P, Cunha AJ, Muhe L, Qazi S, Simoes EA, et al. Quality of hospital care for seriously ill children in less-developed countries. Lancet. 2001;357:106–10.

    CAS  Article  PubMed  Google Scholar 

  2. 2.

    English M, Esamai F, Wasunna A, Were F, Ogutu B, Wamae A, et al. Assessment of inpatient paediatric care in first referral level hospitals in 13 districts in Kenya. Lancet. 2004;363:1948–53.

    Article  PubMed  Google Scholar 

  3. 3.

    Mulholland K, Adegbola R. Bacterial infections--a major cause of death among children in Africa. N Engl J Med. 2005;352:75–7.

    CAS  Article  PubMed  Google Scholar 

  4. 4.

    World Health Organization. Serious childhood problems in countries with limited resources. Geneva: WHO; 2004.

    Google Scholar 

  5. 5.

    Molyneux E. Paediatric emergency care in developing countries. Lancet. 2001;357:86–7.

    CAS  Article  PubMed  Google Scholar 

  6. 6.

    Molyneux E, Ahmad S, Robertson A. Improved triage and emergency care for children reduces inpatient mortality in a resource-constrained setting. Bull World Health Organ. 2006;84:314–9.

    Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Li M, Kelly J, Subhi R, Were W, Duke T. Global use of the WHO pocket book of hospital care for children. Paediatr Int Child Health. 2013;33:4–17.

    Article  PubMed  Google Scholar 

  8. 8.

    Moons K, Royston P, Vergouwe Y, Grobbee D, Altman D. Prognosis and prognostic research: what, why, and how? BMJ. 2009;338:b375.

    Article  PubMed  Google Scholar 

  9. 9.

    Gemke R, van Vught J. Scoring systems in pediatric intensive care: PRISM III versus PIM. Intensive Care Med. 2002;28:204–7.

    Article  PubMed  Google Scholar 

  10. 10.

    Choi KM, Ng DK, Wong SF, Kwok KL, Chow PY, Chan CH, et al. Assessment of the Pediatric Index of Mortality (PIM) and the Pediatric Risk of Mortality (PRISM) III score for prediction of mortality in a paediatric intensive care unit in Hong Kong. Hong Kong Med J. 2005;11:97–103.

    CAS  PubMed  Google Scholar 

  11. 11.

    Singhal D, Kumar N, Puliyel JM, Singh SK, Srinivas V. Prediction of mortality by application of PRISM score in intensive care unit. Indian Pediatr. 2001;38:714–9.

    CAS  PubMed  Google Scholar 

  12. 12.

    Martinot A, Grandbastien B, Leclerc F. Performance of the Pediatric Risk of Mortality Score. Crit Care Med. 1997;25:716–7.

    CAS  Article  PubMed  Google Scholar 

  13. 13.

    Pollack MM, Ruttimann UE, Getson PR. Pediatric risk of mortality (PRISM) score. Crit Care Med. 1988;16:1110–6.

    CAS  Article  PubMed  Google Scholar 

  14. 14.

    Shann F, Pearson G, Slater A, Wilkinson K. Paediatric index of mortality (PIM): a mortality prediction model for children in intensive care. Intensive Care Med. 1997;23:201–7.

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Parshuram CS, Hutchison J, Middaugh K. Development and initial validation of the Bedside Paediatric Early Warning System score. Crit Care. 2009;13:R135.

    Article  PubMed  PubMed Central  Google Scholar 

  16. 16.

    Helbok R, Kendjo E, Issifou S, Lackner P, Newton CR, Kombila M, et al. The Lambarene Organ Dysfunction Score (LODS) is a simple clinical predictor of fatal malaria in African children. J Infect Dis. 2009;200:1834–41.

    Article  PubMed  Google Scholar 

  17. 17.

    von Seidlein L, Olaosebikan R, Hendriksen I, Lee S, Adedoyin O, Agbenyega T, et al. Predicting the clinical outcome of severe falciparum malaria in African children: findings from a large randomized trial. Clin Infect Dis. 2012;54:1080–90.

    Article  Google Scholar 

  18. 18.

    Riordan A, Marzouk O, Thomson A, Sills J, Hart A. Prospective validation of the Glasgow meningococcal septicaemia prognostic score. Comparison with other scoring methods. Eur J Pediatr. 2002;161:531–7.

    Article  PubMed  Google Scholar 

  19. 19.

    Barquet N, Domingo P, Caylà JA, González J, Rodrigo C, Fernández-Viladrich P, et al. Prognostic factors in meningococcal disease. Development of a bedside predictive model and scoring system. Barcelona Meningococcal Disease Surveillance Group. JAMA. 1997;278:491–6.

    CAS  Article  PubMed  Google Scholar 

  20. 20.

    Maitland K, Kiguli S, Opoka R, Engoru C, Olupot-Olupot P, Akech S, et al. Mortality after fluid bolus in African children with severe infection. New Engl J Med. 2011;364:2483–95.

    CAS  Article  PubMed  Google Scholar 

  21. 21.

    Gove S, Tamburlini G, Molyneux E, Whitesell P, Campbell H. Development and technical basis of simplified guidelines for emergency triage assessment and treatment in developing countries. WHO Integrated Management of Childhood Illness (IMCI) Referral Care Project. Arch Dis Child. 1999;81:473–7.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  22. 22.

    Kiguli S, Maitland K, George EC, Olupot-Olupot P, Opoka RO, Engoru C, et al. Anaemia and blood transfusion in African children presenting to hospital with severe febrile illness. BMC Med. 2015;13:21.

    Article  PubMed  PubMed Central  Google Scholar 

  23. 23.

    Scott A, Bauni E, Moisi J, Ojal J, Gatakaa H, Nyundo C, et al. Profile: The Kilifi Health and Demographic Surveillance System (KHDSS). Int J Epidemiol. 2012;41:650–7.

    Article  PubMed  PubMed Central  Google Scholar 

  24. 24.

    Goddard JM. Pediatric risk of mortality scoring overestimates severity of illness in infants. Crit Care Med. 1992;20:1662–5.

    CAS  Article  PubMed  Google Scholar 

  25. 25.

    Wells M, Riera-Fanego JF, Luyt DK, Dance M, Lipman J. Poor discriminatory performance of the Pediatric Risk of Mortality (PRISM) score in a South African intensive care unit. Crit Care Med. 1996;24:1507–13.

    CAS  Article  PubMed  Google Scholar 

  26. 26.

    Gemke RJ, Bonsel GJ, van Vught AJ. Effectiveness and efficiency of a Dutch pediatric intensive care unit: validity and application of the Pediatric Risk of Mortality score. Crit Care Med. 1994;22:1477–84.

    CAS  Article  PubMed  Google Scholar 

  27. 27.

    Pollack MM, Patel KM, Ruttimann UE. PRISM III: an updated Pediatric Risk of Mortality score. Crit Care Med. 1996;24:743–52.

    CAS  Article  PubMed  Google Scholar 

  28. 28.

    Gérardin P, Rogier C, Leteurtre S, Jouvencel P, Ka AS, Imbert P. Evaluation of Pediatric Risk of Mortality (PRISM) scoring in African children with falciparum malaria. Pediatr Crit Care Med. 2006;7:45–7.

    Article  PubMed  Google Scholar 

  29. 29.

    Dondorp A, Fanello C, Hendriksen I, Gomes E, Seni A, Chhaganlal K, et al. Artesunate versus quinine in the treatment of severe falciparum malaria in African children (AQUAMAT): an open-label, randomised trial. Lancet. 2010;376:1647–57.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  30. 30.

    Conroy A, Hawkes M, Hayford K, Namasopo S, Opoka R, John C, et al. Prospective validation of pediatric disease severity scores to predict mortality in Ugandan children presenting with malaria and non-malaria febrile illness. Crit Care. 2015;19:47.

    Article  PubMed  PubMed Central  Google Scholar 

  31. 31.

    Berkley JA, Ross A, Mwangi I, Osier FH, Mohammed M, Shebbe M, et al. Prognostic indicators of early and late death in children admitted to district hospital in Kenya: cohort study. BMJ. 2003;326:361.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  32. 32.

    Royston P, Moons K, Altman D, Vergouwe Y. Prognosis and prognostic research: developing a prognostic model. BMJ. 2009;338:b604.

    Article  PubMed  Google Scholar 

  33. 33.

    Harrell FE, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361–87.

    Article  PubMed  Google Scholar 

  34. 34.

    Royston P, Altman DG. Regression using fractional polynomials of continuous covariates: Parsimonious parametric modelling. Applied Statistics. 1994;43:429–67.

    Article  Google Scholar 

  35. 35.

    Pencina M, D'Agostino Sr RB, D'Agostino Jr RB, Vasan R. Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.

    Article  PubMed  Google Scholar 

  36. 36.

    Hosmer DW, Lemeshow S. Applied logistic regression. Chichester: John Wiley and Sons; 1989.

    Google Scholar 

  37. 37.

    White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011;30:377–99.

    Article  PubMed  Google Scholar 

  38. 38.

    Db R. Multiple imputation for non-response in surveys. Chichester: Wiley; 1987.

    Google Scholar 

  39. 39.

    Vergouwe Y, Royston P, Moons K, Altman D. Development and validation of a prediction model with missing predictor data: a practical approach. J Clin Epidemiol. 2010;63:205–14.

    Article  PubMed  Google Scholar 

  40. 40.

    Altman D, Vergouwe Y, Royston P, Moons K. Prognosis and prognostic research: validating a prognostic model. BMJ. 2009;338:b605.

    Article  PubMed  Google Scholar 

  41. 41.

    Berkley J, Bejon P, Mwangi T, Gwer S, Maitland K, Williams T, et al. HIV infection, malnutrition, and invasive bacterial infection among children with severe malaria. Clin Infect Dis. 2009;49:336–43.

    Article  PubMed  PubMed Central  Google Scholar 

  42. 42.

    Koram KA, Molyneux ME. When is "malaria" malaria? The different burdens of malaria infection, malaria disease, and malaria-like illnesses. Am J Trop Med Hyg. 2007;77:1–5.

    CAS  PubMed  Google Scholar 

  43. 43.

    Reyburn H, Mbatia R, Drakeley C, Carneiro I, Mwakasungula E, Mwerinde O, et al. Overdiagnosis of malaria in patients with severe febrile illness in Tanzania: a prospective study. BMJ. 2004;329:1212.

    Article  PubMed  PubMed Central  Google Scholar 

  44. 44.

    Singer M. Mitochondrial function in sepsis: acute phase versus multiple organ failure. Crit Care Med. 2007;35:S441–8.

    CAS  Article  PubMed  Google Scholar 

  45. 45.

    Weiskopf RB, Viele MK, Feiner J, Kelley S, Lieberman J, Noorani M, et al. Human cardiovascular and metabolic response to acute, severe isovolemic anemia. JAMA. 1998;279:217–21.

    CAS  Article  PubMed  Google Scholar 

  46. 46.

    Nadjm B, Amos B, Mtove G, Ostermann J, Chonya S, Wangai H, et al. WHO guidelines for antimicrobial treatment in children admitted to hospital in an area of intense Plasmodium falciparum transmission: prospective study. BMJ. 2010;340:c1350.

    Article  PubMed  PubMed Central  Google Scholar 

  47. 47.

    Reddy E, Shaw A, Crump J. Community-acquired bloodstream infections in Africa: a systematic review and meta-analysis. Lancet Infect Dis. 2010;10:417–32.

    Article  PubMed  PubMed Central  Google Scholar 

  48. 48.

    Mwaniki M, Nokes J, Ignas J, Munywoki P, Ngama M, Newton CR, et al. Emergency triage assessment for hypoxaemia in neonates and young children in a Kenyan hospital: an observational study. Bull World Health Organ. 2009;87:263–70.

    Article  PubMed  PubMed Central  Google Scholar 

  49. 49.

    Banajeh SM. Outcome for children under 5 years hospitalized with severe acute lower respiratory tract infections in Yemen: a 5 year experience. J Trop Pediatr. 1998;44:343–6.

    CAS  Article  PubMed  Google Scholar 

  50. 50.

    Brewster D. African fluid bolus study: implications for practice. J Paediatr Child Health. 2012;48:548–50.

    Article  PubMed  Google Scholar 

  51. 51.

    Myburgh J. Fluid resuscitation in acute illness--time to reappraise the basics. N Engl J Med. 2011;364:2543–4.

    CAS  Article  PubMed  Google Scholar 

  52. 52.

    Berkley J, Mwangi I, Griffiths K, Ahmed I, Mithwani S, English M, et al. Assessment of severe malnutrition among hospitalized children in rural Kenya: comparison of weight for height and mid upper arm circumference. JAMA. 2005;294:591–7.

    CAS  Article  PubMed  Google Scholar 

Download references

Acknowledgements

The FEAST trial was supported by a grant (G0801439) from the Medical Research Council, United Kingdom provided through the (MRC) DFID concordat. Baxter Healthcare donated the resuscitation fluids. The funders (Medical Research Council) and Baxter Healthcare Sciences had no role in the design of this study, data collection and analysis, decision to publish, or preparation of the manuscript. We thank the FEAST trial management group, the investigators at all sites, and all members of the trial steering, monitoring and review committees. Particular thanks are due to the children and families who participated in the FEAST trial.

Author information

Affiliations

  1. Medical Research Council Clinical Trials Unit (MRC CTU) at UCL, London, UK

    Elizabeth C. George, A. Sarah Walker, Jane Crawley, Diana M. Gibb & Abdel G. Babiker

  2. Department of Paediatrics, Mulago Hospital, Makerere University, Kampala, Uganda

    Sarah Kiguli & Robert O. Opoka

  3. Department of Paediatrics, Mbale Regional Referral Hospital, Mbale, Uganda

    Peter Olupot-Olupot

  4. Department of Paediatrics, Soroti Regional Referral Hospital, Soroti, Uganda

    Charles Engoru

  5. Kilifi Clinical Trials Facility, KEMRI-Wellcome Trust Research Programme, Kilifi, Kenya

    Samuel O. Akech, James A. Berkley, Ayub Mpoya & Kathryn Maitland

  6. Department of Paediatrics, St Mary’s Hospital, Lacor, Uganda

    Richard Nyeko

  7. Department of Paediatrics, Joint Malaria Programme, Teule Hospital, Muheza, Tanzania

    George Mtove & Hugh Reyburn

  8. Wellcome Trust Centre for Clinical Tropical Medicine and Department of Paediatrics, Faculty of Medicine, Imperial College, London, UK

    Michael Levin & Kathryn Maitland

  9. Centre for Tropical Medicine and Global Health, Nuffield Department of Medicine, University of Oxford, Oxford, UK

    Jane Crawley

Authors
  1. Elizabeth C. George
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. Sarah Walker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sarah Kiguli
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peter Olupot-Olupot
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Robert O. Opoka
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Charles Engoru
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Samuel O. Akech
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Richard Nyeko
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. George Mtove
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Hugh Reyburn
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. James A. Berkley
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Ayub Mpoya
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Michael Levin
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Jane Crawley
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Diana M. Gibb
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Kathryn Maitland
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Abdel G. Babiker
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elizabeth C. George.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

ECG, ASW, AGB, and KM wrote the paper. ASW, PO-O, ROO, CE, SA, RN, GM, HR, ML, JB, AM, AGB, and DMG commented on the manuscript and approved the final version. All authors contributed to the design of the study. AM, JB, SK, KM, PO-O, ROO, CE, SA, RN, GM, and HR participated in data collection. ECG, ASW, and AGB performed the statistical analyses. All authors read and approved the final manuscript.

Additional file

Additional file 1:

Supplementary Tables and Figures.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

George, E.C., Walker, A.S., Kiguli, S. et al. Predicting mortality in sick African children: the FEAST Paediatric Emergency Triage (PET) Score. BMC Med 13, 174 (2015). https://doi.org/10.1186/s12916-015-0407-3

Download citation

Keywords

  • Africa
  • Children
  • FEAST trial
  • Mortality
  • Risk score

BMC Medicine

ISSN: 1741-7015

Contact us