- Open Access
- Open Peer Review
Hospital Mortality – a neglected but rich source of information supporting the transition to higher quality health systems in low and middle income countries
BMC Medicinevolume 16, Article number: 32 (2018)
There is increasing focus on the strength of primary health care systems in low and middle-income countries (LMIC). There are important roles for higher quality district hospital care within these systems. These hospitals are also sources of information of considerable importance to health systems, but this role, as with the wider roles of district hospitals, has been neglected.
As we make efforts to develop higher quality health systems in LMIC we highlight the critical importance of district hospitals focusing here on how data on hospital mortality offers value: i) in understanding disease burden; ii) as part of surveillance and impact monitoring; iii) as an entry point to exploring system failures; and iv) as a lens to examine variability in health system performance and possibly as a measure of health system quality in its own right. However, attention needs paying to improving data quality by addressing reporting gaps and cause of death reporting. Ideally enabling the collection of basic, standardised patient level data might support at least simple case-mix and case-severity adjustment helping us understand variation. Better mortality data could support impact evaluation, benchmarking, exploration of links between health system inputs and outcomes and critical scrutiny of geographic variation in quality and outcomes of care. Improved hospital information is a neglected but broadly valuable public good.
Accurate, complete and timely hospital mortality reporting is a key attribute of a functioning health system. It can support countries’ efforts to transition to higher quality health systems in LMIC enabling national and local advocacy, accountability and action.
“An urgent appeal for adopting…some uniform system of publishing the statistical records of hospitals. If they could be obtained…they would show subscribers how their money was being spent, what amount of good was really being done with it, or whether the money was doing mischief rather than good.” (Attributed to Florence Nightingale, 1863)
The desire for better health statistics is not new. With 2030 defined as the next major global health horizon the majority of targets and indicators related to the 3rd Sustainable Development Goal (SDG3, ‘Ensure healthy lives and promote well-being for all at all ages’) require an ability to measure population health status . We expect a national health information system (HIS) to furnish such measurement. Indeed, Abou-Zahr et al. suggest the HIS should address the following domains : health determinants (socioeconomic, environmental, behavioural and genetic factors); inputs to the health system including health infrastructure, facilities and human and financial resources; health outcomes (mortality, morbidity, disability, well-being, disease outbreaks and health status); and inequities in determinants, coverage and use of services, and outcomes. Here we focus on one specific level of the primary health care system and value of the information it can yield.
There is no universally agreed definition of a hospital . For the purposes of this report we are most concerned with facilities that should provide inpatient and ambulatory care to populations at district or regional levels (hereafter referred to just as district hospitals). In larger district hospitals (likely to have a total of 80 inpatient beds and often many more) norms and standards in low and middle-income countries (LMIC) often aspire to have services led by at least one obstetrician, paediatrician, physician and surgeon supported by basic laboratory and imaging diagnostic resources. Such facilities are often also centres providing experiential training to multiple health worker cadres. The Alma Ata Declaration clearly states that these facilities are a critical part of the primary health care system . We argue they could and should offer valuable insights on health system needs and performance. Yet their role has largely been ignored for many years. As the SDGs focus attention on reinvigorating primary health care efforts must include understanding and strengthening district hospitals as part of these systems.
It is a fundamental attribute of a health system that it can report hospital mortality accurately. We argue that such reporting and its quality is neglected despite seeming a much more achievable measurement goal than many others. While there is a need for much more research on how future district hospitals can support primary health care goals of universal coverage we focus specifically here on the value of better hospital mortality data as an immediate concern: i) in understanding disease burden, ii) as part of surveillance and impact monitoring, iii) as an entry point to exploring system failures, and iv) as a possible measure of health system quality in its own right. We present these arguments below illustrating them with data from the Kenyan health system where appropriate.
Hospital mortality as a window on burden of disease
A decade ago it was suggested that absence of reliable data for births, deaths, and causes of death contributes to a ‘scandal of invisibility, which renders most of the world’s poor as unseen, uncountable, and hence uncounted’ . Death registration is worst in African and Asian regions . Thus, we continue to rely on sparse data from a small number of population-based studies that employ verbal autopsy interviews with bereaved relatives about symptoms and signs to attribute these to a specific cause. These data are then modelled and interpolated in time and space to provide an estimate of cause-specific mortality for every year since 1980 in every country . These estimates have been important for disease burden estimation and global priority setting providing at least some estimates for the number of deaths attributable to specific causes in many low-income countries. Yet, they are often based on limited or no suitable local data and have wide confidence intervals. This seems inappropriate as we approach the third decade of the twenty-first century [8, 9].
Better reporting of cause-specific hospital mortality is a major missed opportunity to dramatically increase the availability of cause of death data. Although we need to recognised the potential bias in these data, related to the proportion of the population with access to hospital care, cause of death reporting from hospitals where individual cases can be reviewed by trained health-workers with access to diagnostic procedures should be more accurate and timely than data derived from interview responses with bereaved family members – and of course professionally determined cause of death data are the norm in in high income countries. Hospital data are also available for many more sites and time points across LMIC than those from population-based, verbal autopsy surveys (and see Fig. 1). We should be using such data in national policy and planning and to triangulate, calibrate or pressure test model predictions of the frequency or trends in cause-specific mortality. High quality hospital cause of death data should also be allied with improved routine civil registration and vital status. Together these would make a major contribution to our local understanding of disease burden and its variation and be an important advocacy tool helping to prioritise resource allocation. Improved hospital data will become especially important as many LMIC enter the epidemiologic transition providing opportunities for extended time series analyses that would be highly informative.
Taking advantage of what should be readily accessible cause of death information will require us to make efforts to promote its accuracy. This will require better training for health workers who document diagnoses and cause of death in most routine settings . Inadequate investments in information systems generally and in this area specifically are one reason why external assessments of the accuracy of hospital cause of death data in LMIC suggest it can be poor [11, 12] and incomplete . Illustrating this we display in Box 1 the frequency of missing data on hospital mortality from 272 public hospitals in Kenya , with data missing for an entire 12 months on surgical admissions and outcomes in over 200 hospitals. Yet addressing these challenges is arguably more tractable in the long-run than increasing coverage with sophisticated verbal autopsy approaches to determine cause of death in dedicated demographic surveillance systems. Enabling countries to generate quality health information at national and sub-national levels in the same way that high income countries do is also clearly preferable to a future that continues to rely on modelling, and the uncertain estimates it produces, to understand local disease burdens (Fig. 2).
Hospital mortality – value in surveillance and impact evaluation
Tracking specific hospital mortality events is an important element of Integrated Disease Surveillance and Response (IDSR)  with hospitals in many LMIC expected to report both the frequency of priority illnesses and their outcome. Thus, an increase in deaths associated with characteristic features of meningitis, Cholera or Ebola may signal the onset of an outbreak or epidemic of national (or even international) importance [16, 17]. Such tracking may extend to syndromic surveillance. For example, for severe acute respiratory syndrome (SARS) a rapid rise in cases and case fatality may be an important signal. Good hospital mortality data may also be key to monitoring the quality and coverage of routine health programs. Deaths due to illness such as neonatal tetanus may signal the failure of vaccination efforts, deaths attributable to malaria and TB to deficiencies in specific programmes [18, 19]. Both could signal important regional differences . Increasingly mortality data may also be a key part of national disease registries (eg. for trauma or cancers) that inform long-term planning and monitoring of outcomes .
For specific conditions hospital mortality data has been used to evaluate the quality of service provision too. For example, to track efforts to improve outcomes after acute myocardial infarction in high income settings  while perioperative mortality is proposed as a key indicator of quality of surgical services in LMIC . Recent studies also suggest that good quality data on hospital mortality may support evaluation of large-scale quality improvement (QI) programmes in LMIC. The ‘Project Fives Alive!’ in Ghana employed a strategy to improve maternal and child health outcomes using a QI methodology to recognize barriers to care-seeking and care provision at the facility level and then to identify, test and implement simple and low-cost local solutions that addressed these barriers. In the impact evaluation, the intensity of the QI activity was associated with a reduction in hospital mortality for those aged 0 – 59 months. However, the strength of these conclusions was undermined by the fact that 43% of data on hospital outcomes were missing [24, 25]. Most recently a multilateral partnership supporting work in nine LMIC was initiated with an aim of reducing in-facility maternal and neonatal mortality by 50% . The health impact of such investments will remain a matter of conjecture without accurate mortality data from multiple facilities over prolonged periods. Greater coordination of effort and investment by all parties to improve hospital mortality data that can serve the needs of multiple programmes would also help create data as a broader public good.
Hospital mortality and system failure
Striking headlines suggest up to one third of deaths in the USA are attributable to medical errors although this is probably a gross overestimate [27, 28]. Despite differences of opinion on headline figures there is agreement that there is considerable scope to improve quality and safety even in high income settings . But, is mortality a good measure of the quality of a hospital’s care? This question is much debated and we return to it below. However, it is now widely felt that appropriately structured and detailed analyses of individual inpatient deaths that identify deficiencies and errors in care can contribute to improvements in quality and safety of health systems [30, 31]. Examination of maternal deaths has been used for over 50 years in higher income countries and has profoundly influenced policy and practice at multiple levels of the health system . This approach is strongly promoted in LMIC through programmes focused on maternal (and more recently perinatal) death reviews . However, implementation remains patchy and impacts uncertain. In South Africa systems have been developed to examine deaths of children in hospitals and identify the nature and prevalence of factors that could be modified to reduce mortality . Now operating at considerable scale reports suggest information aggregated across multiple facilities is influencing policy and resource allocation aimed at improving services equitably . Case based investigation of hospital mortality that spans examination of pathways to care may thus be a form of ‘system diagnostic’ that is directly useful for local quality improvement and useful well beyond the hospital to support advocacy and accountability .
Aggregate or service specific hospital mortality data may also raise flags over system failure. Identification of persistently high adult inpatient mortality in one United Kingdom hospital and of high mortality following paediatric cardiac surgery in another triggered national enquiries that reported major failings in clinical and management processes that had implications for the whole health sector . As LMIC introduce more specialist (and often expensive) forms of intervention delivered through its hospitals attention should be paid to accurate and transparent reporting of mortality. For example, Kenya has recently made major investments in equipment to support the provision of intensive care and renal replacement therapy. Careful scrutiny of the outcomes of such services should be an important part of examining the value of these investments while also seeking to identify where systems need to be strengthened . While it remains challenging to compare hospitals’ mortality rates fairly (see below) even basic data may begin to prompt engagement of policy makers, managers and practitioners in a process of exploring reasons for variability helping direct action to improve services [38,39,40]. However, it is clearly important that there are sufficient, high quality data to support such a process of inquiry [41, 42]. To illustrate how relatively simple visual representations of hospital mortality data might engage multiple stakeholders to discuss and explore the reasons for variability we use empiric and simulated data on inpatient child mortality from Kenyan hospitals in Box 2 (Fig. 3).
Hospital mortality as a measure of the quality of care
Can comparison of mortality rates across hospitals provide information on the quality of care provided? This question remains highly contentious. Clearly mortality may be affected by the mix of cases included in the population in which mortality is measured (case-mix) and a range of other, potential risk factors such as a patient’s age or stage of disease (case-severity) [41,42,43]. To correct for these factors that vary at the individual patient level some high-income countries employ sophisticated adjustment approaches. A number of hospital mortality measures are used in high-income countries and are recommended by Organisation for Economic Co-operation and Development (OECD) and national governments as part of portfolios of quality indicators and there is little doubt such measures (and the debate around them) have directed nations’ attention to improving quality and outcomes. Examples include the UK’s Summary Hospital Mortality Index or Medicare’s more disease specific acute myocardial infarction 30-day mortality rate that are both used as indicators of hospital performance.
So, could specific hospital mortality data be useful in gauging the quality of health care and health systems in LMIC? Two such measures are already part of WHO’s 100 Core Indicators for global tracking and comparison, peri-operative mortality and institutional maternal mortality rates. These, and other measures may be useful for three reasons: a) for benchmarking particularly in conditions where case-specific mortality may be informative, b) for examining the relationship between hospital mortality and variation in health system inputs, and c) for contrasting mortality across hospitals with high workloads in situations where mortality may be sensitive to the quality of care delivered.
Benchmarking against peers (as in Box 2) or a proposed standard may provide useful insights. For example, gestation specific neonatal mortality rates have been used to drive system improvements with the best performers potentially providing an aspirational standard while cross-hospital analyses have informed the organisation of services in high income settings [44, 45]. Another example pertinent to LMIC is that the World Health Organisation suggests that inpatient mortality from complicated severe acute malnutrition in children can be reduced to less than 5% . Where mortality from this condition is much higher it may suggest inadequacies in the overall health system and hospital response to this condition  providing the motivation to identify and tackle the reasons for poor outcomes.
Examining relationships between specific inputs and outcomes
More broadly, mortality data may be used to examine whether improving health system inputs influences outcomes. In high income settings, for example, variations in workforce capacity have been shown to influence both process measures of quality and hospital mortality . In the case of severe childhood anaemia, an important cause of mortality in many African countries often attributable to malaria, failure to initiate blood transfusion on the day a clinician requests it has been associated with an 80% increase in the odds of hospital death . In Papua New Guinea reductions in hospital mortality were seen after efforts to improve the provision and use of oxygen for childhood pneumonia .
Inpatient mortality as a possible measure of the overall quality of hospital care
Above we alluded to the fact that mortality proportions need to be interpreted with great care as variation in the case-mix or illness severity at hospital presentation have a major influence on observed mortality rates even after efforts at statistical adjustment [41, 51, 52]. One key concern is that hospital mortality is a poor overall metric of quality because such a small fraction of deaths are likely to be sensitive to changes in quality of within hospital care [29, 42]. However, two features of LMIC hospitals suggest that examining specific mortality rates may be more informative. Firstly, in some hospital departments only a few serious illnesses may be responsible for the majority of deaths. For example, small numbers of conditions are felt to account for over 60% of paediatric deaths . In well-defined populations case-mix differences may be reduced offering some prospect of effective adjustment . Secondly, although we have only few reports, it seems likely that many more deaths in LMIC hospitals might be sensitive to differences in quality of in-hospital care. Thus improvements in care at the time of delivery resulted in a 15% reduction in maternal mortality in one large study  and over 40% of hospital deaths of children in South Africa are thought potentially avoidable . The possible use of hospital mortality data from specific populations as one indicator of the quality of hospital care in LMIC would however, depend on the availability of high quality individual level data from facilities with at least moderately high inpatient workloads (see Box 2). At least in one clinical arena recent research suggests obtaining better quality routine data on individual cases might be possible if simple standardised record forms are introduced  and could be facilitated by emerging efforts to implement electronic medical records at scale . In Fig. 4 we present in slightly more detail a hypothetical case for why cause or group specific mortality may be a more sensitive indicator of the quality of hospital care in LMIC than it is in high income countries.
In an era when even those in rural areas of LMIC have increasing access to digital tools that support their communication and business needs it seems a major paradox that countries are unable to count and characterise deaths in hospitals. Accurate, complete and timely hospital mortality reporting would seem a basic indicator of a quality health system. As access to care expands, better hospital mortality data should offer a granular picture of the burden of disease in a given geography taken together with reporting of all deaths through vital status reporting. It can therefore support advocacy based on population needs and promote equity by highlighting regional variation. More detailed examination of mortality rates, or for selected cases all the events leading up to death, can be important tools to identify system failings. Hospitals themselves, and most importantly their patients, may benefit from benchmarking mortality rates with peers or against aspirational standards to drive local action. In some cases, specific hospital mortality rates may offer a global metric of health care quality in settings where the potential for improvement is large.
The scale of the challenge to improve mortality reporting from at least larger hospitals within LMIC seems, in principle, less daunting than the challenge of implementing the large number of global indicators being discussed as part of efforts to track and improve quality of care. As we seek to strengthen primary health care systems we must not neglect district hospitals as have done in the past. As one first step we believe efforts must be made to improve analysis of hospital mortality data (and suggest specific initial steps in Box 3). These data are a potentially rich source of information supporting the transition to higher quality health systems in LMIC and taking advantage of available technologies can increase the speed with which we can use data for advocacy, accountability and action.
District Health Information System
Integrated Disease Surveillance and Response
Low and Middle Income Countries
Organisation for Economic Co-operation and Development
Severe Acute Respiratory Syndrome
Sustainable Development Goals
The SustaInable Development Goals [http://www.un.org/sustainabledevelopment/sustainable-development-goals/]. Accessed 31 Oct 2017.
AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bull World Health Organ. 2005;83(8):578–83.
English M, Lanata C, Ngugi I, Smith PC. The District Hospital. In: Jamison D, Alleyne G, Breman J, Claeson M, Evans D, Jha P, Mills A, Measham A, editors. Disease Control Priorities in Developing Countries - 2nd Edition. Washington DC: World Bank; 2006. p. 1211–28.
World Health Organisation. Declaration of Alma-Ata, International Conference on Primary Health Care. Geneva: World Health Organisation; 1978.
Setel PW, Macfarlane SB, Szreter S, Mikkelsen L, Jha P, Stout S, AbouZahr C, group MoVEw. A scandal of invisibility: making everyone count by counting everyone. Lancet. 2007;370(9598):1569–77.
Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, Lopez AD. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. Lancet. 2015;386(10001):1395–406.
Abajobir AA, Abbafati C, Abbas KM, Abd-Allah F, Abera SF, Aboyans V, Adetokunboh O, Afshin A, Agrawal A, Ahmadi A, et al. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 390(10100):1151–210.
GBD 2015 Mortality and Causes of Death Collaborators. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980-2015: a systematic analysis for the Global Burden of Disease Study 2015. The Lancet. 2016;388(10053):1459–1544.
Snow RW. Sixty years trying to define the malaria burden in Africa: have we made any progress? BMC Med. 2014;12(1):227.
Data for Health [https://www.bloomberg.org/program/public-health/data-health/].
Rampatige R, Mikkelsen L, Hernandez B, Riley I, Lopez AD. Systematic review of statistics on causes of deaths in hospitals: strengthening the evidence for policy-makers. Bull World Health Organ. 2014;92(11):807–16.
Rampatige R, Mikkelsen L, Hernandez B, Riley I, Lopez AD. Hospital cause-of-death statistics: what should we make of them? Bull World Health Organ. 2014;92(1):3–3A.
Kihuba E, Gathara D, Mwinga S, Mulaku M, Kosgei R, Mogoa W, Nyamai R, English M. Assessing the ability of health information systems in hospitals to support evidence-informed decisions in Kenya. Global Health Action. 2014;7. https://doi.org/10.3402/gha.v7.24859.
Health Facility Master List [http://kmhfl.health.go.ke/#/home]. Accessed 31 Oct 2017.
Integrated Disease Surveillance and Response [http://www.who.int/countries/eth/areas/surveillance/en/]. Accessed 31 Oct 2017.
Integrated Disease Surveillance and Response [https://www.cdc.gov/globalhealth/healthprotection/idsr/about.html]. Accessed 31 Oct 2017.
Lingani C, Bergeron-Caron C, Stuart JM, Fernandez K, Djingarey MH, Ronveaux O, Schnitzler JC, Perea WA. Meningococcal Meningitis Surveillance in the African Meningitis Belt, 2004–2013. Clin Infect Dis. 2015;61(Suppl 5):S410–5.
Immunization, Vaccines and Biologicals - Tetanus [http://www.who.int/immunization/monitoring_surveillance/burden/vpd/surveillance_type/passive/tetanus/en/]. Accessed 31 Oct 2017.
100 Core Health Indicators [http://www.who.int/healthinfo/indicators/2015/en/]. Accessed 31 Oct 2017.
Ayieko P, Ogero M, Makone B, Julius T, Mbevi G, Nyachiro W, Nyamai R, Were F, Githanga D, Irimu G, et al. Characteristics of admissions and variations in the use of basic investigations, treatments and outcomes in Kenyan hospitals within a new Clinical Information Network. Arch Dis Child. 2016;101(3):223–9.
African Cancer Registry Network [http://afcrn.org/about-us]. Accessed 31 Oct 2017.
Smolina K, Wright FL, Rayner M, Goldacre MJ. Determinants of the decline in mortality from acute myocardial infarction in England between 2002 and 2010: linked national database study. BMJ. 2012;344:d8059.
Global Indicator Initiative [http://www.lancetglobalsurgery.org/indicators]. Accessed 31 Oct 2017.
Singh K, Brodish P, Speizer I, Barker P, Amenga-Etego I, Dasoberi I, Kanyoke E, Boadu EA, Yabang E, Sodzi-Tettey S. Can a quality improvement project impact maternal and child health outcomes at scale in northern Ghana? Health Res Policy Syst. 2016;14:45.
Singh K, Speizer I, Handa S, Boadu RO, Atinbire S, Barker PM, Twum-Danso NAY. Impact evaluation of a quality improvement intervention on maternal and child health outcomes in Northern Ghana: early assessment of a national scale-up project. Int J Qual Health Care. 2013;25(5):477–87.
What is the Quality of Care Network? [http://www.who.int/maternal_child_adolescent/topics/quality-of-care/network/en/]. Accessed 31 Oct 2017.
Makary MA, Daniel M. Medical error-the third leading cause of death in the US. BMJ. 2016;353:i2139.
Shojania KG, Dixon-Woods M. Estimating deaths due to medical error: the ongoing controversy and why it matters. BMJ Qual Saf. 2016: https://doi.org/10.1136/bmjqs-2016-006144.
Shojania KG, Dixon-Woods M. Estimating preventable hospital deaths: the authors reply. BMJ Qual Saf. 2017: https://doi.org/10.1136/bmjqs-2016-006341.
Higginson J, Walters R, Fulop N. Mortality and morbidity meetings: an untapped resource for improving the governance of patient safety? BMJ Qual Saf. 2012: https://doi.org/10.1136/bmjqs-2011-000603.
Kerber KJ, Mathai M, Lewis G, Flenady V, Erwich JJH, Segun T, Aliganyira P, Abdelmegeid A, Allanson E, Roos N. Counting every stillbirth and neonatal death through mortality audit to improve quality of care for every pregnant woman and her baby. BMC Pregnancy Childbirth. 2015;15(2):1.
Kurinczuk J, Draper E, Field D, Bevan C, Brocklehurst P, Gray R, Kenyon S, Manktelow B, Neilson J, Redshaw M. Experiences with maternal and perinatal death reviews in the UK—the MBRRACE-UK programme. BJOG. 2014;121(s4):41–6.
Maternal Death Surveillance and Response (MDSR) [http://www.who.int/maternal_child_adolescent/epidemiology/maternal-death-surveillance/en/]. Accessed 31 Oct 2017.
Group SAEDCW. Every death counts: use of mortality audit data for decision making to save the lives of mothers, babies, and children in South Africa. Lancet. 2008;371(9620):1294–304.
Font F, Quinto L, Masanja H, Nathan R, Ascaso C, Menendez C, Tanner M, Schellenberg JA, Alonso P. Paediatric referrals in rural Tanzania: the Kilombero District Study – a case series. BMC Int Health Hum Rights. 2002;2(1):4.
Dixon-Woods M, Yeung K, Bosk CL. Why is UK medicine no longer a self-regulating profession? The role of scandals involving “bad apple” doctors. Soc Sci Med. 2011;73(10):1452–9.
Munya W. Many counties yet to receive medical equipment. In: The Daily Nation. Kenya: Nation Media Group; 2016. [http://www.nation.co.ke/news/The-intrigues-behind-Sh38bn-county-medical-equipment-deal-/1056-3019626-ldx1xrz/index.html].
Spiegelhalter D. Funnel plots for institutional comparison. Qual Saf Health Care. 2002;11(4):390.
Ghaferi AA, Birkmeyer JD, Dimick JB. Variation in hospital mortality associated with inpatient surgery. N Engl J Med. 2009;361(14):1368–75.
Gathara D, Malla L, Ayieko P, Karuri S, Nyamai R, Irimu G, van Hensbroek MB, Allen E, English M. Variation in and risk factors for paediatric inpatient all-cause mortality in a low income setting: data from an emerging clinical information network. BMC Pediatr. 2017;17(1):99.
Bottle Alex, Jarman Brian, Aylin Paul. Strengths and weaknesses of hospital standardised mortality ratios. BMJ. 2011;342: https://doi.org/10.1136/bmj.c7116.
Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away. BMJ. 2010;340: https://doi.org/10.1136/bmj.c2016.
Marang-van de Mheen PJ, Shojania KG. Simpson's paradox: how performance measurement can fail even with perfect risk adjustment. BMJ Qual Saf. 2014;23(9):701.
Horbar JD, Edwards EM, Greenberg LT, et al. Variation in performance of neonatal intensive care units in the united states. JAMA Pediatr. 2017;171(3):e164396.
Gale C, Morris I. The UK National Neonatal Research Database: using neonatal data for research, quality improvement and more. Arch Dis Child Educ Pract Ed. 2016;101(4):216–8.
Maitland K, Berkely JA, Shebbe M, Peshu N, English M, Newton C. Children with Severe Malnutrition: Can Those at Highest Risk of Death Be Identified with the WHO Protocol? PLoS Med. 2006;3(12):e500.
Gathara D, Opiyo N, Wagai J, Ntoburi S, Opondo C, Ayieko P, Wamae A, Migiro S, Mogoa W, Were F, et al. Quality of hospital care for sick newborns and severely malnourished children in Kenya: A two year descriptive study in 8 hospitals. BMC Health Serv Res. 2011;11:307.
Aiken LH, Sloane D, Griffiths P, Rafferty AM, Bruyneel L, McHugh M, Maier CB, Moreno-Casbas T, Ball JE, Ausserhofer D: Nursing skill mix in European hospitals: cross-sectional study of the association with mortality, patient ratings, and quality of care. BMJ Qual Saf. 2016: https://doi.org/10.1136/bmjqs-2016-005567.
Thomas J, Ayieko P, Ogero M, Gachau S, Makone B, Nyachiro W, Mbevi G, Chepkirui M, Malla L, Oliwa J, et al. Blood Transfusion Delay and Outcome in County Hospitals in Kenya. Am J Trop Med Hyg. 2017;96(2):511–7.
Duke T, Wandi F, Jonathan M, Matai S, Kaupa M, Saavu M, Subhi R, Peel D. Improved oxygen systems for childhood pneumonia: a multihospital effectiveness study in Papua New Guinea. Lancet. 2008;372(9646):1328–33.
Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ. Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009;338:b780.
Aylin P, Bottle, A, Jarman, B. Standardised Mortality Ratios - Monitoring Mortality. British Medical Journal 2009;338:b1745
Dumont A, Fournier P, Abrahamowicz M, Traore M, Haddad S, Fraser WD. Quality of care, risk management, and technology in obstetrics to reduce hospital-based maternal mortality in Senegal and Mali (QUARITE): a cluster-randomised trial. Lancet. 2013;382(9887):146–57.
Patrick M, Stephen C. Child PIP: Making mortality meaningful by using a structured mortality review process to improve the quality of care that children receive in the South African health system. S Afr J Child Health. 2008;2(2):38–42.
Tuti T, Bitok M, Malla L, Paton C, Muinga N, Gathara D, Gachau S, Mbevi G, Nyachiro W, Ogero M et al: Improving documentation of clinical care within a clinical information network: an essential initial step in efforts to understand and improve care in Kenyan hospitals. BMJ Global Health. 2016;1(1)e000028. https://doi.org/10.1136/bmjgh-2016-000028.
Richards J, Douglas G, Fraser H. Perspectives on Global Public Health Informatics. In: Magnuson JA, Fu Jr PC, editors. Public Health Informatics and Information Systems. London: Springer-Verlag; 2014. p. 619–43.
The authors would like to acknowledge the help of the Ministry of Health, Division of Informatics and Prof. Peter Waiganjo for help in accessing DHIS2 data and the useful advice of colleagues from the Lancet Global Health Commission on High Quality Health Systems for the SDG era: Margaret Kruk, Tanya Marchant and Hannah Leslie. This paper is published with the permission of the Director of KEMRI.
ME is supported by a Wellcome Trust Senior Fellowship (#097170), EO is supported by the Wellcome Trust as an Intermediate Fellow (#201866); RWS is a Wellcome Trust Principal Fellow (# 103602); RWS is also grateful to the UK’s Department for International Development for their continued support to a project Strengthening the Use of Data for Malaria Decision Making in Africa (DFID Programme Code # 203155) that provided support to POO; POO acknowledges support under the IDeAL Project (#107769). All authors acknowledge the support from the Wellcome Trust to the Kenya Major Overseas Programme (# 203077). Those funding the authors had no role in writing any part of this manuscript.
Availability of data and materials
Data used to illustrate the availability of hospital mortality information in Kenyan hospitals were made available as part of a collaboration between the KEMRI-Wellcome Trust Research Programme and the Ministry of Health, Kenya. Those seeking similar data are requested to contact the Kenyan Ministry of Health.
Ethics approval and consent to participate
Not appropriate for this debate manuscript.
Consent for publication
Not appropriate for this debate manuscript.
KEMRI-Wellcome Trust Research Programme team members receive research funding for work on improvement of health services.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.