Benchmarking health system performance across regions in Uganda: a systematic analysis of levels and trends in key maternal and child health interventions, 1990–2011
BMC Medicine volume 13, Article number: 285 (2015)
Globally, countries are increasingly prioritizing the reduction of health inequalities and provision of universal health coverage. While national benchmarking has become more common, such work at subnational levels is rare. The timely and rigorous measurement of local levels and trends in key health interventions and outcomes is vital to identifying areas of progress and detecting early signs of stalled or declining health system performance. Previous studies have yet to provide a comprehensive assessment of Uganda’s maternal and child health (MCH) landscape at the subnational level.
By triangulating a number of different data sources – population censuses, household surveys, and administrative data – we generated regional estimates of 27 key MCH outcomes, interventions, and socioeconomic indicators from 1990 to 2011. After calculating source-specific estimates of intervention coverage, we used a two-step statistical model involving a mixed-effects linear model as an input to Gaussian process regression to produce regional-level trends. We also generated national-level estimates and constructed an indicator of overall intervention coverage based on the average of 11 high-priority interventions.
National estimates often veiled large differences in coverage levels and trends across Uganda’s regions. Under-5 mortality declined dramatically, from 163 deaths per 1,000 live births in 1990 to 85 deaths per 1,000 live births in 2011, but a large gap between Kampala and the rest of the country persisted. Uganda rapidly scaled up a subset of interventions across regions, including household ownership of insecticide-treated nets, receipt of artemisinin-based combination therapies among children under 5, and pentavalent immunization. Conversely, most regions saw minimal increases, if not actual declines, in the coverage of indicators that required multiple contacts with the health system, such as four or more antenatal care visits, three doses of oral polio vaccine, and two doses of intermittent preventive therapy during pregnancy. Some of the regions with the lowest levels of overall intervention coverage in 1990, such as North and West Nile, saw marked progress by 2011; nonetheless, sizeable disparities remained between Kampala and the rest of the country. Countrywide, overall coverage increased from 40 % in 1990 to 64 % in 2011, but coverage in 2011 ranged from 57 % to 70 % across regions.
The MCH landscape in Uganda has, for the most part, improved between 1990 and 2011. Subnational benchmarking quantified the persistence of geographic health inequalities and identified regions in need of additional health systems strengthening. The tracking and analysis of subnational health trends should be conducted regularly to better guide policy decisions and strengthen responsiveness to local health needs.
The measurement of population health outcomes and intervention coverage is a vital component of evaluating health systems performance . The allocation of resources by policymakers should be guided by evidence of gaps in coverage and opportunities to improve health outcomes. While national-level health indicators are commonly used for benchmarking and target setting, subnational coverage can be much more informative, revealing geographic variance and allowing decision-makers to tailor policies to local conditions . However, estimates of subnational levels and trends for health indicators are often unavailable in low-resource settings, largely due to data scarcity and insufficient health information systems .
Uganda has made marked progress in reducing under-5 mortality since 1990, which declined from 163 deaths per 1,000 live births in 1990 to 85 deaths per 1,000 live births in 2013 . While Uganda has witnessed a slight increase in maternal mortality since 1990, the country has experienced an annualized rate of decline of 3.2 % since its peak maternal mortality ratio of 475 deaths per 100,000 live births in 2001 . Despite these national-level trends, it is unknown whether the declines have been realized equally across subnational areas or to what extent geographic inequalities have changed over time. Subnational monitoring is critical for Uganda to maximize impact by targeting high-burden areas.
Over the last two decades, Uganda’s government has prioritized expanding health services across a number of key maternal and child health (MCH) interventions. Since 2002, distribution of insecticide-treated nets (ITNs) has substantially expanded , indoor residual spraying (IRS) has been implemented in select districts , and artemisinin-based combination therapies (ACTs) have been introduced as the first-line treatment for uncomplicated malaria since 2006 . The pentavalent vaccine replaced the original diphtheria-pertussis-tetanus formulation in 2002 , and Gavi, the Vaccine Alliance, has provided health systems strengthening and immunization services support (ISS) periodically since 2001 . The extent to which these efforts have resulted in improved intervention access and use throughout the country is unknown. Tracking local trends and generating sound subnational estimates of intervention coverage are vital components of evaluating the success of the implementation of policies and programs aiming to improve MCH services.
To date, few studies have benchmarked health systems performance at the subnational level in low-income countries. Several studies have addressed inequalities in intervention coverage but are generally restricted to comparisons by sex, urbanicity, or socioeconomic status [11–13]. Others have applied small-area techniques to estimating intervention coverage, but these studies have generally been limited to a subset of health indicators or to a restricted time range [14–16]. More recently, a study in Zambia assessed subnational health systems performance across a wide swathe of health indicators , but similarly comprehensive studies have not been conducted in Uganda. Previous work in Uganda includes the government’s annual district league tables, which rely on administrative records to rank districts . However, reporting through the Health Management Information System (HMIS) is often incomplete and inaccurate, and reliable denominator estimates are difficult to obtain . Other efforts using household surveys have been limited to using a single cross-sectional survey to estimate district-level child mortality in 2006 and underweight and obesity prevalence in 2011 [20, 21].
By systematically collating all available data, this study provides a comprehensive regional assessment of a broad range of MCH indicators and socioeconomic factors in Uganda from 1990 to 2011.
Data and indicator selection
We identified data sources for MCH indicators via in-country meetings with collaborators and relevant stakeholders. For this analysis, we used 17 household surveys and two population censuses (Table 1). While we identified administrative data sources including drug distribution from National Medical Stores, ITN distribution campaigns, and HMIS data, we excluded them from our analysis due to concerns about completeness and lack of reliable denominator information.
We included 20 MCH indicators that have previously been shown to be related to child survival  (Table 1): antenatal care (ANC, 1 and 4 visits); skilled birth attendance (SBA); immunization with the Bacillus Calmette-Guérin (BCG), measles, oral polio (three doses, OPV3), and pentavalent vaccines; exclusive breastfeeding (EBF); the receipt of at least two tetanus toxoid injections during pregnancy; reported use of oral rehydration salts for diarrhea; reported seeking of care at a health facility for children under 5 in response to suspected pneumonia; prevalence of childhood underweight and stunting; intermittent preventive therapy against malaria during pregnancy (IPTp, one and two doses); household ownership of ITNs; ITN use by children under 5; household receipt of IRS; the proportion of households that either owned at least one ITN or received IRS; the proportion of children under 5 who either slept under an ITN the night before the survey or lived in a household that received IRS; reported receipt of ACTs for children under 5 who had a fever in the last 2 weeks; and the proportion of ACT antimalarials prescribed for febrile children under 5. Additionally, we included seven socioeconomic covariates previously shown to be related to child health outcomes [23–26]: household size, female headship, electricity availability, improved wall type, improved sanitation, improved water source, and years of education for women aged 15–44. Due to data availability, we restricted our analysis to between 1990 and 2011.
We focus on the results For a subset of indicators in this paper, but trends for all indicators can be found in Additional file 1. We also produced national estimates by pooling microdata within and across surveys. All regional and national results can be downloaded from the Global Health Data Exchange (GHDx), a publicly available health data catalogue .
We report estimates for 10 sub-regions (Central 1, Central 2, Kampala, East Central, Eastern, North, Karamoja, West Nile, Western, and Southwest) delineated in the 2011 Demographic and Health Survey (DHS; Additional file 2) . We sought to conduct our analyses at the district level, but experienced barriers to doing so appropriately. Uganda has frequently redistricted its administrative boundaries, creating new district boundaries and reformulating existing ones several times since 1990 (i.e. there were 44 districts in 1997, 79 in 2006, and 112 in 2010 [29, 30]). GPS coordinates were not available for every survey in this analysis, and since there was insufficient documentation of restricting activities, we could not consistently extract and reassign estimates to their corresponding district in 2010. As a result, we opted to use the 10 regions delineated in the 2011 DHS.
We calculated an annual series of under-5 mortality estimates for each region from surveys and censuses that included birth history modules (Table 1). We applied synthetic life table methods to pooled complete birth history data from sources where complete birth histories were collected (i.e. DHS) to generate direct estimates of under-5 mortality . For sources where summary birth histories only were collected (i.e. AIDS Indicator Survey and both censuses), we applied the combined version of the maternal age cohort and maternal age period methods to generate indirect estimates of under-5 mortality .
We calculated regional intervention coverage estimates for each survey-year of available data. Aside from information extracted from Netmark survey reports (Table 1), all estimates were produced using microdata and accounting for each survey’s complex multistage design. For most child-level indicators, we included children aged between 0 and 59 months; however, we excluded children under 12 months of age for immunizations, except for BCG, due to their recommended dosing schedule . For BCG immunization, however, we computed coverage estimates for two age groups – under 12 months and under 59 months – in order to both reflect timely BCG vaccination and overall protection among children under 5. We report on BCG immunization rates for the latter age group below, but additional information on BCG coverage estimation and corresponding results can be found in Additional files 1 and 3, respectively.
Most survey questions pertaining to ANC, SBA, and IPTp only covered the respondent’s most recent birth. As this restriction disproportionately excludes older children from high parity mothers, we restricted the age range for children aged 0–12 months to avoid bias. Additionally, the Uganda National Panel Survey (UNPS) only ascertained pentavalent and measles immunization status for children aged 0–24 months, and weight measurements were taken for children aged 6–59 months . In order to maximize data inclusion while keeping age groups consistent across surveys, we used the UNPS age groups for all survey data extraction pertaining to these indicators. Immunization coverage estimates were obtained using vaccine cards whenever they were available; in cases where cards were not present at the time of survey, maternal recall was used to supplement immunization data.
Estimation process for under-5 mortality
We adapted a previously described modeling and validation framework for modeling regional trends in under-5 mortality in Uganda . Specifically, we applied the following model:
where 5q0 i,t,s is under-5 mortality in region (i), year (t), as measured by source (s). The β terms are fixed effects; β 0 and β 1 are the global intercept and slope, respectively, and β 2 is an adjustment coefficient included for non-DHS sources to account for an observed discrepancy between under-5 mortality estimates derived from DHS surveys and those derived from other surveys. All other terms are random effects. Specifically, u i and v i are a regional-level random intercept and slope, respectively, and are both assigned conditional autoregressive priors ; these terms allow for each region to deviate from the global level and linear trend in under-5 mortality. w t is a year-level random intercept assigned a first-order random walk prior ; this term allows for non-linearity in the global time trend. Similarly, δ i,t is a region-year level random intercept with the prior given by the interaction between a conditional autoregressive prior for spatial trends and a first order random walk prior for temporal trends . This random effect allows for non-linearity in the region-specific time trends. Finally, γ i,s is a source-year level random effect assigned an independent and identically distributed normal prior and is included to account for autocorrelation in estimates of under-5 mortality derived from the same source in the same region. Weakly informative normal priors were assigned to all fixed effects and weakly informative gamma priors were applied to the log precision of all random effects. To generate predictions from this model, we approximated the posterior distribution of θ i,t by setting I s ∉ DHS and γ i,s to 0. The median, 2.5th, and 97.5th percentiles of this distribution were inverse-logit transformed to generate the point estimates and confidence intervals (CIs) for 5q0 i,t in each region and year.
Estimation process for intervention coverage
We used a two-step modeling approach to generate regional trends from 1990 to 2011 for each indicator. In the first stage, we fit the following linear mixed-effects model with random intercepts and slopes for each region.
Observations are indexed to region i and year t. For modeling coverage estimates, which are bounded between 0 and 1, logit transformation was applied. On the other hand, for variables such as years of maternal education log transformation was used. We used a one-knot natural cubic spline with two basis functions (h 1 and h 2 ) to act as a smoother. The random effects (γ 0i , γ 1i , and γ 2i ) allow the levels and trends to vary between regions.
In the second step, the predicted trend from this linear model acts as the mean prior for Gaussian process regression (GPR), which is implemented with a Matern covariance function [37, 38]. GPR is a nonparametric technique for interpolating non-linear trends that has been used extensively in the estimation of time series data [39–43]. Briefly, it takes into account the model variance as well as the relative sampling uncertainty of the observed data to estimate a posterior mean function. We generated trends with uncertainty for each indicator by drawing 1,000 times from the posterior distribution and back-transforming to the original scale. The point estimate was based on the median of the draws, and 95 % CIs were obtained by taking the 2.5th and 97.5th percentiles of the samples.
Overall intervention coverage
We created two overall intervention coverage metrics to summarize regional intervention levels. First, we estimated an overall intervention coverage metric that included 11 indicators spanning the spectrum of interventions included in this analysis: the proportion of households with IRS, ITN ownership or both; IPTp2; self-reported receipt of ACTs after fever; EBF; BCG, measles, OPV3, and pentavalent immunization coverage; ANC4; SBA; and the proportion of children who were not underweight. When constructing overall coverage metrics, prior theory-based judgments may be incorporated to reflect the relative value of interventions . For simplicity and ease of interpretation, we applied equal weights for each intervention included in the overall coverage metric, therefore defining overall intervention coverage as the average of the 11 interventions. We compared the overall intervention coverage trend to under-5 mortality and socioeconomic variables using Pearson correlation coefficients.
All analyses were conducted using Stata 13.1 (StataCorp, College Station, TX) and R version 3.0.1 (R Foundation for Statistical Computing, Vienna, Austria). The model used for mortality estimation was fit using the INLA package .
Permission to implement this research project was obtained from the Ministry of Health of Uganda. Ethical approval for this study was obtained from the institutional review board of the University of Washington, Uganda National Council of Science and Technology, and School of Medicine Research Ethics Committee. The study was conducted in compliance with national regulatory and ethics guidelines.
We found large declines in under-5 mortality for all regions since 1990 (Fig. 1). The national rate of decline has quickened since 2000, with a 39 % decrease between 2000 and 2011 compared to a 14 % decrease from 1990 to 2000. However, subnational estimates revealed considerable regional variation. Kampala experienced consistently lower mortality than all other regions between 1990 and 2011, although the gap between Kampala and the rest of the country declined. In 1990, Karamoja (201 deaths per 1,000 live births; 95 % CI, 169–236), North (191 deaths per 1,000 live births; 95 % CI, 164–221), and West Nile (184 deaths per 1,000 live births; 95 % CI, 154–217) had the highest mortality. These regions saw steep declines between 1990 and 2011, especially in the North region (a 54 % decrease). Despite large decreases in under-5 mortality from 1990 to 2007, Karamoja showed an increase in rates between 2007 (107 deaths per 1,000 live births; 95 % CI, 88–130) and 2010 (124 deaths per 1,000 live births; 95 % CI, 100–153), although the uncertainty intervals were wide.
The prevalence of childhood underweight declined in Uganda, falling from 20 % (95 % CI, 16–26 %) in 1990 to 14 % (95 % CI, 12–15 %) in 2011 (Fig. 2). Since 1990, a number of regions recorded even faster declines in childhood underweight, dropping 14 percentage points in the Eastern region, 16 percentage points in North, and 19 percentage points in West Nile. By contrast, levels of childhood underweight largely stagnated in Karamoja and Western regions since 1990. Further, Karamoja’s rates of childhood underweight, 29 % (95 % CI, 24–34 %) in 2011, remained persistently higher than in the rest of Uganda.
Uganda has rapidly scaled up coverage of several malaria interventions. Prior to 2004, all regions recorded coverage levels below 10 % for ITNs and ACTs. By 2011, national rates of ITN ownership reached 59 % (95 % CI, 36–79 %) and self-reported receipt of ACTs for febrile children under 5 increased to 49 % (95 % CI, 34–65 %). Despite these gains, no region met the National Malaria Control Programme (NMCP) target of 85 % by 2010 for ITN ownership, under-5 ITN use, or IPTp2 (Fig. 3) . In addition, IPTp2 remained quite low across regions (29 % in 2011), a striking finding since IPTp2, which is prescribed at ANC visits, consistently lagged behind levels of ANC4. Nationally, IPTp2 coverage was 18 percentage points lower than ANC4, and only one region (Eastern) had IPTp2 levels (35 %; 95 % CI, 21–54 %) that were comparable to ANC4 (35 %; 95 % CI, 24–47 %) in 2011.
BCG and measles vaccine coverage increased in all regions from 1990 to 2011. Nationally, BCG immunization coverage rose from 78 % (95 % CI, 62–89 %) in 1990 to 94 % (95 % CI, 89–97 %) in 2011, and measles vaccination climbed from 63 % (95 % CI, 39–82 %) to 85 % (95 % CI, 75–91 %) during this time. In contrast, OPV3 coverage remained relatively unchanged across regions, increasing slightly from 1990 to 2000 and then somewhat declining since 2000. Pentavalent immunization coverage (77 %; 95 % CI, 51–92 %) reached comparable levels to OPV3 coverage in 2011 (76 %; 95 % CI, 52–90 %) demonstrating a rapid scale-up since its introduction in 2002. At the regional level, immunization coverage was more varied. In 2011, OPV3 coverage ranged from 69 % (95 % CI, 44–87 %) in Central 1 to 83 % (95 % CI, 63–93 %) in Southwest, and pentavalent vaccination coverage spanned from 67 % (95 % CI, 42–86 %) in East Central to 86 % (95 % CI, 69–95 %) in Southwest. In general, Central 1 had lower levels of immunization coverage than the other regions, whereas Southwest had higher vaccination rates.
Other key MCH indicators
Between 1990 and 2011, ANC1 coverage increased across regions, narrowing the gap between the regions with the highest and lowest levels of ANC1 over time (Fig. 4). In 1990, ANC1 coverage ranged from 67 % (95 % CI, 40–87 %) in West Nile to 88 % (95 % CI, 70–96 %) in East Central, a difference of 21 percentage points; more than two decades later, this coverage gap shrunk to six percentage points, with the ANC1 coverage range spanning 93 % (95 % CI, 85–97 %) in Central 1 to 99 % (95 % CI, 98–100 %) in Kampala. Similar gains were not observed for ANC4 coverage, with the national average remaining relatively unchanged (49 %; 95 % CI, 30–65 % in 1990 and 47 %; 95 % CI, 41–54 % in 2011). Regionally, ANC4 trends diverged, with several regions experiencing decreasing ANC4 coverage at the same time as others showed gradual gains in coverage. By contrast, SBA coverage increased substantially for a number of regions since 1990, particularly in North (a 34 percentage point increase), West Nile (a 41 percentage point increase), Eastern (a 32 percentage point increase), and Southwest (a 32 percentage point increase). SBA coverage still remained quite varied across regions, with Kampala and nearby regions experiencing much higher rates (SBA coverage was 95 %; 95 % CI, 90–97 % in Kampala) than Karamoja (27 %; 95 % CI, 16–43 %). Nationwide, EBF moderately increased, rising from 54 % (95 % CI, 36–71 %) in 1990 to 61 % (95 % CI, 54–67 %) in 2011. By 2011, Karamoja had the highest rates of EBF, at 73 % (95 % CI, 58–84 %), whereas Kampala recorded the lowest levels (46 %; 95 % CI, 31–62 %).
Overall intervention coverage
Uganda experienced a large increase in overall intervention coverage since 2000, which was largely driven by gains in coverage of malaria vector control (ITNs or IRS) and pentavalent immunization (Fig. 5). In 2011, Kampala recorded the highest level of overall intervention coverage at 70 % whereas East Central had the lowest at 57 %. West Nile and North recorded the largest gains in overall intervention coverage since 1990, at 31 and 30 percentage points, respectively. Overall coverage was strongly correlated with under-5 mortality (ρ = −0.85), but its relationships with measures of education (ρ = 0.57) and other socioeconomic indicators (with ρ ranging from 0.42 to 0.50) were more moderate. The relationship between under-5 mortality and overall intervention coverage was stronger than the correlation between under-5 mortality and education (ρ = −0.77), as well as under-5 mortality and other socioeconomic indicators (with ρ ranging from −0.50 to −0.75).
This study represents the first comprehensive regional assessment of levels and trends of MCH indicators and socioeconomic factors in Uganda. All regions have achieved substantial progress in reducing under-5 mortality as well as scaling up coverage of malaria control interventions and pentavalent vaccination. At the same time, coverage of other key MCH interventions, such as OPV3 and ANC4, have generally flattened or declined over time. Analyzing regional trends revealed marked heterogeneity and geographic disparities in both coverage levels and outcomes, emphasizing the importance of routinely monitoring local health needs in a timely manner. Subnational benchmarking of health intervention coverage is a crucial step in identifying areas to which resources should be directed in Uganda and sub-Saharan Africa.
Although under-5 mortality decreased throughout Uganda, geographic inequalities persisted, with Kampala consistently recording much lower rates of under-5 deaths than other regions from 1990 to 2011. Further, progress in reducing child mortality in Karamoja stalled after 2007, and its prevalence of childhood underweight was the highest in Uganda for 2011, more than 10 percentage points higher than the next-highest region. Although Karamoja achieved high levels of coverage for some interventions, particularly EBF and pentavalent vaccination, its health outcomes lagged behind other regions. Food insecurity due to climactic shocks, disease, and conflict is well-documented in this region [47–53], which is largely populated by pastoralist groups. Heavy flooding in 2007 reportedly devastated crops and isolated many parts of the region from food supplies , potentially contributing to the region’s high levels of child mortality. More recent efforts to improve Karamoja’s challenges with nutrition, such as food distribution initiatives led by organizations like the World Food Programme , may have resulted in improved child health outcomes. However, focused tracking of subnational trends and such targeted interventions will be necessary to optimally understand the impact of these efforts. Health policies and programs well-suited for some communities do not necessarily translate into the same health benefits in others; for instance, researchers found western areas of Uganda experienced high rates of malnutrition, in spite having adequate food production , and thus recommended programs focused on community nutrition and health education beyond food distribution. Further investigation into these strategies, ideally led by a combination of researchers and program leaders in Uganda (e.g. the 2013 Nutrition Surveillance Analysis for Karamoja ), could shed light on which types of programs work to address the country’s local malnutrition burdens.
Uganda’s trends along the maternal health continuum of care unveiled a number of notable findings. While all regions reached high levels of ANC1 coverage by 2011, trends for ANC4 coverage, which is recommended by Uganda’s national guidelines, were much more variable across regions . This coverage gap aligns with reports of women starting ANC later points during their pregnancies [59, 60], making it challenging to complete four ANC visits before delivery. While levels of SBA increased across all regions, in 2011 there remained a wide gap between the highest performer (Kampala, at 95 %) and the lowest performer (Karamoja, at 27 %). Differences in SBA might be explained by educational attainment, health facility proximity, workforce shortages, or cultural preferences to deliver at home or with traditional birth attendants [61–63]. These disparities along a continuum of care for maternal health services are not unique to Uganda [17, 64] and point to two related MCH service delivery challenges facing many countries in sub-Saharan Africa: (1) increasing women’s use of ANC prior to giving birth; and (2) promoting heightened demand for delivery by skilled attendants and/or a stronger capacity for delivering in health facilities. Past work has shown that a number of factors hinder the provision of ANC and SBA, including distance to care , cost [61, 66], cultural practices , insufficient knowledge about the importance of ANC , and inadequate availability of medical supplies and equipment at facilities [68, 69]. Local health offices may consider introducing or scaling up current programs which include a combination of outreach activities led by community health workers , addressing gaps in facility-based resources to provide ANC and support routine deliveries, and incentive schemes, such as vouchers or conditional cash transfers, that address financial barriers and/or link ANC services to post-natal care [66, 70–72].
Uganda has substantially increased coverage of malaria control interventions since 2000, reflecting investments in ITN distribution, subsidizing costs of ITNs and ACTs, and expanding IRS activities [8, 73, 74]. While no region achieved the 2010 NMCP target of reaching 85 % coverage for ITN ownership, ITN use, and IPTp2, it is likely that a 2013 mass distribution campaign has bolstered ITN ownership and use in more recent years . Routine monitoring of malaria control implementation at local levels, as well as the timely investigation into stagnating intervention coverage, are critical to maximizing malaria control impact in Uganda, a country that still experiences some of the highest rates of transmission in the world .
Most regions had lower levels of IPTp2 coverage than ANC4, which suggests there is a substantial constraint to receiving IPTp at ANC visits as recommended by Uganda’s national guidelines . A nationally-representative survey of health facilities found that over 90 % of facilities in Uganda had sulfadoxine/pyrimethamine in stock in 2012 , indicating that stock-outs were an unlikely root cause of low IPTp2. Previous work suggests that prescription practices by health providers, including the misuse of sulfadoxine/pyrimethamine to treat clinical malaria, may be the main driver of low rates of IPTp [77, 78]. Further examination is needed to identify and address the factors leading to low IPTp2 coverage throughout Uganda.
Immunization progress has been variable in Uganda. Coverage of BCG and measles vaccination has increased markedly since 1990, while trends in polio and pentavalent coverage were more variable. The Reaching Every District approach promoted by the World Health Organization (WHO) sets a coverage target of 80 % for all districts in low- and middle-income countries in order to help rectify geographic inequities . While this analysis was conducted at the regional level, the Reaching Every District target still provides a useful benchmark. Immunization coverage in 2011 exceeded 80 % for BCG and measles in all regions; however, only five and two regions achieved coverage over 80 % for OPV3 and pentavalent, respectively. Previous studies have attributed the rise in measles coverage, which has occurred in all regions, to expanded control efforts from 1999 to 2006 [80–82]. The gains in coverage could explain the nearly four-fold drop in under-5 measles deaths from 1990 to 2013 . At the same time, OPV3 coverage has declined in all regions since 2000. While Uganda was certified as polio-free in 2006, wild poliovirus cases were confirmed in Amuru District (North) in 2009 and Bugiri District (East Central) in 2010 . Notably, the North region had the third-lowest OPV3 coverage in 2009 (73 %) and the East Central region had the second-lowest coverage in 2010 (72 %). Subsequently, large-scale supplementary polio immunization campaigns were conducted in eastern and northern Uganda. In addition, a nationwide polio immunization campaign started in January 2015 . While we were not able to estimate coverage trends beyond 2011, future benchmarking exercises using more recent data may help evaluate the results of these campaigns.
The quick rise of pentavalent vaccination coverage to similar levels as OPV3 in all regions demonstrates the successful implementation of the 2002 Gavi Vaccine Introduction Grant . This scale-up is promising for more recent efforts in Uganda to introduce the pneumococcal conjugate vaccine, rotavirus vaccine, human papillomavirus vaccine, and inactivated polio vaccine. However, pentavalent coverage stagnated or declined since 2008 in most regions. Gavi ISS was suspended from 2006 to 2012, which may be related to the drops in coverage. Further research is needed to determine how to further improve routine immunization services in Uganda.
This study revealed substantial heterogeneity in health indicators and outcomes across Uganda’s regions. The decentralization of Uganda’s health system has emphasized management by local governance , which requires subnational benchmarking to optimally evaluate performance of health service delivery. While this work relied on household surveys and censuses, further efforts to improve the accuracy and timeliness of HMIS reporting in Uganda will greatly improve local evaluation efforts and guide resource allocation decisions . Other subnational benchmarking studies, such as those conducted in Mexico [44, 88], have strengthened government accountability and supported the use of locally-relevant evidence to inform decision-making. The systematic tracking of local MCH outcomes and interventions is increasingly occurring in sub-Saharan Africa, as demonstrated by recent work in Zambia and Nigeria [17, 61], and investments by development partners like Gavi to support subnational assessments of immunization coverage . In tandem, research producers and evidence users are working together to make these local data both more accessible and actionable, creating public data catalogues such as the GHDx  and WHO’s Global Health Observatory  and developing interactive, locally-focused data visualization tools, such as the Nigeria Health Map . It is through these collaborative efforts, from the generation of subnational data to its dissemination, that local health evidence can be more effectively used by policymakers, program leaders, and funding organizations to guide their decision-making needs.
Our findings need to be interpreted within the context of some study limitations. First, a number of relevant interventions could not be analyzed due to limited data availability. For instance, we were unable to obtain reliable data for HIV interventions such as prevention of mother-to-child transmission of HIV or pediatric HIV treatment. Second, several MCH indicators were limited by question comparability across surveys. Notably, questions concerning EBF only considered feeding in the day prior to the survey instead of in the first six months of life , and ACT use and healthcare-seeking at health facilities were based on self-reported symptoms of fever and cough, respectively, rather than confirmed malaria or pneumonia diagnoses. Third, some of the data sources from the early 1990s, including the 1991 census and the 1995 and 2000–2001 DHS surveys, excluded certain districts in the North region from the sampling frame due to insecurity. It is possible that the point estimates from these surveys are biased; however, previous analysis using the 2006 DHS found that excluding the districts not sampled in the earlier surveys had little effect on coverage estimates . Finally, most estimates from household surveys were derived from respondent recall, which can be imprecise and subject to bias. Nevertheless, we believe that by combining all available data sources, these findings constitute the best available estimates of levels and trends of key MCH interventions in Uganda.
Uganda has experienced substantial declines in under-5 mortality and gains in ITN ownership and use, the receipt of ACTs, measles vaccination, ANC1, and SBA. However, progress in coverage of other indicators such as ANC4, IPTp2, and OPV3 has stalled. National level trends masked marked subnational heterogeneity, and further investigation is necessary to understand the drivers of regional variation. Enhancing the scope and reliability of health information systems would further enable the regular monitoring of levels and trends. Additional subnational benchmarking analyses, ideally at the administrative level where health services are delivered, should be conducted routinely in order to systematically guide resource allocation and policy decisions in Uganda and other countries in sub-Saharan Africa.
Artemisinin-based combination therapy
Demographic and Health Survey
Global Health Data Exchange
Gaussian process regression
Health Management Information System
Intermittent preventive therapy during pregnancy
Indoor residual spraying
Immunization services support
Maternal and child health
National Malaria Control Programme
Oral polio vaccine
Skilled birth attendance
Uganda National Panel Survey
World Health Organization
World Health Organization. Health systems performance assessment: debates, methods and empiricism. Geneva, Switzerland: WHO; 2003.
Bryce J, Arnold F, Blanc A, Hancioglu A, Newby H, Requejo J, et al. Measuring coverage in MNCH: new findings, new strategies, and recommendations for action. PLoS Med. 2013;10:e1001423.
Mikkelsen L, Phillips DE, AbouZahr C, Setel PW, de Savigny D, Lozano R, et al. A global assessment of civil registration and vital statistics systems: monitoring data quality and progress. Lancet. 2015;386:1395–406.
Wang H, Liddell CA, Coates MM, Mooney MD, Levitz CE, Schumacher AE, et al. Global, regional, and national levels of neonatal, infant, and under-5 mortality during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:957–79.
Kassebaum NJ, Bertozzi-Villa A, Coggeshall MS, Shackelford KA, Steiner C, Heuton KR, et al. Global, regional, and national levels and causes of maternal mortality during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:980–1004.
Uganda Ministry of Health. Malaria control programme. Kampala: Malaria Control Strategic Plan 2001–2005; 2001.
Yeka A, Gasasira A, Mpimbaza A, Achan J, Nankabirwa J, Nsobya S, et al. Malaria in Uganda: challenges to control on the long road to elimination. I. Epidemiology and current control efforts. Acta Trop. 2012;121:184–95.
Nanyunja M, Nabyonga Orem J, Kato F, Kaggwa M, Katureebe C, Saweka J. Malaria treatment policy change and implementation: the case of Uganda. Malar Res Treat. 2011;2011:683167.
Lee EH-J, Lewis RF, Makumbi I, Kekitiinwa A, Ediamu TD, Bazibu M, et al. Haemophilus influenzae type b conjugate vaccine is highly effective in the Ugandan routine immunization program: a case–control study. Trop Med Int Health. 2008;13:495–502.
Government of Uganda. Annual progress report to the Global Alliance for Vaccines and Immunization (GAVI) and The Vaccine Fund. Kampala: GoU; 2002.
Victora CG, Barros AJD, Axelson H, Bhutta ZA, Chopra M, França GVA, et al. How changes in coverage affect equity in maternal and child health interventions in 35 Countdown to 2015 countries: an analysis of national surveys. Lancet. 2012;380:1149–56.
Steketee RW, Eisele TP. Is the scale up of malaria intervention coverage also achieving equity? PLoS One. 2009;4:e8409.
Countdown 2008 Equity Analysis Group, Boerma JT, Bryce J, Kinfu Y, Axelson H, Victora CG. Mind the gap: equity and trends in coverage of maternal, newborn, and child health services in 54 Countdown countries. Lancet. 2008;371:1259–67.
Pullan RL, Freeman MC, Gething PW, Brooker SJ. Geographical inequalities in use of improved drinking water supply and sanitation across sub-Saharan Africa: mapping and spatial analysis of cross-sectional survey data. PLoS Med. 2014;11:e1001626.
Dwyer-Lindgren L, Kakungu F, Hangoma P, Ng M, Wang H, Flaxman AD, et al. Estimation of district-level under-5 mortality in Zambia using birth history data, 1980–2010. Spat Spatio-Temporal Epidemiol. 2014;11:89–107.
Noor AM, Mutheu JJ, Tatem AJ, Hay SI, Snow RW. Insecticide-treated net coverage in Africa: mapping progress in 2000–07. Lancet. 2009;373:58–67.
Colson KE, Dwyer-Lindgren L, Achoki T, Fullman N, Schneider M, Mulenga P, et al. Benchmarking health system performance across districts in Zambia: a systematic analysis of levels and trends in key maternal and child health interventions from 1990 to 2010. BMC Med. 2015;13:69.
Ministry of Health. Annual Health Sector Performance Report 2002/03. Kampala: MoH Uganda; 2003.
Boerma T. Public health information needs in districts. BMC Health Serv Res. 2013;13 Suppl 2:S12.
Asiimwe JB, Jehopio P, Atuhaire LK, Mbonye AK. Examining small area estimation techniques for public health intervention: lessons from application to under-5 mortality data in Uganda. J Public Health Policy. 2011;32:1–14. Discussion 15.
Turi KN, Christoph MJ, Grigsby-Toussaint DS. Spatial distribution of underweight, overweight and obesity among women and children: results from the 2011 Uganda Demographic and Health Survey. Int J Environ Res Public Health. 2013;10:4967–81.
The Partnership for Maternal, Newborn and Child Health. A global review of the key interventions related to reproductive, maternal, newborn and child health (RMNCH). Geneva: PMNCH; 2011.
Gakidou E, Cowling K, Lozano R, Murray CJ. Increased educational attainment and its effect on child mortality in 175 countries between 1970 and 2009: a systematic analysis. Lancet. 2010;376:959–74.
Chowa GA, Ansong D, Masa R. Assets and child well-being in developing countries: a research review. Center for Social Development (CSD) Working Paper. St Louis, MO: Center for Social Development, George Warren brown School of Social Work; 2009.
Shengelia B, Tandon A, Adams OB, Murray CJL. Access, utilization, quality, and effective coverage: an integrated conceptual framework and measurement strategy. Soc Sci Med 1982. 2005;61:97–109.
Houweling TAJ, Kunst AE. Socio-economic inequalities in childhood mortality in low- and middle-income countries: a review of the international evidence. Br Med Bull. 2010;93:7–26.
Institute for Health Metrics and Evaluation (IHME): Global Health Data Exchange (GHDx). http://ghdx.healthdata.org/. Accessed August 30, 2015.
Uganda Bureau of Statistics. Uganda Malaria Indicator Survey 2009. Kampala: UBoS; 2012.
Green E. Working Paper No. 24: Development as state-making. District creation and decentralization in Uganda. London: Development Studies Institute, London School of Economics; 2008.
Uganda Bureau of Statistics, ICF International Inc. Uganda Demographic and Health Survey 2011. Kampala and Calverton: UBoS and ICF International, Inc.; 2012.
Rajaratnam JK, Tran LN, Lopez AD, Murray CJL. Measuring under-five mortality: validation of new low-cost methods. PLoS Med. 2010;7:e1000253.
World Health Organization. WHO-UNICEF Guidelines for Comprehensive Multi-Year Planning for Immunization. Geneva: WHO; 2013.
Uganda Bureau of Statistics. Uganda National Panel Survey 2009/10. Kampala: UBoS; 2010.
Besag J, York J, Mollié A. Bayesian image restoration, with two applications in spatial statistics. Ann Inst Stat Math. 1991;43:1–20.
Clayton D. Generalized linear mixed models. In: Markov Chain Monte Carlo in Practice. Firstth ed. London: Chapman & Hall; 1996. p. 275–302.
Knorr-Held L. Bayesian modelling of inseparable space-time variation in disease risk. Stat Med. 2000;19:2555–67.
Vasudevan S, Ramos F, Nettleton E, Durrant-Whyte H. Heteroscedastic Gaussian processes for data fusion in large scale terrain modeling. Anchorage, AK: 2010 IEEE International Conference on Robotics and Automation; 2010. p. 3452–9.
Rasmussen CE, Williams CKI. Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press; 2006.
Murray CJ, Rosenfeld LC, Lim SS, Andrews KG, Foreman KJ, Haring D, et al. Global malaria mortality between 1980 and 2010: a systematic analysis. Lancet. 2012;379:413–31.
GBD, Mortality and Causes of Death Collaborators. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2013;2015(385):117–71.
Murray CJL, Ortblad KF, Guinovart C, Lim SS, Wolock TM, Roberts DA, et al. Global, regional, and national incidence and mortality for HIV, tuberculosis, and malaria during 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2014;384:1005–70.
Rajaratnam JK, Marcus JR, Flaxman AD, Wang H, Levin-Rector A, Dwyer L, et al. Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970–2010: a systematic analysis of progress towards Millennium Development Goal 4. Lancet. 2010;375:1988–2008.
Foreman KJ, Lozano R, Lopez AD, Murray CJ. Modeling causes of death: an integrated approach using CODEm. Popul Health Metr. 2012;10:1.
Lozano R, Soliz P, Gakidou E, Abbott-Klafter J, Feehan DM, Vidal C, et al. Benchmarking of performance of Mexican states with effective coverage. Lancet. 2006;368:1729–41.
Rue H, Martino S, Chopin N. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. J R Stat Soc Ser B Stat Methodol. 2009;71:319–92.
Malaria Control Programme, Ministry of Health. Uganda Malaria Control Strategic Plan 2005/06-2009/10. Kampala: MoH; 2006.
Uganda Ministry of Health. Nutrition and health assessment: Abim Distrist. Kampala: MoH; 2008.
World Food Programme. Comprehensive food security & vulnerability analysis (CFSVA). Uganda. Kampala: WFP; 2009.
Uganda Human Rights Commission. Uganda Human Rights Commission 9th Annual Report. UHRC: Kampala; 2006.
Saferworld. Karamoja conflict and security assessment. Kampala: Saferworld; 2010.
Powell J. Karamoja: a literature review. Kampala: Saferworld; 2010.
Mubiru D. Climate change and adaption options in Karamoja. Kampala: Food and Agriculture Organization; 2010.
Nichols EK, Talley LE, Birungi N, McClelland A, Madraa E, Chandia AB, et al. Suspected outbreak of riboflavin deficiency among populations reliant on food assistance: a case study of drought-stricken Karamoja, Uganda, 2009–2010. PLoS One. 2013;8:e62976.
Food and Agriculture Organization, World Food Programme. FAO/WFP Assessment of the Impact of 2007 Floods on Food and Agriculture in Eastern and Northern Uganda. Kampala: FAO, WFP; 2008.
World Food Programme. WFP distributes food for Karamoja hunger season. Kampala: WFP; 2013.
Kikafunda JK, Agaba E, Bambona A. Malnutrition amidst plenty: an assessment of factors responsible for persistent high levels of childhood stunting in food secure western Uganda. Afr J Food Agric Nutr Dev. 2014;14:2088–113.
Action Against Hunger (ACF) International, Uganda Ministry of Health. Nutrition surveillance data analysis. Karamoja, Uganda, December 2009-May 2012. Karamoja: ACF-International, MoH; 2013.
Ministry of Health. Uganda national guidelines on management of common conditions. Kampala: MoH; 2010.
Kisuule I, Kaye DK, Najjuka F, Ssematimba SK, Arinda A, Nakitende G, et al. Timing and reasons for coming late for the first antenatal care visit by pregnant women at Mulago hospital, Kampala Uganda. BMC Preg Childbirth. 2013;13:121.
Kawungezi PC, AkiiBua D, Aleni C, Chitayi M, Niwaha A, Kazibwe A, et al. Attendance and utilization of antenatal care (ANC) services: multi-center study in upcountry areas of Uganda. Open J Prev Med. 2015;5:132–42.
Wilunda C, Quaglio G, Putoto G, Lochoro P, Dall’Oglio G, Manenti F, et al. A qualitative study on barriers to utilisation of institutional delivery services in Moroto and Napak districts, Uganda: implications for programming. BMC Preg Childbirth. 2014;14:259.
Kyomuhendo GB. Low use of rural maternity services in Uganda: impact of women’s status, traditional beliefs and limited resources. Reprod Health Matters. 2003;11:16–26.
Amooti-Kaguna B, Nuwaha F. Factors influencing choice of delivery sites in Rakai district of Uganda. Soc Sci Med 1982. 2000;50:203–13.
Wollum A, Burstein R, Fullman N, Dwyer-Lindgren L, Gakidou E. Benchmarking health system performance across states in Nigeria: a systematic analysis of levels and trends in key maternal and child health interventions and outcomes, 2000–2013. BMC Med. 2015;13:208.
Waiswa P, Pariyo G, Kallander K, Akuze J, Namazzi G, Ekirapa-Kiracho E, et al. Effect of the Uganda Newborn Study on care-seeking and care practices: a cluster-randomised controlled trial. Glob Health Action. 2015;8:24584.
Bua J, Paina L, Kiracho EE. Lessons learnt during the process of setup and implementation of the voucher scheme in Eastern Uganda: a mixed methods study. Implement Sci. 2015;10:108.
Coast E, Jones E, Portela A, Lattof SR. Maternity care services and culture: a systematic global mapping of interventions. PLoS One. 2014;9:e108130.
Institute for Health Metrics and Evaluation. Health service provision in Uganda: assessing facility capacity, costs of care, and patient perspectives. Seattle, WA: IHME; 2014.
Wilunda C, Oyerinde K, Putoto G, Lochoro P, Dall’Oglio G, Manenti F, et al. Availability, utilisation and quality of maternal and neonatal health care services in Karamoja region, Uganda: a health facility-based survey. Reprod Health. 2015;12:30.
Lim SS, Dandona L, Hoisington JA, James SL, Hogan MC, Gakidou E. India’s Janani Suraksha Yojana, a conditional cash transfer programme to increase births in health facilities: an impact evaluation. Lancet. 2010;375:2009–23.
Lahariya C. Cash incentives for institutional delivery: Linking with antenatal and postnatal care may ensure “Continuum of care” in India. Indian J Community Med. 2009;34:15.
Okoli U, Morris L, Oshin A, Pate MA, Aigbe C, Muhammad A. Conditional cash transfer schemes in Nigeria: potential gains for maternal and child health service uptake in a national pilot programme. BMC Preg Childbirth. 2014;14:408.
Wanzira H, Yeka A, Kigozi R, Rubahika D, Nasr S, Sserwanga A, et al. Long-lasting insecticide-treated bed net ownership and use among children under five years of age following a targeted distribution in central Uganda. Malar J. 2014;13:185.
Uganda Ministry of Health. Uganda malaria control strategic plan, 2010/11-2014/15. Kampala: MoH; 2009.
President’s Malaria Initiative. President’s Malaria Initiative: Uganda, Malaria Operational Plan FY 2014. Washington, DC: PMI; 2013.
Kamya MR, Arinaitwe E, Wanzira H, Katureebe A, Barusya C, Kigozi SP, et al. Malaria transmission, infection, and disease at three sites with varied transmission intensity in Uganda: implications for malaria control. Am J Trop Med Hyg. 2015;92:903–12.
Sangaré LR, Stergachis A, Brentlinger PE, Richardson BA, Staedke SG, Kiwuwa MS, et al. Determinants of use of intermittent preventive treatment of malaria in pregnancy: Jinja, Uganda. PLoS ONE. 2010;5:e15066.
Odongo CO, Bisaso KR, Kitutu F, Obua C, Byamugisha J. Is there a distinction between malaria treatment and intermittent preventive treatment? Insights from a cross-sectional study of anti-malarial drug use among Ugandan pregnant women. Malar J. 2015;14:189.
World Health Organization Regional Office for Africa. Reaching every district approach: a guide for district health management teams. Brazzaville: WHO AFRO; 2008.
Mbabazi WB, Nanyunja M, Makumbi I, Braka F, Baliraine FN, Kisakye A, et al. Achieving measles control: lessons from the 2002–06 measles control strategy for Uganda. Health Policy Plan. 2009;24:261–9.
Nanyunja M, Lewis RF, Makumbi I, Seruyange R, Kabwongera E, Mugyenyi P, et al. Impact of mass measles campaigns among children less than 5 years old in Uganda. J Infect Dis. 2003;187(Supplement 1):S63–8.
Baliraine FN, Bwogi J, Bukenya H, Seguya R, Kabaliisa T, Kisakye A, et al. Possible interruption of measles virus transmission, Uganda, 2006–2009. Emerg Infect Dis. 2011;17:110–3.
Global Polio Eradication Initiative. Technical advisory group on polio eradication in the horn of Africa: 6th Meeting Report. Nairobi; 2011. http://www.polioeradication.org/Resourcelibrary/Advisoryandcertification/TechnicalAdvisoryGroups.aspx. Accessed August 30, 2015.
Ministry of Health. Press statement on upcoming national house-to-house polio immunization campaign. Kampala: Ministry of Health; 2015.
Gavi, The Vaccine Alliance: Uganda Factsheet. http://www.gavi.org/country/uganda/. Accessed August 30, 2015.
The Republic of Uganda. Local Governments Act 1997. Kampala, Uganda: 1997. http://www.ulii.org/ug/legislation/consolidated-act/243. Accessed online November 17, 2015.
Kiberu VM, Matovu JKB, Makumbi F, Kyozira C, Mukooyo E, Wanyenze RK. Strengthening district-based health reporting through the district health management information software system: the Ugandan experience. BMC Med Inform Decis Mak. 2014;14:40.
Gakidou E, Lozano R, González-Pier E, Abbott-Klafter J, Barofsky JT, Bryson-Cahn C, et al. Assessing the effect of the 2001–06 Mexican health reform: an interim report card. Lancet. 2006;368:1920–35.
Gavi Full Country Evaluations. http://www.healthdata.org/gavi. Accessed August 30, 2015.
Global Health Observatory. http://www.who.int/gho/database/en/. Accessed August 30, 2015.
Institute for Health Metrics and Evaluation (IHME): Nigeria Health Map. http://vizhub.healthdata.org/health-map/nigeria. Accessed August 30, 2015.
Greiner T. Exclusive breastfeeding: measurement and indicators. Int Breastfeed J. 2014;9:18.
Uganda Bureau of Statistics. Uganda Demographic and Health Survey 2006. Kampala: UBoS; 2007.
This research was carried out as part of the Malaria Control Policy Assessment (MCPA) project in Uganda, a collaboration between the Infectious Diseases Research Collaboration (IDRC) at Makerere University and the Institute for Health Metrics and Evaluation (IHME) at the University of Washington. This project has benefited greatly from key inputs and support from the Ministry of Health and the National Malaria Control Programme in Uganda. We also thank the AIDS Control Program and the Uganda Bureau of Statistics for a range of survey data; the WHO office in Uganda for providing access to immunization data; Uganda’s MSL and Joint Medical Store for granting access to drug distribution data; and Abt Associates for providing IRS data. We are most grateful to these organizations, especially for their willingness to facilitate data access and provide crucial content knowledge. We thank the MCPA Advisory Group, which consisted of international and local stakeholders who contributed toward refining the project’s research concept and framework. We thank all members of the MPCA team, including Mary Lakiyo at IDRC and Kelsey Pierce, Annie Haakenstad, Caterina Guinovart, and Ellie Colson at IHME, who contributed to the development and management of the project, as well as analyses.
Funding for this research came from the Bill & Melinda Gates Foundation. The funder did not have a role in the design of this study, its interpretation, or decision to submit the study’s results for publication.
All authors declare that they have no competing interests.
DAR contributed to all parts of the analysis, produced the tables and figures, and wrote the first draft of the manuscript. MN and LDL identified data sources and contributed to the analyses of the microdata, methods development, and manuscript writing. NF contributed to interpretation of findings, manuscript writing, and producing tables and figures. GI, AG, and TN contributed to data acquisition, data verification, and interpretation of findings. MK and EG conceptualized the project and guided the data analysis and manuscript writing. All authors read and approved the final manuscript.
About this article
Cite this article
Roberts, D.A., Ng, M., Ikilezi, G. et al. Benchmarking health system performance across regions in Uganda: a systematic analysis of levels and trends in key maternal and child health interventions, 1990–2011. BMC Med 13, 285 (2015). https://doi.org/10.1186/s12916-015-0518-x