- Research article
- Open Access
Benchmarking health system performance across districts in Zambia: a systematic analysis of levels and trends in key maternal and child health interventions from 1990 to 2010
BMC Medicine volume 13, Article number: 69 (2015)
Achieving universal health coverage and reducing health inequalities are primary goals for an increasing number of health systems worldwide. Timely and accurate measurements of levels and trends in key health indicators at local levels are crucial to assess progress and identify drivers of success and areas that may be lagging behind.
We generated estimates of 17 key maternal and child health indicators for Zambia’s 72 districts from 1990 to 2010 using surveys, censuses, and administrative data. We used a three-step statistical model involving spatial-temporal smoothing and Gaussian process regression. We generated estimates at the national level for each indicator by calculating the population-weighted mean of the district values and calculated composite coverage as the average of 10 priority interventions.
National estimates masked substantial variation across districts in the levels and trends of all indicators. Overall, composite coverage increased from 46% in 1990 to 73% in 2010, and most of this gain was attributable to the scale-up of malaria control interventions, pentavalent immunization, and exclusive breastfeeding. The scale-up of these interventions was relatively equitable across districts. In contrast, progress in routine services, including polio immunization, antenatal care, and skilled birth attendance, stagnated or declined and exhibited large disparities across districts. The absolute difference in composite coverage between the highest-performing and lowest-performing districts declined from 37 to 26 percentage points between 1990 and 2010, although considerable variation in composite coverage across districts persisted.
Zambia has made marked progress in delivering maternal and child health interventions between 1990 and 2010; nevertheless, substantial variations across districts and interventions remained. Subnational benchmarking is important to identify these disparities, allowing policymakers to prioritize areas of greatest need. Analyses such as this one should be conducted regularly and feed directly into policy decisions in order to increase accountability at the local, regional, and national levels.
Achievement of universal health coverage (UHC) is a primary goal for an increasing number of health systems worldwide and has been proposed as a key objective for the post-2015 development agenda . UHC aims to provide all people with the high-quality health services they need without the risk of financial hardship from out-of-pocket expenses . Included in UHC is the goal of reducing inequalities within countries, and this has led to an increased focus on within-country inequalities in low- and middle-income countries (LMICs) [3-6]. National gaps in UHC are closely related to inequalities in intervention coverage within countries [7,8]. While much progress has been made in reducing maternal and child mortality in the past two decades , many countries are lagging behind in the delivery of life-saving interventions and would benefit from intensified actions targeted to the worst-off and hardest-to-reach populations . To inform these efforts, timely and accurate information is needed, and demand for the measurement of subnational coverage in maternal and child health (MCH) and for analysis of time trends in subnational inequality is increasing [11,12].
Information on subnational levels and trends in health in LMICs is limited but growing. To date, most studies and global monitoring systems have focused on within-country inequalities by wealth indices, education, gender, or urban residence [6-8,12-27]. While this literature has been immensely important in identifying strikingly large inequalities and informing policy in many countries, gathering information on variation by geographic subunits has been under-prioritized. Subnational benchmarking has been instrumental in decision-making in high-income countries [28-32], but explicit comparisons of performance across subunits over time remain uncommon in much of the developing world. The Countdown to 2015 group has routinely tracked progress and equity in MCH intervention coverage for 75 countries since 2005, but reports incorporating health measures at subnational geographic levels only began in 2010 . Several studies, most commonly in India, have quantified coverage and outcomes at the regional [33-42] and first administrative levels [43-61]; however, most examine only one indicator, do not evaluate trends over time, or are not explicitly targeted to policymakers interested in local benchmarking for their countries. Even fewer studies have explored the geographic distributions for indicators below the first administrative level [62-76], which is arguably of greater policy relevance . Mexico was the first LMIC country to implement subnational benchmarking of effective coverage [48,78-80] and to then have these data feed into policy decisions, demonstrating how locally-relevant data can be used to inform health policymaking.
In recent years, Zambia has demonstrated multi-stakeholder commitment to UHC and equity in health service delivery [81-84]. The country’s National Health Strategic Plan 2011-2015  diverges from previous plans in its emphasis on UHC and overall health system strengthening rather than vertical programs. Zambia has successfully scaled up many priority MCH interventions in the past two decades . However, previous studies have focused on national trends and have not explored within-country inequalities. Accurate, timely, subnational information on intervention coverage is needed to benchmark progress and to pinpoint areas in need of targeted policy intervention. In this study, we use all available data to produce the first systematic assessment of levels and trends in the coverage of 17 MCH interventions, with estimates of uncertainty, across Zambia’s 72 districts from 1990 to 2010.
Data and indicator selection
We conducted several in-country meetings with major stakeholders in MCH to identify all available data sources with information on MCH and socioeconomic factors, including 20 household surveys, 3 population censuses, and 4 administrative data sources covering Zambia’s 72 districts (Additional file 1).
We identified 17 key indicators that are closely tied to child survival  and that could be estimated at the district level from the identified data sources: antenatal care (ANC, 1 and 4 visits); skilled birth attendance (SBA); immunization with Bacillus Calmette-Guérin (BCG); diphtheria-pertussis-tetanus (DPT); measles, polio, and pentavalent vaccines; exclusive breastfeeding (EBF); prevalence of underweight among children as a proxy for nutritional interventions a; intermittent preventive therapy for malaria during pregnancy (IPTp, 1 and 2 doses); insecticide-treated net (ITN) ownership; ITN use by children under five; indoor residual spraying (IRS); the proportion of households that either owned at least one ITN or received IRS; and the proportion of children who either slept under an ITN the night before the survey or lived in a household that received IRS. Because several indicators were very similar, we report findings for 12 of these indicators in the main text and present results for the other five in Additional file 2. Other indicators of interest, including case management of childhood diarrhea and pneumonia, and artemisinin-based combination therapy for childhood malaria, could not be estimated due to sparse data at the district level. We did not include immunization coverage estimates constructed by pairing data on the number of doses administered with population figures, because, in contrast with survey-based estimates, such measures are often subject to significant numerator and denominator bias which are likely exacerbated at the district level . Due to data availability, we restricted the analysis to the period from 1990 to 2010.
Our modeling strategy, described in more detail below, used the following covariates, identified based on previously established relationships [88-91] and strong correlations in our data: whether the household had electricity, sex of the head of household, household size, average years of education among women 15 to 44 years old, the use of improved wall materials in households, and the number of health facilities per capita in a district. The number of health facilities per capita was only available for the year 2006. Complete definitions of the indicators and covariates are provided in Table 1.
We produced estimates of coverage from each survey-year for each source of data. Our unit of analysis was the district as defined in 2010 for a total of 72 districts. Data collected prior to 2000 referred to a different set of districts totaling 57. For districts that split during the transition from 57 to 72 districts we adjusted estimates from the original district by assuming that the average proportional relationships observed between original and inheriting districts in 2000–2010 applied to the time period 1990–2000 as well. Unlike the earlier Demographic and Health Surveys (DHS) and all three censuses, the 2001–2002 and the 2007 DHS datasets did not contain district identifiers. For the 2007 DHS, the latitude and longitude of each cluster were available and we used these coordinates to identify which district each cluster belonged to. There was no information available in the 2001–2002 survey that allowed us to identify districts, so we used this survey only for province-level estimates.
Except for the Netmark surveys (Table 1), we calculated all indicator estimates according to the definitions in Table 1 using survey microdata, ensuring consistent definitions across sources and taking into account the multistage sampling design for each survey. Surveys provided information for children born up to 5 years before the survey. For ANC, SBA, IPTp immunizations, and EBF, we grouped responses for each child according to year of birth and estimated coverage corresponding to each group for as many years prior to the survey as there were births recorded. Since nationally coordinated programs for ITN distribution and IRS, IPTp, and pentavalent vaccine began in 1999, 2003, and 2005, respectively, we assumed 0.01% coverage for malaria interventions prior to 1997 and for pentavalent immunization prior to 2004. While there were isolated malaria control programs prior to 1997, for example, in Copperbelt province , there was no coordinated national effort for malaria control and the vast majority of the population was not covered by ITNs, IRS, or IPTp [93,94].
In addition to survey-based estimates, we calculated IRS coverage from National Malaria Control Centre (NMCC) administrative data by dividing the reported number of structures sprayed by the number of households in the given district-year according to the census. We interpolated the number of households for years between censuses assuming geometric growth.
In many cases, multiple sources for the same year implied different levels for the same covariate. To address this issue and generate a complete time series that synthesized all available data, we used a two-step statistical model. The first step was a linear mixed-effects model which relates the outcome to year and location. The fixed effects of this model included the bases for a natural spline (a method of interpolation using piecewise polynomials) describing the time trend with one interior knot at 2000 while the random effects included a district-level random intercept and random slope. The second step was a Gaussian process regression (GPR) that uses the results from the first stage as the mean function and draws from a multivariate normal distribution, based on the model’s prior and uncertainty in the data, to generate a final estimate for each indicator-district-year. Provincial estimates of indicators were also produced using this method and used as covariates in the first step of the indicator model described below.
A three-step statistical model was used to generate a complete set of indicator estimates, including uncertainty. The first step of the model was an ordinary least squares (OLS) regression of each indicator. Coverage was modeled in logit space to bound the result between 0 and 1. The following model was run separately for each coverage indicator:
where logit(Ind)i,k,t is the logit-transformed level of coverage for each indicator in district i, province k, and year t; eleci,t is the proportion of households that have electricity in district i and year t; fheadi,t is the proportion of households with a female head in district i and year t; hhsizei,t is the mean household size in district i and year t; edui,t is the mean years of education for women 15 to 44 years old in district i and year t; walli,t is the proportion of dwellings with improved wall type in district i and year t; HFPC i is the number of health facilities per capita in district i; Indk,t is the coverage of the indicator at the province level for province k and year t; and εi,k,t is the error, for district i, province k, and year t.
The second stage in the modeling process involved applying a spatial-temporal regression (ST) to the residuals derived from step 1. ST regression is a form of locally-weighted regression that allows residuals nearby in space and time to have more weight than those farther away. Spatial neighbors were defined as districts within the same province. Temporal neighbors were defined as adjacent data-years within the same district. The predicted residuals from the ST regression are added on to the linear predictions from the OLS regression to generate the mean function used in the final step.
The third and final step is a GPR model with the estimates from the linear and ST regression serving as the mean function. The covariance structure was defined by the Matern Covariance function. We used 1,000 draws from the posterior distribution to calculate estimates of the mean and uncertainty interval (UI). The three step modeling process applied here, including ST and GPR parameters, has been described in detail elsewhere  and has been extensively used in global health systematic analyses, most notably in generating many estimates for the Global Burden of Disease study [9,96-98].
We generated estimates at the national level for each indicator by population-weighting the district values. We also estimated an overall measure of composite coverage, based on 10 indicators that reflect the priorities of Zambia’s health system and cover the full range of interventions we studied: the proportion of households with IRS, ITN ownership, or both; IPTp2; EBF; pentavalent, BCG, measles, and polio immunization coverage; ANC4; SBA; and the proportion of children not underweight. Composite coverage can be constructed using theory-based or arbitrary-weighted averages, or latent variable techniques such as factor analysis . For simplicity and ease of interpretation, we chose to apply equal weights to all interventions, and constructed composite coverage as the simple average of the 10 interventions. We also explored the relationship between socioeconomic status, measured as a composite of four socio-demographic variablesb, and composite coverage, and report the Pearson correlation between these measures across districts and years. In the results section, we present findings for the 12 indicators that are priorities in the Zambian health system. Results for the additional 5 indicators estimated in this analysis are presented in Additional files 2 and 3.
Permission to implement this research project was obtained from the Ministry of Health of Zambia. Ethical approval for this study was obtained from the institutional review board of the University of Washington. The study was conducted in compliance with national regulatory and ethics guidelines.
We found a wide variation in both the levels of coverage and average change between 1990 and 2010 across the 12 indicators shown in Figure 1. For malaria control interventions, the scale-up was remarkable across Zambia (Figure 2A). At the same time, in 2010 ITN ownership ranged from 44% (95% UI: 42–47%) to 90% (95% UI: 85–93%), while use of ITNs by children under the age of 5 years exhibited an even larger range (from 32% [95% UI: 25–40%] to 89% [95% UI: 81–94%]). IPTp2 levels rose rapidly in many districts, but leveled off or experienced declines in coverage in some districts after 2007, and as a result coverage levels ranged from 5% (95% UI: 2–11%) to 96% (95% UI: 92–98%) in 2010.
For immunizations, Zambia maintained high levels of BCG and measles immunization coverage across districts, but polio immunization coverage was highly variable across districts, with a range in 2010 from 24% (95% UI: 11–42%) in Mufumbwe to 99% (95% UI: 98–100%) in Chavuma, both in North-Western province. While at the national level coverage did not change significantly between 1990 and 2010, remaining around 81%, more than half of districts in Zambia had lower levels of polio immunization in 2010 compared to 1990 (Figure 1B). We found similarly large disparities in pentavalent vaccine coverage across districts in 2010; as the vaccine was nationally launched in 2005, this finding likely reflects differential uptake of a new intervention throughout Zambia.
For the other MCH interventions included in this analysis, particularly notable progress was made for EBF (Figure 2B). On average across districts, EBF increased by 79 percentage points, with significant progress observed across all districts (Figure 1B). Districts in Southern province experienced the largest improvements, showing an average 85 percentage point increase in EBF between 1990 and 2010. Progress was also made on malnutrition: the proportion of children who are underweight decreased during this time period and the range across districts is smaller than for any other indicator included in this analysis.
On the other hand, ANC4 and SBA displayed the largest differences in levels and trends. In 2010, the difference between the highest-performing and lowest-performing districts was 86 percentage points for ANC4 and 97 percentage points for SBA. At the same time, national ANC4 decreased by 31 percentage points between 1990 and 2010, and declining trends in many districts were also observed for SBA and polio immunization coverage, shown in more detail in Figure 3. During this 20-year period, 59 (of 72) districts in Zambia experienced declines in ANC4, 31 experienced declines in SBA, and 41 experienced declines in polio immunization. The number of districts with declining coverage is particularly worrisome for polio immunization since coverage dropped in several districts considered at high risk for polio importation from neighboring countries . Figure 3 also highlights that the highest-performing districts in 1990 tended to have the largest declines over the next two decades, while districts with lower baseline coverage achieved the greatest gains. The correlation coefficients between coverage level in 1990 and change between 1990 and 2010 were −0.73 for ANC4, −0.37 for SBA, and −0.76 for polio immunization. Geographic patterns in indicator trends are also notable: districts in Copperbelt province (show in dark blue) had relatively high baseline levels and large declines, while districts in Northern province (dark red) largely had lower baseline levels in 1990 but experienced gains.
Figure 4 shows the national trend in composite coverage by its component interventions. If coverage of all 10 interventions measured here was 100%, then composite coverage would be at 100%. While overall composite coverage increased from 46% in 1990 to 73% in 2010, with more substantial gains in the early 2000s, most of the expansion in composite coverage is due to the scale-up of malaria control, EBF, and pentavalent immunization. Polio immunization, ANC4, and SBA exhibited minimal progress and in some cases declined.
This national trend also masked substantial heterogeneity across districts. While the absolute difference in composite coverage between the highest-performing and lowest-performing districts declined from 37 to 26 percentage points between 1990 and 2010, considerable variation in composite coverage persisted across districts in 2010 (Figure 5). Composite coverage ranged from 58% in Sinazongwe to 85% in Kalulushi; nevertheless, Figure 5 shows that the relative contributions of malaria control, immunizations, and other MCH interventions were actually quite similar across districts. Surprisingly, the bivariate correlation between composite coverage and socioeconomic status was only 0.43.
The findings from this first-ever assessment of levels and trends in coverage of key MCH interventions across districts in Zambia show that substantial progress has been made in scaling up interventions such as malaria control and pentavalent immunization, as well as EBF. At the same time, stagnation and declines of intervention coverage occurred for routine services such as ANC4, SBA, and polio immunization. This district-level analysis revealed marked inequalities in coverage, particularly for maternal health interventions. Rates of progress for routine services varied substantially across districts, while rapidly scaled up interventions showed more uniform improvements across the country. Benchmarking performance of districts in delivering key interventions offers important insights and action points for policymakers, enabling them to identify underperforming districts and interventions with declining trends, as well as understand the largest disparities across districts.
This study revealed that very few districts in Zambia were high performers for all intervention types and, in general, performance was not highly correlated with average district socioeconomic status. While a few districts stand out as having uniformly low coverage and require immediate attention (Chiengi, Samfya, Sinazongwe, and Shang’ombo), several districts had mixed success. For example, coverage in Lusaka (the country’s capital district, a region with lower malaria transmission intensity) in 2010 was above the national average for IRS, IPTp2, BCG, measles, and polio immunization coverage, and SBA, but it was well below the national average for ITN ownership and use, pentavalent immunization, ANC4, and EBF. In contrast to other countries where similar studies have been undertaken, geographic patterns in coverage did not reflect geographic variation in socioeconomic status. For example, in the United States [100-102], Mexico , and China , patterns in health indicators largely mirror geographic variation in socioeconomic status and tend to be uniform across indicators; that is, wealthier regions within each country tend to have high life expectancy and high coverage of interventions such as in-facility delivery and hypertension treatment. In the case of Zambia, the fact that we did not see a strong association between socioeconomic status and coverage suggests that more complex factors are at work. Further investigation is needed to understand the drivers of the variation in performance across districts. In particular, more detailed case studies of districts with heterogeneous performance are needed to elucidate the reasons why certain interventions but not others are successful in these contexts. Zambia’s experience highlights the importance of benchmarking to identify regions of high and low performance for a variety of key health indicators.
This work highlights two major patterns in health system performance across districts in Zambia: success in scaling up vertical programs and stagnation, or even weakening, of horizontal programs. At the national and district level, Zambia achieved greater successes in newer, rapidly scaled up interventions while gains in routine services delivery either stalled or declined, raising concerns that successes in vertical programs may have come at the expense of primary health care. Other key interventions such as HIV/AIDS treatment, prevention of mother-to-child transmission of HIV, and case management of childhood malaria are not covered in the present study due to data limitations, but were also scaled up dramatically in this time period, and may have also contributed to our observed trends in routine service provision. Although there is some evidence that such a ‘crowding-out effect’ did not occur [103,104], the stark contrast between intervention coverage trends from horizontal and vertical programs warrants further examination. Concerns about vertical programs displacing horizontal ones are not unique to Zambia. A key challenge as LMIC health systems grow and the emphasis on UHC is heightened is to balance the roles of vertical and horizontal programs and ultimately leverage both to strengthen overall health system performance in each country. The Mexican health system reform is a notable example of success for implementing a more ‘diagonal’ approach, employing cost-effective interventions that link health facilities to community health needs, and benefiting from a balance between strong primary health care and vertical programs . Zambia, along with many other countries, has begun to make the shift to diagonal programs that combine the strengths of disease-specific and comprehensive delivery systems .
This study underscores the importance of incorporating equity goals in target-setting. Zambia’s scale-up of malaria control at the national level is impressive, but its emphasis on equity is lacking. The country’s National Malaria Strategic Plan 2006–2010 set several malaria intervention coverage targets for the country to achieve by 2010 . These targets were very ambitious, and despite marked progress since 2000, no district achieved all four targets in 2010. Zambia, as well as other countries, would greatly benefit from formulating health policy goals with explicit mention of targets for each district or region, as this would ensure that particular attention and resources are directed to the poorest performing regions. Zambia’s National Health Strategic Plan 2011–2015  emphasizes UHC, equity, and overall health system strengthening, but does not incorporate specific subnational targets. Achievement of the plan’s targets (e.g., to reduce the national under-5 mortality rate from 119 deaths per 1,000 live births to 63 deaths per 1,000 live births by 2015) will require targeting interventions to the most disadvantaged populations. With the appropriate framing and implementation, this plan could be used as a platform to promote greater within-country equality. At the global level, it is well recognized that the lack of clearly incorporating equity into the Millennium Development Goals (MDGs) was a major oversight, one that should not be repeated in the finalization of the forthcoming Sustainable Development Goals (SDGs) [107-109]. The experience of the MDGs warns that national target-setting not only fails to represent those most in need, but that such exercises can actually incentivize the opposite, to target the most accessible populations and to potentially propagate even greater inequalities [110-112].
Incorporating equity into global and national targets has significant implications for data collection systems. Data quality and availability limited the scope of this study, and a future global focus on subnational benchmarking will require substantial strengthening of existing and emerging data collection systems. In this analysis, the generation of district trends in coverage was challenging, and required triangulating information from many sources and applying sophisticated statistical techniques. Zambia is a comparatively data-rich country within sub-Saharan Africa, but most countries, both developed and developing, are not well-equipped for the routine collection and monitoring of data at the most relevant administrative levels. The demand from governments, international agencies, donors, civil society groups, and the public for high quality health information is growing rapidly and existing data collection systems are not keeping pace [113,114]. The MDGs motivated significant improvements in country-level monitoring of key health indicators, but the overarching evidence base and state of data collection systems, particularly in developing countries, remains weak. If the SDGs ultimately include subnational targets, a similar data revolution will be necessary. In order to report on subnational targets for a variety of indicators, data collection systems will need to become more integrated, cover a finer array of geographic regions and health topics, include measures of quality of interventions (such as biomarkers and health examinations), and encourage regular validation and use of the information collected for policymaking.
The findings of this study need to be interpreted within the context of the limitations we encountered. First, the coverage of several key interventions could not be estimated in this analysis due to lack of data. Case management of childhood diarrhea, pneumonia, and malaria could not be estimated because caregivers reported too few cases per survey-district-year. Second, data on additional indicators from several administrative sources (i.e., the NMCC’s ITN distribution database; National AIDS Council quarterly service reports; and Medical Stores Limited drug supply database) were excluded due to concerns about accuracy, completeness, and lack of appropriate denominator data. Third, our estimates of intervention coverage do not reflect the quality of the intervention received or any health gains associated with receiving the intervention. This a critical input for determining the effectiveness of health service provision and understanding whether the receipt or use of an intervention translates into improved health outcomes. Fourth, the findings from this study are largely based on self-reported information from household survey respondents, and thus are prone to biases related to self-reported data. Fifth, we encountered small sample sizes for some indicators from surveys that were not designed to be representative at the district level; for these indicators, coverage estimates were generally accompanied by larger levels of uncertainty. Finally, the analysis presented here did not seek to evaluate the causes of declines, improvements, or differences in coverage across districts and over time. Understanding the drivers of these trends in intervention coverage is critical, and it is likely that much could be learned by conducting a rigorous assessment of these changes.
Subnational benchmarking is important for assessing progress towards UHC, identifying drivers of success, and prioritizing areas of greatest need. This study shows that Zambia saw notable gains in the delivery of malaria control interventions, BCG and measles immunization, and EBF across districts, with small differences in the levels of coverage achieved. On the other hand, for SBA, ANC4, and polio and pentavalent immunization, the gap between the highest-performing and lowest-performing districts was very large. Geographic patterns in intervention coverage were not highly correlated with socioeconomic status, and further investigation is needed to understand what is driving such heterogeneity at the district level. Subnational analyses, such as the work presented here, should be conducted regularly so that the findings they generate can directly inform policy decisions and increase accountability at all levels of the health system and government.
aStunting reflects chronic under-nutrition and wasting reflects acute under-nutrition. We selected underweight because it is representative of both chronic and acute under-nutrition and is the preferred World Health Organization measure of malnutrition .
bThese variables include mean years of education among adults aged 18 and older, coverage of improved sanitation, coverage of improved cooking fuel, and household electricity availability.
Demographic and health survey
Gaussian process regression
Intermittent preventive therapy for malaria during pregnancy
Indoor residual spraying
Low- and middle-income countries
Millennium Development Goals
Maternal and child health
National Malaria Control Centre
Ordinary least squares
Skilled birth attendance
Sustainable Development Goals
Universal Health Coverage
Sustainable Development Knowledge Platform. Open working group proposal for sustainable development goals. https://sustainabledevelopment.un.org/sdgsproposal.
O’Connell T, Rasanathan K, Chopra M. What does universal health coverage mean? Lancet. 2014;383:277–9.
Victora CG, Wagstaff A, Schellenberg JA, Gwatkin D, Claeson M, Habicht J-P. Applying an equity lens to child health and mortality: more of the same is not enough. Lancet. 2003;362:233–41.
Victora CG, Hanson K, Bryce J, Vaughan JP. Achieving universal coverage with health interventions. Lancet. 2004;364:1541–48.
Braveman P, Tarimo E. Social inequalities in health within countries: not only an issue for affluent nations. Soc Sci Med 1982. 2002;54:1621–35.
Barros AJ, Ronsmans C, Axelson H, Loaiza E, Bertoldi AD, França GV, et al. Equity in maternal, newborn, and child health interventions in Countdown to 2015: a retrospective review of survey data from 54 countries. Lancet. 2012;379:1225–33.
Hosseinpoor AR, Victora CG, Bergen N, Barros AJ, Boerma T. Towards universal health coverage: the role of within-country wealth-related inequality in 28 countries in sub-Saharan Africa. Bull World Health Organ. 2011;89:881–9.
Victora CG, Barros AJD, Axelson H, Bhutta ZA, Chopra M, França GVA, et al. How changes in coverage affect equity in maternal and child health interventions in 35 Countdown to 2015 countries: an analysis of national surveys. Lancet. 2012;380:1149–56.
Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2095–128.
World Health Organization. Making fair choices on the path to universal health coverage. Final report of the WHO Consultative Group on Equity and Universal Health Coverage. 2014. http://www.who.int/choice/documents/making_fair_choices/en/.
Bryce J, Arnold F, Blanc A, Hancioglu A, Newby H, Requejo J, et al. Measuring coverage in MNCH: new findings, new strategies, and recommendations for action. PLoS Med. 2013;10:e1001423.
Barros AJD, Victora CG. Measuring coverage in MNCH: determining and interpreting inequalities in coverage of maternal, newborn, and child health interventions. PLoS Med. 2013;10:e1001390.
Countdown 2008 Equity Analysis Group, Boerma JT, Bryce J, Kinfu Y, Axelson H, Victora CG. Mind the gap: equity and trends in coverage of maternal, newborn, and child health services in 54 Countdown countries. Lancet. 2008;371:1259–67.
World Health Organization. Global Health Observatory. 2015. http://www.who.int/gho/en/.
The World Bank. World DataBank poverty and inequality database. 2015. http://databank.worldbank.org/data/home.aspx. Accessed Feb 7 2016.
Gwatkin DR. Health inequalities and the health of the poor: what do we know? What can we do? Bull World Health Organ. 2000;78:3–18.
Steketee RW, Eisele TP. Is the scale up of malaria intervention coverage also achieving equity? PLoS One. 2009;4:e8409.
Houweling TA, Ronsmans C, Campbell OM, Kunst AE. Huge poor-rich inequalities in maternity care: an international comparative study of maternity and child care in developing countries. Bull World Health Organ. 2007;85:745–54.
Wagstaff A. Socioeconomic inequalities in child mortality: comparisons across nine developing countries. Bull World Health Organ. 2000;78:19–29.
Makinen M, Waters H, Rauch M, Almagambetova N, Bitran R, Gilson L, et al. Inequalities in health care use and expenditures: empirical data from eight developing countries and countries in transition. Bull World Health Organ. 2000;78:55–65.
Castro-Leal F, Dayton J, Demery L, Mehra K. Public spending on health care in Africa: do the poor benefit? Bull World Health Organ. 2000;78:66–74.
Van de Poel E, O’Donnell O, Van Doorslaer E. Are urban children really healthier? Evidence from 47 developing countries. Soc Sci Med 1982. 2007;65:1986–2003.
Bhutta ZA, Chopra M, Axelson H, Berman P, Boerma T, Bryce J, et al. Countdown to 2015 decade report (2000–10): taking stock of maternal, newborn, and child survival. Lancet. 2010;375:2032–44.
Khadr Z. Monitoring socioeconomic inequity in maternal health indicators in Egypt: 1995–2005. Int J Equity Health. 2009;8:38.
Fotso J-C. Child health inequities in developing countries: differences across urban and rural areas. Int J Equity Health. 2006;5:9.
Fotso J-C. Urban–rural differentials in child malnutrition: trends and socioeconomic correlates in sub-Saharan Africa. Health Place. 2007;13:205–23.
Firestone R, Punpuing S, Peterson KE, Acevedo-Garcia D, Gortmaker SL. Child overweight and undernutrition in Thailand: is there an urban effect? Soc Sci Med 1982. 2011;72:1420–28.
National Health Performance Committee (NHPC). National Report on Health Sector Performance Indicators 2001. Australian Health Ministers’ Conference. Brisbane: Queensland Health; 2002.
Wolfson M, Podger A. Towards integrated and coherent health information systems for performance monitoring: the Canadian experience. In: OECD. Measuring up: Improving health system performance in OECD countries. Ottawa: OECD Publishing; 2002. p. 133–55.
Kulkarni SC, Levin-Rector A, Ezzati M, Murray CJ. Falling behind: life expectancy in US counties from 2000 to 2007 in an international context. Popul Health Metr. 2011;9:16.
US Burden of Disease Collaborators. The state of US health, 1990–2010: burden of diseases, injuries, and risk factors. JAMA. J Am Med Assoc. 2013;310:591–608.
Dwyer-Lindgren L, Freedman G, Engell RE, Fleming TD, Lim SS, Murray CJ, et al. Prevalence of physical activity and obesity in US counties, 2001–2011: a road map for action. Popul Health Metr. 2013;11:7.
Axelson H, Gerdtham U-G, Ekman B, Hoa DTP, Alfvén T. Inequalities in reproductive, maternal, newborn and child health in Vietnam: A retrospective study of survey data for 1997–2006. BMC Health Serv Res. 2012;12:456.
Meng Q, Xu L, Zhang Y, Qian J, Cai M, Xin Y, et al. Trends in access to health services and financial protection in China between 2003 and 2011: a cross-sectional study. Lancet. 2012;379:805–14.
Singh PK. Trends in child immunization across geographical regions in India: focus on urban–rural and gender differentials. PLoS One. 2013;8:e73102.
Victora CG, Barros FC. Infant mortality due to perinatal causes in Brazil: trends, regional patterns and possible interventions. São Paulo Med J Rev Paul Med. 2001;119:33–42.
Morris SK, Awasthi S, Kumar R, Shet A, Khera A, Nakhaee F, et al. Measles mortality in high and low burden districts of India: Estimates from a nationally representative study of over 12,000 child deaths. Vaccine. 2013;31:4655–61.
Jagnoor J, Suraweera W, Keay L, Ivers RQ, Thakur JS, Jha P, et al. Unintentional injury mortality in India, 2005: Nationally representative mortality survey of 1.1 million homes. BMC Public Health. 2012;12:487.
Morris SK, Bassani DG, Awasthi S, Kumar R, Shet A, Suraweera W, et al. Diarrhea, pneumonia, and infectious disease mortality in children aged 5 to 14 years in India. PLoS One. 2011;6:e20119.
The Million Death Study Collaborators. Causes of neonatal and child mortality in India: a nationally representative mortality survey. Lancet. 2010;376:1853–60.
Nguyen K-H, Jimenez-Soto E, Morgan A, Morgan C, Hodge A. How does progress towards the MDG 4 affect inequalities between different subpopulations? Evidence from Nepal. J Epidemiol Community Health. 2013;67:311–9.
Paudel D, Shrestha IB, Siebeck M, Rehfuess EA. Neonatal health in Nepal: analysis of absolute and relative inequalities and impact of current efforts to reduce neonatal mortality. BMC Public Health. 2013;13:1239.
Countdown to 2015 Equity Working Group. Countdown Equity Country Profiles. 2010. http://www.countdown2015mnch.org/country-profiles.
Van Eijk AM, Hill J, Alegana VA, Kirui V, Gething PW, ter Kuile FO, et al. Coverage of malaria protection in pregnant women in sub-Saharan Africa: a synthesis and analysis of national survey data. Lancet Infect Dis. 2011;11:190–207.
Pande RP, Yazbeck AS. What’s in a country average? Wealth, gender, and regional inequalities in immunization in India. Soc Sci Med 1982. 2003;57:2075–88.
Singh PK, Rai RK, Kumar C. Equity in maternal, newborn, and child health care coverage in India. Glob Health Action. 2013;6:22217.
Wirth ME, Balk D, Delamonica E, Storeygard A, Sacks E, Minujin A. Setting the stage for equity-sensitive monitoring of the maternal and child health Millennium Development Goals. Bull World Health Organ. 2006;84:519–27.
Lozano R, Soliz P, Gakidou E, Abbott-Klafter J, Feehan DM, Vidal C, et al. Benchmarking of performance of Mexican states with effective coverage. Lancet. 2006;368:1729–41.
Noor AM, Mutheu JJ, Tatem AJ, Hay SI, Snow RW. Insecticide-treated net coverage in Africa: mapping progress in 2000–07. Lancet. 2009;373:58–67.
Liu Y, Rao K, Wu J, Gakidou E. China’s health system performance. Lancet. 2008;372:1914–23.
Kumar C, Singh PK, Rai RK. Coverage gap in maternal and child health services in India: Assessing trends and regional deprivation during 1992–2006. J Public Health (Oxf). 2013;35:598–606.
Boutayeb A, Helmert U. Social inequalities, regional disparities and health inequity in North African countries. Int J Equity Health. 2011;10:23.
Edward A, Kumar B, Kakar F, Salehi AS, Burnham G, Peters DH. Configuring balanced scorecards for measuring health system performance: Evidence from 5 years’ evaluation in Afghanistan. PLoS Med. 2011;8:e1001066.
Subramanian SV, Nandy S, Irving M, Gordon D, Lambert H, Davey SG. The mortality divide in India: the differential contributions of gender, caste, and standard of living across the life course. Am J Public Health. 2006;96:818–25.
De Sherbinin A. The biophysical and geographical correlates of child malnutrition in Africa. Popul Space Place. 2011;17:27–46.
Sousa A, Hill K, Poz MRD. Sub-national assessment of inequality trends in neonatal and child mortality in Brazil. Int J Equity Health. 2010;9:21.
Sreeramareddy CT, Harsha Kumar HN, Sathian B. Time trends and inequalities of under-five mortality in Nepal: a secondary data analysis of four demographic and health surveys between 1996 and 2011. PLoS One. 2013;8:e79818.
Adebayo SB, Fahrmeir L, Klasen S. Analyzing infant mortality with geoadditive categorical regression models: a case study for Nigeria. Econ Hum Biol. 2004;2:229–44.
Kraft AD, Nguyen K-H, Jimenez-Soto E, Hodge A. Stagnant neonatal mortality and persistent health inequality in middle-income countries: a case study of the Philippines. PLoS One. 2013;8:e53696.
Pathak P, Singh A. Geographical variation in poverty and child malnutrition in India. In: Singh K, Yadava R, Pandey A, editors. Popul Poverty Health Anal Approaches. New Delhi: Hindustan Publishing Corporation; 2009. p. 183–206.
Singh A, Pathak PK, Chauhan RK, Pan W. Infant and child mortality in India in the last two decades: a geospatial analysis. PLoS One. 2011;6:e26856.
Ahmed S, Hill K. Maternal mortality estimation at the subnational level: a model-based method with an application to Bangladesh. Bull World Health Organ. 2011;89:12–21.
Rai RK, Kumar C, Singh PK. District level coverage gap in maternal, newborn and child health care services in India. J Epidemiol Glob Health. 2012;2:221–4.
Pullan RL, Freeman MC, Gething PW, Brooker SJ. Geographical inequalities in use of improved drinking water supply and sanitation across sub-Saharan Africa: mapping and spatial analysis of cross-sectional survey data. PLoS Med. 2014;11:e1001626.
Kumar C, Singh PK, Rai RK. Under-five mortality in high focus states in India: a district level geospatial analysis. PLoS One. 2012;7:e37515.
Storeygard A, Balk D, Levy M, Deane G. The global distribution of infant mortality: a subnational spatial view. Popul Space Place. 2008;14:209–29.
Bangha MW, Simelane S. Spatial differentials in childhood mortality in South Africa: evidence from the 2001 census. Afr Popul Stud. 2007;2001:3–21.
Asiimwe JB, Jehopio P, Atuhaire LK, Mbonye AK. Examining small area estimation techniques for public health intervention: lessons from application to under-5 mortality data in Uganda. J Public Health Policy. 2011;32:1–14. Discussion 15.
Kandala N-B, Ghilagaber G. A geo-additive Bayesian discrete-time survival model and its application to spatial analysis of childhood mortality in Malawi. Qual Quant. 2006;40:935–57.
Bauze AE, Tran LN, Nguyen K-H, Firth S, Jimenez-Soto E, Dwyer-Lindgren L, et al. Equity and geography: the case of child mortality in Papua New Guinea. PLoS One. 2012;7:e37861.
Ram U, Jha P, Ram F, Kumar K, Awasthi S, Shet A, et al. Neonatal, 1–59 month, and under-5 mortality in 597 Indian districts, 2001 to 2012: estimates from national demographic and mortality surveys. Lancet Glob Health. 2013;1:e219–26.
Sartorius BK, Sartorius K, Chirwa TF, Fonn S. Infant mortality in South Africa – distribution, associations and policy implications, 2007: an ecological spatial analysis. Int J Health Geogr. 2011;10:61.
Gemperli A, Vounatsou P, Kleinschmidt I, Bagayoko M, Lengeler C, Smith T. Spatial patterns of infant mortality in Mali: the effect of malaria endemicity. Am J Epidemiol. 2004;159:64–72.
Kazembe LN, Appleton CC, Kleinschmidt I. Spatial analysis of the relationship between early childhood mortality and malaria endemicity in Malawi. Geospat Health. 2007;2:41–50.
Kazembe LN, Mpeketula PMG. Quantifying spatial disparities in neonatal mortality using a structured additive regression model. PLoS One. 2010;5:e11180.
Chin B, Montana L, Basagaña X. Spatial modeling of geographic inequalities in infant and child mortality across Nepal. Health Place. 2011;17:929–36.
Mulholland E, Smith L, Carneiro I, Becher H, Lehmann D. Equity and child-survival strategies. Bull World Health Organ. 2008;86:399–407.
Mexican Ministry of Health. Effective Coverage of the Health System in Mexico 2000–2003. Federal District, Mexico: Mexican Ministry of Health; 2006.
Gakidou E, Lozano R, González-Pier E, Abbott-Klafter J, Barofsky JT, Bryson-Cahn C, et al. Assessing the effect of the 2001–06 Mexican health reform: an interim report card. Lancet. 2006;368:1920–35.
Murray CJ, Frenk J. A framework for assessing the performance of health systems. Bull World Health Organ. 2000;78:717–31.
Ministry of Health. National Health Strategic Plan 2006–2010. Lusaka: Ministry of Health, Republic of Zambia; 2005.
Ministry of Health. National Health Strategic Plan 2011–2015. Lusaka: Ministry of Health, Republic of Zambia; 2011.
Programme NMC. A road map for impact on malaria in Zambia: a 6-year strategic plan 2006–2011. Lusaka: Ministry of Health, Republic of Zambia; 2006.
Programme NMC. Strategic plan for 2011–2015. Lusaka: Ministry of Health, Republic of Zambia; 2011.
The Partnership for Maternal, Newborn and Child Health. A global review of the key interventions related to reproductive, maternal, newborn and child health. Geneva: PMNCH; 2011.
World Health Organization. Physical status: the use and interpretation of anthropometry. Report of a WHO Expert Committee. Technical Report Series No. 854. Geneva: World Health Organization; 1995.
Burton A, Monasch R, Lautenbach B, Gacic-Dobo M, Neill M, Karimov R, et al. WHO and UNICEF estimates of national infant immunization coverage: methods and processes. Bull World Health Organ. 2009;87:535–41.
Gakidou E, Cowling K, Lozano R, Murray CJL. Increased educational attainment and its effect on child mortality in 175 countries between 1970 and 2009: a systematic analysis. Lancet. 2010;376:959–74.
Chowa G, Ansong D, Masa R. Assets and child well-being in developing countries: a research review. Child Youth Serv Rev. 2010;32:1508–19.
Houweling TAJ, Kunst AE. Socio-economic inequalities in childhood mortality in low- and middle-income countries: a review of the international evidence. Br Med Bull. 2010;93:7–26.
Shengelia B, Tandon A, Adams OB, Murray CJL. Access, utilization, quality, and effective coverage: an integrated conceptual framework and measurement strategy. Soc Sci Med. 2005;61:97–109.
Sharp B, van Wyk P, Sikasote JB, Banda P, Kleinschmidt I. Malaria control by residual insecticide spraying in Chingola and Chililabombwe, Copperbelt Province, Zambia. Trop Med Int Health. 2002;7:732–6.
Chanda E, Masaninga F, Coleman M, Sikaala C, Katebe C, MacDonald M, et al. Integrated vector management: the Zambian experience. Malar J. 2008;7:164.
Chanda E, Kamuliwo M, Steketee RW, Macdonald MB, Babaniyi O, Mukonka VM. An overview of the Malaria Control Programme in Zambia. ISRN Prev Med. 2012;2013:495037.
Foreman KJ, Lozano R, Lopez AD, Murray CJ. Modeling causes of death: an integrated approach using CODEm. Popul Health Metr. 2012;10:1.
Murray CJ, Rosenfeld LC, Lim SS, Andrews KG, Foreman KJ, Haring D, et al. Global malaria mortality between 1980 and 2010: a systematic analysis. Lancet. 2012;379:413–31.
Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet. 2010;375:1609–23.
Rajaratnam JK, Marcus JR, Flaxman AD, Wang H, Levin-Rector A, Dwyer L, et al. Neonatal, postneonatal, childhood, and under-5 mortality for 187 countries, 1970–2010: a systematic analysis of progress towards Millennium Development Goal 4. Lancet. 2010;375:1988–2008.
World Health Organization (WHO). Annual report of the WHO country office Zambia, 2011. Lusaka: WHO; 2011.
Wang H, Schumacher AE, Levitz CE, Mokdad AH, Murray CJ. Left behind: widening disparities for males and females in US county life expectancy, 1985–2010. Popul Health Metr. 2013;11:8.
Danaei G, Rimm EB, Oza S, Kulkarni SC, Murray CJL, Ezzati M. The promise of prevention: the effects of four preventable risk factors on national life expectancy and life expectancy disparities by race and county in the United States. PLoS Med. 2010;7:e1000248.
Dwyer-Lindgren L, Mokdad AH, Srebotnjak T, Flaxman AD, Hansen GM, Murray CJ. Cigarette smoking prevalence in US counties: 1996–2012. Popul Health Metr. 2014;12:5.
Brugha R, Simbaya J, Walsh A, Dicker P, Ndubani P. How HIV/AIDS scale-up has impacted on non- HIV priority services in Zambia. BMC Public Health. 2010;10:540.
Institute for Health Metrics and Evaluation. Health service provision in Zambia: assessing facility capacity, costs of care, and patient perspectives. Seattle, WA: IHME; 2014.
Sepúlveda J, Bustreo F, Tapia R, Rivera J, Lozano R, Oláiz G, et al. Improvement of child survival in Mexico: the diagonal approach. Lancet. 2006;368:2017–27.
Lawn JE, Rohde J, Rifkin S, Were M, Paul VK, Chopra M. Alma-Ata 30 years on: revolutionary, relevant, and time to revitalise. Lancet. 2008;372:917–27.
Waage J, Banerji R, Campbell O, Chirwa E, Collender G, Dieltiens V, et al. The Millennium Development Goals: a cross-sectoral analysis and principles for goal setting after 2015. Lancet. 2010;376:991–1023.
Health and the post-2015 development agenda. Lancet. 2013;381:699.
UNAIDS, UNICEF, UNFPA, WHO. Health in the Post-2015 UN Development Agenda. Thematic Think Piece. UN System Task Team on the Post-2015 Development Agenda. Geneva: UNAIDS; 2012. http://www.un.org/millenniumgoals/pdf/Think%20Pieces/8_health.pdf.
Stuckler D, Basu S, McKee M. Drivers of inequality in millennium development goal progress: a statistical analysis. PLoS Med. 2010;7:e1000241.
Gwatkin DR. How much would poor people gain from faster progress towards the millennium development goals for health? Lancet. 2005;365:813–7.
Easterly W. How the millennium development goals are unfair to Africa. World Dev. 2009;37:26–35.
Boerma JT, Stansfield SK. Health statistics now: are we making the right investments? Lancet. 2007;369:779–86.
Murray CJ. Towards good practice for health statistics: lessons from the Millennium Development Goal health indicators. Lancet. 2007;369:862–73.
This research was carried out as part of the Malaria Control Policy Assessment (MCPA) project in Zambia, a collaboration between the Department of Economics at the University of Zambia and the Institute for Health Metrics and Evaluation at the University of Washington. This project has benefited greatly from key inputs and support from the Ministry of Health, the NMCC, the Central Statistical Office, the Churches Health Association of Zambia, Malaria Care, and the National Food and Nutrition Commission, in Zambia. We are most grateful to these organizations, especially for their willingness to facilitate data access and provide crucial content knowledge. We thank the MCPA Advisory Group, which consists of international and local stakeholders who contributed toward refining the project’s research concept and framework. We also thank the Malaria Control and Evaluation Partnership in Africa team in Zambia for facilitating data access. We thank all members of the MPCA team, including Heather Bonander, Kelsey Pierce, Annie Haakenstad, Caterina Guinovart, Rose Gabert, and Allen Roberts, who contributed to the development and management of the project.
Funding for this research came from the Bill & Melinda Gates Foundation.
All authors declare that they have no competing interests.
KEC contributed to all parts of the analysis, produced the tables and figures, and wrote the first draft of the manuscript. LDL, TA, NF, MS, and MN identified data sources and contributed to the analyses of the microdata and methods development. PM and PH contributed to data acquisition, data verification, and interpretation of findings. FM and EG conceptualized the project and guided the data analysis and manuscript writing. All authors read and approved the final manuscript. KEC and MS were at IHME when the research was undertaken. PM was at the University of Zambia when the research was undertaken.
Additional file 1:
is a table of data sources.
Additional file 2:
is an excel file of intervention coverage and outcome estimates for all districts from 1990 to 2010.
Additional file 3:
features graphics accompanied by a scale that represents intervention coverage or the proportion of children who were underweight ranging from 0% to 100%.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.
The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Colson, K.E., Dwyer-Lindgren, L., Achoki, T. et al. Benchmarking health system performance across districts in Zambia: a systematic analysis of levels and trends in key maternal and child health interventions from 1990 to 2010. BMC Med 13, 69 (2015). https://doi.org/10.1186/s12916-015-0308-5
- Maternal and child health
- Subnational benchmarking