Skip to main content

Cost effectiveness of pediatric pneumococcal conjugate vaccines: a comparative assessment of decision-making tools

Abstract

Background

Several decision support tools have been developed to aid policymaking regarding the adoption of pneumococcal conjugate vaccine (PCV) into national pediatric immunization programs. The lack of critical appraisal of these tools makes it difficult for decision makers to understand and choose between them. With the aim to guide policymakers on their optimal use, we compared publicly available decision-making tools in relation to their methods, influential parameters and results.

Methods

The World Health Organization (WHO) requested access to several publicly available cost-effectiveness (CE) tools for PCV from both public and private provenance. All tools were critically assessed according to the WHO's guide for economic evaluations of immunization programs. Key attributes and characteristics were compared and a series of sensitivity analyses was performed to determine the main drivers of the results. The results were compared based on a standardized set of input parameters and assumptions.

Results

Three cost-effectiveness modeling tools were provided, including two cohort-based (Pan-American Health Organization (PAHO) ProVac Initiative TriVac, and PneumoADIP) and one population-based model (GlaxoSmithKline's SUPREMES). They all compared the introduction of PCV into national pediatric immunization program with no PCV use. The models were different in terms of model attributes, structure, and data requirement, but captured a similar range of diseases. Herd effects were estimated using different approaches in each model. The main driving parameters were vaccine efficacy against pneumococcal pneumonia, vaccine price, vaccine coverage, serotype coverage and disease burden. With a standardized set of input parameters developed for cohort modeling, TriVac and PneumoADIP produced similar incremental costs and health outcomes, and incremental cost-effectiveness ratios.

Conclusions

Vaccine cost (dose price and number of doses), vaccine efficacy and epidemiology of critical endpoint (for example, incidence of pneumonia, distribution of serotypes causing pneumonia) were influential parameters in the models we compared. Understanding the differences and similarities of such CE tools through regular comparisons could render decision-making processes in different countries more efficient, as well as providing guiding information for further clinical and epidemiological research. A tool comparison exercise using standardized data sets can help model developers to be more transparent about their model structure and assumptions and provide analysts and decision makers with a more in-depth view behind the disease dynamics. Adherence to the WHO guide of economic evaluations of immunization programs may also facilitate this process.

Please see related article: http://www.biomedcentral.com/1741-7007/9/55

Peer Review reports

Background

The availability of a seven-valent pneumococal conjugate vaccine (PCV7), which is efficacious in preventing invasive pneumococcal disease (IPD), pneumonia, and acute otitis media (AOM) [1–3], has prompted policymakers to ponder whether or not this vaccine should be included in the national immunization program. The more recent licensure of higher valent PCV vaccines (10-valent and 13-valent pneumococal conjugate vaccines) makes this a harder task still. Cost-effectiveness (CE) analyses can be useful to aid decision making. Numerous economic evaluation studies of PCV-7 have been published since 2000 [4–29]. Despite the availability of a comprehensive critical literature review [30], there is a lack of critical review of the computational reliability and convergent validity of accessible PCV models [31]. Indeed, there is a constant need to verify the actual model structures, model attributes, input parameters, key assumptions and whether different models will produce the same outputs if standardized input parameters are used. Moreover it is not clear what the strengths and possible pitfalls of the available PCV7 models are and the potential to use it for new PCV combinations. In order to guide policymakers in particular from low-income and middle-income countries (LMIC) on the optimal use of decision-making tools, in 2009 the World Health Organization (WHO) invited model developers from both the public and private sectors to submit their tools for a systematic comparative assessment. Rather than having the aim of recommending a single tool, the overall objective of the assessment was to provide decision makers with a menu of CE tools and their characteristics for their optimal use for vaccine adoption decisions.

This paper critically reviews a number of potentially influential and accessible cost-effectiveness tools. We assess the differences and similarities between models and evaluate to which extent the outputs differ given the use of standardized input parameters.

Methods

Comparison of cost-effectiveness models

Several publicly available cost-effectiveness modeling tools with both public and private provenance were identified through literature searches and key informants and contacted by WHO (RH, AMH). Three models were provided to our research team: Pan-American Health Organization (PAHO) ProVac Initiative's [32] TriVac model version 108.5 developed by researchers from London School of Hygiene and Tropical Medicine (LSHTM) [33], the PneumoADIP model (beta version) constructed by researchers from University of Medicine and Dentistry New Jersey (UMDNJ) [34], and the SUPREMES model (version 3.0, succinct Population Research & Economic Modeling Exercise for Synflorixâ„¢) developed by modelers from GlaxoSmithKline Biologicals (GSK) [35] (Table 1). The developers of the models provided access to their tools and explained the model framework via telephone conferences to our research team (RH, NC). These tools are intended by their developers to provide modeling team with predefined set of parameters and mathematical algorithms with which users can interact in order to develop their own cost-effectiveness analyses.

Table 1 Characteristics of cost-effectiveness models (PneumoADIP, Pan-American Health Organization (PAHO) TriVac, and SUPREMES)

We adopted the framework on infectious disease mathematical model attributes by Kim and Goldie to describe all three models [36]. Models were compared in terms of structure, attributes, input parameters and key assumptions against the WHO Guide for standardization of economic evaluations of immunization programs [37].

As models are often updated and revised, the reader should note that for each model the August 2009 version was reviewed.

Standardized input parameters

Despite the differences in terms of model structures and data requirements, we attempt to use a common standardized set of input parameters regarding country demographics, epidemiology and vaccine characteristics in order to facilitate the comparison exercise (see Table 2). Meanwhile it should be clear that only a dataset for a cohort model approach has been developed and not one for a population-based model. A cohort model will focus on the accumulated benefit over time for individuals within the cohort, whereas for a population model the focus is on the immediate benefit across different age cohorts making up the population at the time of the assessment. Hence an analysis of the SUPREMES results was difficult to assess [38]. In order to determine the robustness of the similarities of outputs independent of country-specific data sets, we chose to compare standardized input parameters for three hypothetical but typical countries each representing different regions: sub-Saharan Africa (SSA), South-East Asia (SEA) and Latin America and the Caribbean (LAC).

Table 2 Input values for standardized analysis in each hypothetical country in the sub-Saharan African (SSA) region, Southeast Asian (SEA) region and Latin America and the Caribbean (LAC) region

Sensitivity analysis

All three models have different ways of specifying values for uncertainty and sensitivity analysis. The SUPREMES model applies a predefined non-adjustable rule of 20% adjustment upwards and downwards from the baseline value. The PneumoADIP model does not allow for sensitivity and/or uncertainty analysis, however it can be performed by repeating the model runs for specific scenarios with different input parameters. The PAHO TriVac model provides the user with a default set of parameters, specifying the maximum and minimal values of each parameter if uncertainty information from the user is lacking. We used a series of one-way sensitivity analyses to determine the major drivers of the models by using 20% adjustment upward and downward for several parameters where possible and calculated the boundary values accordingly for the different tools assessed. We adopted the hypothetical country data from the SSA region as an example of the sensitivity analysis in our study.

We categorized the influences of parameters on outputs into four groups: minimally influential (percentage change < 5%), mildly influential (5% to 30%), moderately influential (30% to 50%), and highly influential (> 50%). Tornado plots, a graphical presentation of the results of a series of sensitivity analyses, were used to help visually determine the influential parameters. Regardless of models, parameters with at least mild influence were selected and listed on the Y axis of tornado plots in order to compare the influences of parameters across models. In order to allow for direct comparisons, we chose to present the sensitivity analysis results of PAHO TriVac using 20% adjustment rather than the default values in the model.

Outputs

The outputs chosen for investigation while varying input parameters were differences in outcomes and costs as well as an incremental cost-effectiveness ratios (ICERs). The differences in outcome were presented as disability-adjusted life years (DALYs) averted for the PAHO TriVac and PneumoADIP models and quality-adjusted life years (QALYs) gained for the SUPREMES model, while the differences in cost were expressed in US dollars (US$ 2009). Similarly, the ICERs were presented as incremental costs per DALY averted for the PAHO TriVac and PneumoADIP models and as incremental costs per QALY gained for the SUPREMES model (Table 3).

Table 3 Influencing parameters for outcome, incremental cost and incremental cost effectiveness ratio (ICER) in the models

Results

Comparison of cost-effectiveness models

Model structures

Both the PneumoADIP and PAHO TriVac models are similar as they are deterministic state-transition models. Both models follow more than one live birth cohort over time. The models allow individuals to enter and exit over time, and thus these can be termed 'open' cohort models. This is similar to how vaccination is likely to be implemented in cohorts over time rather than in a single cohort (although from a decisional point of view, this difference in approach should not matter, as this is relevant for the budget-impact calculations, but not for the cost effectiveness). The SUPREMES model has adopted a different approach from the previous two models. Instead of following cohorts over time, it assesses the impact of the vaccine in a cross-sectional population. The developers of the SUPREMES model view their model as a prevalence-based and user-friendly model (succinct model). It relies on a comprehensive, 1-year population-based, age-compartmental modeling exercise that essentially highlights the potential importance of herd immunity effects. According to the developers, the SUPREMES model and the comprehensive model have a close match of > 95% regarding end results. The model assumes the full effects of vaccination on the vaccinated and unvaccinated population at steady state. Therefore, this model assumes that the vaccination has been implemented in the population for a long time and that the complete vaccine effects have been achieved across the whole population, such that a new post-vaccination endemic equilibrium is reached. The evaluation is made over a 1-year period using a prevalence-based approach for assessing all costs and benefits across the whole population.

In terms of structure the three tools are static-deterministic models requiring calculations based on proportions similar to a decision tree approach (see Table 1). Both the PAHO TriVac and PneumoADIP models have a default for input values estimated based on international sources, for example, UN population database, WHO, WHO-CHOICE, UNICEF, Global Burden of Disease (GBD) and Domestic Household Surveys (DHS).

Model attributes

All three models allow for vaccine effectiveness adjustment. All models estimate the vaccine effectiveness based on vaccine coverage and percentage of circulating pneumococci that are caused by the serotypes included in the vaccine (individual or all serotypes). The PAHO TriVac model allows for an adjustment for serotype replacement over time, through an input parameter representing a percentage reduction in circulating pneumococci caused by vaccine serotypes. Despite no direct adjustment for serotype replacement over time, in the SUPREMES model the effects of serotype replacement are combined with those of herd protection into an input parameter expressing the overall indirect vaccine net herd effect. The PneumoADIP model allows for serotype adjustment for each disease separately (for example, pneumococcal pneumonia, meningitis, non-pneumococcal pneumonia).

All models claim to incorporate the herd immunity effects using different approaches. The SUPREMES model estimates that the incidence of vaccine type pneumococcal-related outcomes is lowered with a certain magnitude of reduction in all age groups. This assumes the benefits of herd immunity in both vaccinated (direct effects) and unvaccinated (indirect effects) people. The PAHO TriVac model assumes indirect effects only within the cohort that is targeted for vaccination. In the cost-effectiveness results of both the PAHO TriVac and SUPREMES models herd immunity effects can be included or excluded. In the PneumoADIP model herd effects can be included in the results section. It should be noted that in the base-case cost-effectiveness analysis the herd effects are not accounted for. According to the results presented on the herd effects in the Results section, the model estimates the herd effects among the entire population excluding those less than 1 year of age. The PneumoADIP model does not allow an explicit consideration of serotype replacement to produce net herd immunity effects.

Both the SUPREMES and the PneumoADIP models consider sequelae due to meningitis and acute otitis media. The PAHO TriVac model categorizes sequelae as single and multiple sequelae, and determines the weighted average for all single and multiple sequelae. It also presents, based on the input values, an overall rate and proportion of having sequelae in those with pneumococcal disease.

Input parameters

Some of the requirements for input parameters are quite similar in all three models, but nonetheless several differences should be noted.

The assessed version of PneumoADIP model does not include default values for disease burden estimates (incidence and case-fatality rate) like the other two models. The costing components in the PneumoADIP model include direct medical and non-medical costs and cost for caregivers. The PAHO TriVac model includes both direct medical and non-medical costs and has options for household/government expenditure by disease, by geographical area, various settings and by outpatient pediatric department and inpatient pediatric department. Only direct medical costs have been included in SUPREMES model. The PneumoADIP model takes the perspective of society, the TriVac model takes the perspective of the society and government while the SUPREMES model takes the perspective of healthcare payer with an option to add the societal perspective. Both of the PneumoADIP and SUPREMES models estimated costs from a combination of acute care costs and long-term sequelae costs.

Assessing differences in outputs using standardized input parameters

We found the outputs of the similarly structured PAHO TriVac and PneumoADIP models to be comparable in terms of outcomes, costs, and incremental cost-effectiveness ratio. For example, the incremental cost per DALYs averted for the hypothetical country in the SSA region was US$3,842 and US$3,878/DALY for the PAHO TriVac and PneumoADIP models, respectively. DALYs averted and incremental costs per person were of the same order of magnitude (947 and 1,254 DALYs averted; US$60 and US$80 for TriVac and PneumoADIP, respectively). All outputs for the three hypothetical countries in the three regions are shown in Table 4.

Table 4 Outputs of all three models using standardized set of input parameters for hypothetical countries in the subA-Saharan African (SSA) region, Southeast Asian (SEA) region and Latin America and the Caribbean (LAC) region

Identifying influential parameters in the models

The TriVac and PneumoADIP models yield incremental costs per DALY averted while the SUPREMES model yields incremental cost per QALY gained. Furthermore incremental costs, DALYs averted, and QALYs gained are also reported separately (Table 3).

The PneumoADIP model for the hypothetical country example in the SSA region proposes that the use of PCV results both in cost savings and improved health outcomes, and hence in this model PCV vaccination is the dominant option versus doing nothing (resulting in a negative ICER, which we choose not to present as it could be misleading).

The robustness of the findings in the three models was evaluated with a series of sensitivity analyses using QALYs or DALYs, incremental costs and incremental cost-effectiveness ratio as outputs and presented as tornado plots (Figures 1,2,3).

Figure 1
figure 1

Tornado plots displaying sensitivity analysis (20% change) for TriVac model, PneumoADIP model and SUPREMES model for a hypothetical country in the sub-Saharan Africa (SSA) region using outcomes (disability-adjusted life years (DALYs) averted for TriVac model and PneumoADIP model, quality-adjusted life years (QALYs) gained for SUPREMES model) as an output.

Figure 2
figure 2

Tornado plots displaying sensitivity analysis (20% change) for TriVac model, PneumoADIP model and SUPREMES model for a hypothetical country in the sub-Saharan Africa (SSA) region using incremental costs as an output.

Figure 3
figure 3

Tornado plots displaying sensitivity analysis (20% change) for TriVac model, PneumoADIP model and SUPREMES model for a hypothetical country in the sub-Saharan Africa (SSA) region using incremental cost-effectiveness ratio as an output. For PneumoADIP model, incremental cost-effectiveness ratio was not calculated because it was dominant strategy.

Serotype coverage of pneumonia was found to be the only parameter with moderate influence on the number of DALYs averted in the PAHO TriVac model (Figure 1).

Parameters influencing cost outputs were varying depending on the models (Figure 2). For the PAHO TriVac model, the vaccine dose cost was rated a moderately influential parameter. The total number of births per year was rated as moderately influential for the PneumoADIP model, while rated as highly influential for the SUPREMES model. Vaccine coverage was highly influential for the cost outputs in the PneumoADIP model and moderately influential in the SUPREMES model. Other parameters such as serotype coverage of pneumococcal pneumonia and incidence of pneumonia were shown to be highly influential in the PneumoADIP model, while moderate influence on cost output in the SUPREMES model included vaccine dose cost and the number of vaccine doses.

For the incremental cost-effectiveness ratio (Figure 3), serotype coverage of pneumonia and the number of vaccine doses were a moderately influential parameter in the PAHO TriVac model and SUPREMES models, respectively.

In line with cost-effectiveness literature of immunization programs, discounting was another influential parameter [39, 40]. In the PAHO TriVac model, the changes of this parameter from 0% to 3% and 10% resulted in an important change of DALYs averted and incremental cost per DALY averted. Note that this parameter could not be varied in the PneumoADIP model. For the SUPREMES model, discounting was not needed as the population model evaluates the impact of interventions across all ages at one cross sectional time period of 1 year [38]. Therefore, discounting was not listed as the key influential parameter in this report as it can be varied in only one model.

Discussion

To the best of our knowledge, this research work is the first study conducted with an aim to compare accessible models developed by both the public and private sectors. This review provides insights into differences and similarities of model attributes and key assumptions to understand disease dynamics and key drivers of the results. Importantly, having a full understanding why different tools produce different results will help identify data needs and pitfalls important to the users of such models. Although the models we reviewed were developed to determine value for money of vaccination program, different vaccines were assessed: PneumoADIP assessed the CE of PCV, TriVac assessed the CE of PCV, Haemophilus influenzae B (Hib) and rotavirus vaccines and SUPREMES appraised pneumococcal Haemophilus influenzae protein D-conjugate vaccine (PHiD-CV).

The different model approaches translated in different data input requirements, which made it a challenge to use a standardized data set for the tool comparison exercise. The incidence-based cohort approaches adopted in the PneumoADIP and the PAHO TriVac models are more data demanding and may be more intuitively appealing than the SUPREMES model. The latter model evaluates under static conditions an entire population at specific time point using the total population size and it specific age distribution to estimate the impact of a new vaccine program on total population health during a fixed time period (usually 1 year) and therefore requires fewer data inputs. This feature makes the SUPREMES model useful if the vaccine causes intermediate and important changes to the population and if budget-impact estimates after vaccine introduction are of interest to the decision maker. In addition, the model is easier use and can be applied widely to those countries with limited data but may be more difficult to justify as users would need to agree with several implicit assumptions embedded in the modeling approach.

It is important to note that while all three models were at an advanced stage of development at the time of the comparison exercise, models of this kind are prone to continued extension and elaboration, and weaknesses or absent features listed in this article may be corrected or improved with time. This comparison process can serve a useful purpose in this regard, by giving modelers the opportunity to identify key omissions and improve the accuracy, transparency and usability of their models. For example, since the evaluation in August 2009 the TRIVAC model now includes otitis media outcomes, advanced options for probabilistic sensitivity analysis and scenario analysis, and key assumptions about waning efficacy and age-appropriate vaccination. The present version of the PneumoADIP model allows discount rates to be varied while GSK now has developed a cohort-based version of the SUPREMES model to deal with the different vaccine impact on disease events using cohort-based or population-based model methods [38]. In addition, while none of the three models had been through a validation process at the time of the comparison exercise, the TRIVAC model has since been evaluated by an external expert panel [41]. As models and cumulative effects analysis (CEA tools evolve continued appraisal is needed.

The differences between these models are not only due to the approach and data requirements, but are difficult to distinguish without fully transparent user manuals. The TriVac model has an advanced user-friendly and self-guided function enabling users to properly interpret the research findings.

All three models include the possibility to incorporate the herd immunity effects of the vaccination program, however there are important differences in how this is incorporated and the underlying assumptions in each model. Herd immunity effects have already been shown to be influential in various analyses published before 2006 [30]. However, the closely related effects of serotype replacement, which can partly nullify the beneficial impacts of herd immunity are not taken into account in any of these models. All three models have shown that they acknowledge an important component of outcome, the morbidity or health-related quality of life, because they present the results in terms of incremental costs per DALY averted (PneumoADIP and TriVac) or per QALY gained (SUPREMES).

From the user's perspective, it is very important to be able to identify influential parameters. A series of sensitivity analyses using tornado diagrams has shown that vaccine efficacy against pneumonia, serotype coverage and replacement, vaccine coverage, and disease burden parameters including incidence and case fatality of pneumococcal diseases are the key driver of the outcomes. Unfortunately, evidence to inform one or more of these parameters is often lacking in low-income and middle-income countries and frequently parameters are populated through generalizations made using data from industrialized countries. Vaccination costs was also a parameter of major importance (though not included in the standard sensitivity analyses).

The outputs for TriVac and PneumoADIP were found to be very similar, while the outputs of the SUPREME model were markedly different from the other two models. Given the differences in various aspects such as parameters included in the models, the baseline value used in the model, and model structure, it is not possible to distinguish the sources that could explain the differences in findings. Because discounting is very influencing in this long-term outcome modeling, the lack of discounting in the SUPREME model could be considered a crucial factor that might explain, to a certain extent, the differences in QALYs gained and cost differences. To be more specific, the future outcomes earned by cohort vaccinated previously are measured at the same time for cohort currently being vaccinated.

Conclusions

The main aim of our comparison was not to make the difference between models understandable to model developers but foremost to potential users of these models at the country level. Understanding the differences and similarities of these CE tools will enhance the intended use of these tools by decision makers in terms of feeling ownership of results. This structured tool assessment exercise has shown that the models we compared differed in terms of model structure and key assumptions. Using a standardized input data set for three PCV cost-effectiveness analysis tools revealed that vaccine cost, efficacy and assumptions for critical clinical endpoints are the most influential parameters. Comparison of CE tools should help local policymakers understand the different approaches used in these models, and their advantages and disadvantages in relation to the data they have at their disposal to conduct and economic analysis. For instance, due to the complex nature of the transmission and ecology of pneumococci, many simplifying assumptions were implicitly made about the transmission dynamics in each of these models. All assumptions and simplifications should be well understood, and be transparent to users of such models. Models should be as transparent as possible according to the criteria and requirements presented in the WHO CEA guidelines [37]. By identifying the most relevant key parameters influencing the results of these models, country and region-specific data collection could be focused as appropriately as possible. Priority should be given to improve the data to inform key parameters. In addition, efforts to improve and develop transmission dynamic models with realistic age structures that better describe the natural history of Streptococcus pneumoniae infection and progression to pneumococcal disease and capable of improved investigation of herd immunity and serotype replacement effects are also important. Lastly, the fact that the tools are evaluated and other tools are publicly available enables different stakeholders to learn from each other's experiences. Adherence to the WHO guide of economic evaluations of immunization programs may also facilitate this process [37].

References

  1. Black S, Shinefield H, Fireman B, Lewis E, Ray P, Hansen JR, Elvin L, Ensor KM, Hackell J, Siber G, Malinoski F, Madore D, Chang I, Kohberger R, Watson W, Austrian R, Edwards K: Efficacy, safety and immunogenicity of heptavalent pneumococcal conjugate vaccine in children. Northern California Kaiser Permanente Vaccine Study Center Group. Pediatr Infect Dis J. 2000, 19: 187-195. 10.1097/00006454-200003000-00003.

    Article  CAS  PubMed  Google Scholar 

  2. Black SB, Shinefield HR, Ling S, Hansen J, Fireman B, Spring D, Noyes J, Lewis E, Ray P, Lee J, Hackell J: Effectiveness of heptavalent pneumococcal conjugate vaccine in children younger than 5 years of age for prevention of pneumonia. Pediatr Infect Dis J. 2002, 21: 810-815. 10.1097/00006454-200209000-00005.

    Article  PubMed  Google Scholar 

  3. Whitney CG, Farley MM, Hadler J, Harrison LH, Bennett NM, Lynfield R, Reingold A, Cieslak PR, Pilishvili T, Jackson D, Facklam RR, Jorgensen JH, Schuchat A: Decline in invasive pneumococcal disease after the introduction of protein-polysaccharide conjugate vaccine. N Engl J Med. 2003, 348: 1737-1746. 10.1056/NEJMoa022823. Active Bacterial Core Surveillance of the Emerging Infections Program Network

    Article  PubMed  Google Scholar 

  4. Asensi F, De Jose M, Lorente M, Moraga F, Ciuryla V, Arikian S, Casciano R, Vento M: A pharmacoeconomic evaluation of seven-valent pneumococcal conjugate vaccine in Spain. Value Health. 2004, 7: 36-51. 10.1111/j.1524-4733.2004.71263.x.

    Article  PubMed  Google Scholar 

  5. Bergman A, Hjelmgren J, Ortqvist A, Wisløff T, Kristiansen IS, Högberg LD, Persson KM, Persson U: Cost-effectiveness analysis of a universal vaccination programme with the 7-valent pneumococcal conjugate vaccine (PCV-7) in Sweden. Scand J Infect Dis. 2008, 40: 721-729. 10.1080/00365540802014872.

    Article  PubMed  Google Scholar 

  6. Bos JM, Rumke H, Welte R, Postma MJ: Epidemiologic impact and cost-effectiveness of universal infant vaccination with a 7-valent conjugated pneumococcal vaccine in the Netherlands. Clin Ther. 2003, 25: 2614-2630. 10.1016/S0149-2918(03)80322-3.

    Article  PubMed  Google Scholar 

  7. Bos JM, Rumke HC, Welte R, Spanjaard L, van Alphen L, Postma MJ: Combination vaccine against invasive meningococcal B and pneumococcal infections potential epidemiological and economic impact in The Netherlands. Pharmacoeconomics. 2006, 24: 141-153. 10.2165/00019053-200624020-00004.

    Article  PubMed  Google Scholar 

  8. Butler JR, McIntyre P, MacIntyre CR, Gilmour R, Howarth AL, Sander B: The cost-effectiveness of pneumococcal conjugate vaccination in Australia. Vaccine. 2004, 22: 1138-1149. 10.1016/j.vaccine.2003.09.036.

    Article  PubMed  Google Scholar 

  9. Claes C, Graf von der Schulenburg JM: Cost effectiveness of pneumococcal vaccination for infants and children with the conjugate vaccine PnC-7 in Germany. Pharmacoeconomics. 2003, 21: 587-600. 10.2165/00019053-200321080-00005.

    Article  PubMed  Google Scholar 

  10. Claes C, Reinert RR, von der Schulenburg JM: Cost effectiveness analysis of heptavalent pneumococcal conjugate vaccine in Germany considering herd immunity effects. Eur J Health Econ. 2009, 10: 25-38. 10.1007/s10198-008-0098-1.

    Article  PubMed  Google Scholar 

  11. De Wals P, Petit G, Erickson LJ, Guay M, Tam T, Law B, Framarin A: Benefits and costs of immunization of children with pneumococcal conjugate vaccine in Canada. Vaccine. 2003, 21: 3757-3764. 10.1016/S0264-410X(03)00361-X.

    Article  PubMed  Google Scholar 

  12. Ess SM, Schaad UB, Gervaix A, Pinosch S, Szucs TD: Cost-effectiveness of a pneumococcal conjugate immunisation program for infants in Switzerland. Vaccine. 2003, 21: 3273-3281. 10.1016/S0264-410X(03)00193-2.

    Article  PubMed  Google Scholar 

  13. Hubben GA, Bos JM, Glynn DM, van der Ende A, van Alphen L, Postma MJ: Enhanced decision support for policy makers using a web interface to health-economic models--illustrated with a cost-effectiveness analysis of nation-wide infant vaccination with the 7-valent pneumococcal conjugate vaccine in the Netherlands. Vaccine. 2007, 25: 3669-3678. 10.1016/j.vaccine.2007.01.088.

    Article  CAS  PubMed  Google Scholar 

  14. Lebel MH, Kellner JD, Ford-Jones EL, Hvidsten K, Wang EC, Ciuryla V, Arikian S, Casciano R: A pharmacoeconomic evaluation of 7-valent pneumococcal conjugate vaccine in Canada. Clin Infect Dis. 2003, 36: 259-268. 10.1086/345833.

    Article  PubMed  Google Scholar 

  15. Lloyd A, Patel N, Scott DA, Runge C, Claes C, Rose M: Cost-effectiveness of heptavalent conjugate pneumococcal vaccine (Prevenar) in Germany: considering a high-risk population and herd immunity effects. Eur J Health Econ. 2008, 9: 7-15. 10.1007/s10198-006-0013-6.

    Article  PubMed  Google Scholar 

  16. Marchetti M, Colombo GL: Cost-effectiveness of universal pneumococcal vaccination for infants in Italy. Vaccine. 2005, 23: 4565-4576. 10.1016/j.vaccine.2005.04.033.

    Article  CAS  PubMed  Google Scholar 

  17. McIntosh ED, Conway P, Willingham J, Lloyd A: The cost-burden of paediatric pneumococcal disease in the UK and the potential cost-effectiveness of prevention using 7-valent pneumococcal conjugate vaccine. Vaccine. 2003, 21: 2564-2572. 10.1016/S0264-410X(03)00031-8.

    Article  PubMed  Google Scholar 

  18. McIntosh ED, Conway P, Willingham J, Hollingsworth R, Lloyd A: Pneumococcal pneumonia in the UK--how herd immunity affects the cost-effectiveness of 7-valent pneumococcal conjugate vaccine (PCV). Vaccine. 2005, 23: 1739-1745. 10.1016/j.vaccine.2004.08.051.

    Article  CAS  PubMed  Google Scholar 

  19. Melegaro A, Edmunds WJ: Cost-effectiveness analysis of pneumococcal conjugate vaccination in England and Wales. Vaccine. 2004, 22: 4203-4214. 10.1016/j.vaccine.2004.05.003.

    Article  CAS  PubMed  Google Scholar 

  20. Moore D, Bigham M, Patrick D: Modelling the costs and effects of a universal infant immunization program using conjugated pneumococcal vaccine in British Columbia. Can Commun Dis Rep. 2003, 29: 97-104.

    CAS  PubMed  Google Scholar 

  21. Navas E, Salleras L, Gisbert R, Domínguez A, Timoner E, Ibáñez D, Prat A: Cost-benefit and cost-effectiveness of the incorporation of the pneumococcal 7-valent conjugated vaccine in the routine vaccination schedule of Catalonia (Spain). Vaccine. 2005, 23: 2342-2348. 10.1016/j.vaccine.2005.01.018.

    Article  CAS  PubMed  Google Scholar 

  22. Ray GT, Whitney CG, Fireman BH, Ciuryla V, Black SB: Cost-effectiveness of pneumococcal conjugate vaccine: evidence from the first 5 years of use in the United States incorporating herd effects. Pediatr Infect Dis J. 2006, 25: 494-501. 10.1097/01.inf.0000222403.42974.8b.

    Article  PubMed  Google Scholar 

  23. Ruedin HJ, Ess S, Zimmermann HP, Szucs T: Invasive meningococcal and pneumococcal disease in Switzerland: cost-utility analysis of different vaccine strategies. Vaccine. 2003, 21: 4145-4152. 10.1016/S0264-410X(03)00562-0.

    Article  PubMed  Google Scholar 

  24. Salo H, Sintonen H, Nuorti JP, Linna M, Nohynek H, Verho J, Kilpi T: Economic evaluation of pneumococcal conjugate vaccination in Finland. Scand J Infect Dis. 2005, 37: 821-832. 10.1080/00365540500321512.

    Article  PubMed  Google Scholar 

  25. Silfverdal SA, Berg S, Hemlin C, Jokinen I: The cost-burden of paediatric pneumococcal disease in Sweden and the potential cost-effectiveness of prevention using 7-valent pneumococcal vaccine. Vaccine. 2009, 27: 1601-1608. 10.1016/j.vaccine.2008.12.033.

    Article  PubMed  Google Scholar 

  26. Sinha A, Levine O, Knoll MD, Muhib F, Lieu TA: Cost-effectiveness of pneumococcal conjugate vaccination in the prevention of child mortality: an international economic analysis. Lancet. 2007, 369: 389-396. 10.1016/S0140-6736(07)60195-0.

    Article  PubMed  Google Scholar 

  27. Sinha A, Constenla D, Valencia JE, O'Loughlin R, Gomez E, de la Hoz F, Valenzuela MT, de Quadros CA: Cost-effectiveness of pneumococcal conjugate vaccination in Latin America and the Caribbean: a regional analysis. Rev Panam Salud Publica. 2008, 24: 304-313. 10.1590/S1020-49892008001100002.

    Article  PubMed  Google Scholar 

  28. Tilson L, Usher C, Butler K, Fitzsimons J, O'Hare F, Cotter S, O'Flanagan D, Johnson H, Barry M: Economic evaluation of a universal childhood Pneumococcal Conjugate Vaccination strategy in Ireland. Value Health. 2008, 11: 898-903. 10.1111/j.1524-4733.2008.00341.x.

    Article  PubMed  Google Scholar 

  29. Wisløff T, Abrahamsen TG, Bergsaker MA, Løvoll Ø, Møller P, Pedersen MK, Kristiansen IS: Cost effectiveness of adding 7-valent pneumococcal conjugate (PCV-7) vaccine to the Norwegian childhood vaccination program. Vaccine. 2006, 24: 5690-5699. 10.1016/j.vaccine.2006.04.042.

    Article  PubMed  Google Scholar 

  30. Beutels P, Thiry N, Van Damme P: Convincing or confusing? Economic evaluations of childhood pneumococcal conjugate vaccination--a review (2002-2006). Vaccine. 2007, 25: 1355-1367. 10.1016/j.vaccine.2006.10.034.

    Article  PubMed  Google Scholar 

  31. Weinstein MC, Toy EL, Sandberg EA, Neumann PJ, Evans JS, Kuntz KM, Graham JD, Hammitt JK: Modeling for health care and other policy decisions: uses, roles, and validity. Value Health. 2001, 4: 348-361. 10.1046/j.1524-4733.2001.45061.x.

    Article  CAS  PubMed  Google Scholar 

  32. Andrus J, Toscano C, Lewis M, Oliveira L: A model for enhancing evidence-based capacity to make informed policy decisions on the introduction of new vaccines in the Americas: PAHO's ProVac initiative. Public Health Rep. 2007, 122.

    Google Scholar 

  33. TriVac: Integrated vaccine impact and cost-effectiveness model for evaluating Hiv, Rotavirus and Pneumoccocal vaccines. PAHO's ProVac Initiative (Rotavirus and Pneumoccocal component) and GAVI's Hib Initiative (Hib component). 2010, [http://new.paho.org/provac/index.php?option=com_content&task=view&id=1590&Itemid=1405]

  34. Interactive Pneumococcal Vaccination Policy Model. 2010, [http://www.preventpneumo.org/data-tools/Cost_Effectiveness_Model.cfm]

  35. De Wals P, Black S, Borrow R, Pearce D: Modeling the impact of a new vaccine on pneumococcal and nontypable Haemophilus influenzae diseases: a new simulation model. Clin Ther. 2009, 31: 2152-2169. 10.1016/j.clinthera.2009.10.014.

    Article  PubMed  Google Scholar 

  36. Kim S, Goldie S: Cost-effectiveness analysis of vaccination programmes: a focused review of modelling approaches. Pharmacoeconomics. 2008, 26: 191-215. 10.2165/00019053-200826030-00004.

    Article  PubMed  Google Scholar 

  37. WHO: Guide for standardization of economic evaluations in the field of vaccine-preventable diseases. 2008, Geneva, Switzerland: WHO

    Google Scholar 

  38. Standaert B, Demarteau N, Talbird S, Mauskopf J: Modelling the effect of conjugate vaccines in pneumococcal disease: cohort or population models?. Vaccine. 2010, 28 (Suppl 6): G30-G38.

    Article  CAS  PubMed  Google Scholar 

  39. Beutels P, Scuffham PA, MacIntyre CR: Funding of drugs: do vaccines warrant a different approach?. Lancet Infect Dis. 2008, 8: 727-733. 10.1016/S1473-3099(08)70258-5.

    Article  PubMed  Google Scholar 

  40. Brouwer WB, Niessen LW, Postma MJ, Rutten FF: Need for differential discounting of costs and health effects in cost effectiveness analyses. BMJ. 2005, 331: 446-448. 10.1136/bmj.331.7514.446.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Pan-American Health Organization: Expert review of a cost-effectiveness model to evaluate Pneumococcal and Rotavirus vaccines in the countries of Latin America and the Caribbean. 2009, Washington, DC: Pan American Health Organization

    Google Scholar 

Pre-publication history

Download references

Acknowledgements

We thank the model developers, Dr Andy Clark from the London School of Hygiene and Tropical Medicine in London (UK), Drs Anushua Sinha and C Greg Hagerty from the University of Medicine and Dentistry New Jersey, New Jersey Medical School in New Jersey (USA), Robert Wood Johnson, Medical School in New Jersey (USA) and Dr Baudouin Standaert, Health Economics GCRD, GlaxoSmithKline Biologicals (GSK), Rixensart (Belgium) for providing the modeling tools, their comments to earlier drafts of the manuscripts and their collaboration to make this tool comparison exercise possible. Specific questions regarding the succinct SUPREMES and comprehensive model from GSK should be attended to Dr Baudouin Standaert - baudouin.a.standaert@gskbio.com. In addition we would like to thank Dr Carsten Mantel from the Immunization, Vaccines and Biologicals (IVB) department at WHO, Geneva for his support to the study and his comments to earlier drafts of the manuscript. Finally we would like to thank the participants of the cost-effectiveness workshop at the Global New and Under-utilized Vaccines Implementation (NUVI) meeting in 16-18 June 2009 in Montreux, Switzerland for their contribution to the discussions. This study was funded by the World Health Organization.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Raymond Hutubessy.

Additional information

Competing interests

JE's partner is currently employed for GlaxoSmithKline, manufacturer of a pediatric pneumococcal vaccine. All the other authors declare that they have no competing interests. AMH and RH are staff members of the World Health Organization. The authors alone are responsible for the views expressed in this publication and they do not necessarily represent the decisions, policy or views of the World Health Organization.

Authors' contributions

RH and AMH conceived the study. NC and RS integrated the results from different models and drafted the manuscript with input from the other authors. All authors provided advice on the methodology and the data analyses of tool comparison exercise. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Chaiyakunapruk, N., Somkrua, R., Hutubessy, R. et al. Cost effectiveness of pediatric pneumococcal conjugate vaccines: a comparative assessment of decision-making tools. BMC Med 9, 53 (2011). https://doi.org/10.1186/1741-7015-9-53

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1741-7015-9-53

Keywords