Research article
Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Where is the supporting evidence for treating mild to moderate chronic obstructive pulmonary disease exacerbations with antibiotics? A systematic review

  • Milo A Puhan1, 2Email author,
  • Daniela Vollenweider1,
  • Johann Steurer1,
  • Patrick M Bossuyt3 and
  • Gerben ter Riet4
BMC Medicine20086:28

https://doi.org/10.1186/1741-7015-6-28

©  Puhan et al; licensee BioMed Central Ltd. 2008

Received: 15 April 2008

Accepted: 10 October 2008

Published: 10 October 2008

Open Peer Review reports

Abstract

Background

Randomised trials comparing different drugs head-to-head are extremely valuable for clinical decision-making. However, it is scientifically and ethically sensible to demand strong evidence that a drug is effective by showing superiority over a placebo before embarking on head-to-head comparisons of potentially ineffective drugs. Our aim was to study the evolvement of evidence from placebo-controlled and head-to-head trials on the effects of antibiotics for the treatment of mild to moderate exacerbations of chronic obstructive pulmonary disease.

Methods

We conducted a historical systematic review. Through electronic databases and hand-searches, we identified placebo-controlled and head-to-head antibiotic trials for the treatment of mild to moderate chronic obstructive pulmonary disease exacerbations. We compared the numbers of patients recruited in placebo-controlled and head-to-head trials between 1957 and 2005. Using cumulative meta-analysis of placebo-controlled trials, we determined when, if ever, placebo-controlled trials had shown convincing evidence that antibiotics are effective in preventing treatment failure in patients with mild to moderate chronic obstructive pulmonary disease exacerbations.

Results

The first head-to-head trial was published in 1963. It was followed by another 100 trials comparing different antibiotics in a total of 34,029 patients with mild to moderate chronic obstructive pulmonary disease exacerbations. Over time, the cumulative odds ratio in placebo-controlled trials remained inconclusive throughout with odds ratios ranging from 0.39 (95% confidence intervals 0.04–4.22) to the most recent estimate (1995) of 0.81 (95% confidence intervals 0.52–1.28, P = 0.37).

Conclusion

Placebo-controlled trials do not support the use of antibiotics in chronic obstructive pulmonary disease patients with mild to moderate exacerbations. Conducting head-to-head trials is, therefore, scientifically and ethically questionable. This underscores the requirement to perform or study systematic reviews of placebo-controlled trials before conducting head-to-head trials.

Background

The Helsinki Declaration emphasises the great importance of conducting experimental studies for medical progress. However, it also states that one should be very careful before embarking on randomised trials with placebo controls because research participants have a right to the best available treatment [1]. Worries about the 'unethical use of placebo' continue [2, 3]. However, what about the reverse scenario? Might there be cases where experimental treatment did not show superiority over placebo but where the placebo controls were abandoned nevertheless, thus exposing patients to adverse effects and society to healthcare expenditures not offset by any beneficial effects?

There is a large number randomised trials comparing different antibiotics (without placebo control) for the treatment of exacerbations of chronic obstructive pulmonary disease (COPD). Although it may seem plausible that antibiotics are beneficial in about 50% of the COPD patients in whom bacteria are the cause of the exacerbation [4], there is evidence indicating that antibiotics have a short-term effect only in COPD patients with severe exacerbations but not in mild to moderate exacerbations [5]. Although head-to-head comparisons of different treatment options available in clinical practice can be very useful [6], an underlying assumption of such trials is that the treatments are effective compared with a placebo [7–9]. While conducting a series of systematic reviews of treatments in COPD, we gained the impression that the evaluation of antibiotics for COPD exacerbations had moved to head-to-head comparisons of different antibiotics with very little research in placebo-controlled trials. We set out to test this hypothesis in a more systematic way. We counted the number of randomised trials of antibiotic treatment for mild to moderate exacerbations in COPD patients published in the last 50 years, determined whether they used a placebo control or conducted head-to-head comparisons, and contrasted the number of patients studied with the results of a cumulative meta-analysis, using data from a recently published systematic review.

Methods

Data sources and searches

For the identification of antibiotics trials in COPD patients, we used a comprehensive literature search described elsewhere [5]. In brief, information specialists (Bazian, London, UK, http://www.bazian.com) searched the Cochrane Central Register of Controlled Trials (CENTRAL, 2005 issue 4), PREMEDLINE (1960 to 1965), MEDLINE (1966 to March 2006), EMBASE (1974 to March 2006), the Database of Abstracts of Reviews of Effects (DARE, March 2006) for any randomised trials on antibiotics in COPD patients. Two reviewers independently assessed the titles and abstracts of all the identified citations without imposing any language restrictions. The full text of any article that seemed potentially eligible by one of the reviewers was ordered. The reviewers then evaluated the full text of retrieved articles and selected those meeting the inclusion criteria. Each reviewer's decisions were recorded in the Endnote file and any disagreements were resolved by consensus.

Study selection

We included randomised head-to-head trials comparing any antibiotics or an antibiotic with placebo for the treatment of mild to moderate exacerbations in COPD patients. Placebo-controlled trials allow for an estimation of the specific effects of the treatment and offer a proof of effectiveness [7].

As with any systematic review on this topic, a difficulty is that definitions of COPD have varied over time. In particular, spirometry criteria became widespread only after 1995 and we accepted a clinical diagnosis of COPD, chronic bronchitis or emphysema. However, in order to include only trials whose patients were very likely to have COPD, we included studies only if patients with chronic bronchitis were at least 40 years of age and/or if at least 80% were smokers or ex-smokers. The presence of these characteristics (chronic bronchitis, age and smoking history) renders a diagnosis of COPD according to modern (spirometric) criteria extremely likely [10]. We defined patients to have 'mild to moderate exacerbations' if they needed any outpatient treatment (level I exacerbation) according to the Operational Classification of Severity of the European Respiratory and American Thoracic Societies [11].

Data extraction and analysis

For each trial, one reviewer recorded details about the type of trial (placebo-controlled or head-to-head), year of publication and number of included patients. A second reviewer checked data extraction for correctness. We calculated the cumulative number of patients included in these trials over the years. We plotted the cumulative number of patients against the year of publication. A systematic review of the placebo-controlled trials has been reported elsewhere [5]. We conducted a cumulative meta-analysis of the effects of antibiotics on treatment failure, commonly used as the main outcome, using the set of placebo-controlled trials. With the cumulative meta-analysis we determined when, if ever, placebo-controlled trials had shown convincing evidence that antibiotics were effective in preventing treatment failure in mild to moderate exacerbations. Thus the cumulative meta-analysis showed what the state of knowledge would have been if people had reviewed the published literature. In a sensitivity analysis, we included another trial [12] that we, as reported previously [5], excluded from the main analyses because we had major doubts about the reported results. We were interested in whether inclusion of this trial changed the cumulative odds ratio (OR) significantly. We conducted all analyses in STATA for windows version 9.2 (Stata Corp; College Station, TX, US).

Results

Placebo-controlled and head-to-head trials

Out of 15 placebo-controlled trials, seven enrolled outpatients with mild to moderate exacerbations. We identified a total of 212 head-to-head trials, of which 101 explicitly enrolled outpatients with mild to moderate exacerbations and 63 enrolled inpatients. In 48 trials, patients with any severity of exacerbations were enrolled or severity of the exacerbation could not be determined.

Figure 1 shows the cumulative number of placebo-controlled and head-to-head trials as well as the number of enrolled patients between 1957 and 2005. Over this period of almost 50 years, the 101 head-to-head trials enrolled a total of 34,029 patients with mild to moderate exacerbations.
Figure 1

Number of patients in antibiotic trials. Cumulative number of patients with chronic obstructive pulmonary disease enrolled in placebo-controlled and head-to-head trials evaluating antibiotics in patients with mild to moderate exacerbations from the first published trials until 2005.

The first head-to-head trial in 1963 [13] included patients with mild to moderate exacerbations and compared sulphonamide with penicillin, with the aim of finding an antibiotic with fewer adverse events than oxytetracycline, the drug used in the three earlier placebo-controlled trials [14–16]. As in many of the following head-to-head trials [17], the role of the antibiotic itself was not questioned. A common reason to justify a head-to-head trial was that antibiotics are effective against organisms most commonly associated with purulent sputum in chronic bronchitis, such as Haemophilus influenzae and Streptococcus pneumoniae. Thus rather than citing evidence from placebo-controlled trials, they referred to the in-vitro activity of antibiotics (for example [18, 19]). Yet another group of head-to-head trials referred to placebo-controlled trials to justify their head-to-head trials but selectively cited only those trials with positive results [20, 21].

Evidence on the effects of antibiotics in mild to moderate COPD exacerbations

The seven trials included a total of 990 outpatients with mild to moderate exacerbations. Figure 2 shows the cumulative meta-analyses for the five trials reporting on treatment failure. In one trial, treatment failure was defined as event-based because of the need for further antibiotics [15] and in four trials, a symptom-based definition of treatment failure was used [14, 22–24]. Cumulative ORs never reached statistical significance and the most recent (1995) cumulative OR was 0.81 (95% confidence interval (CI) 0.52–1.28, P = 0.37). When we also included another trial [12], as explained above, the cumulative OR also remained non-significant (0.50, 95% CI 0.20–1.24, P = 0.14). In other words, cumulative evidence from placebo-controlled trials did not show any significant effects of antibiotics on treatment failure in COPD patients with mild to moderate exacerbations.
Figure 2

Evidence on the effects of antibiotics in chronic obstructive pulmonary disease exacerbations. Cumulative meta-analyses of placebo-controlled trials, which evaluated the effects of antibiotics on treatment failure in patients with mild to moderate exacerbations.

The rationale for the first placebo-controlled trials was reported to be the uncertainty about the benefits of a 'short course' of 'intermittent' antibiotic therapy for exacerbations [14–16]. The authors explicitly stated the short duration of antibiotic treatment because prophylactic long-term use of antibiotics to prevent exacerbations was quite common at that time [25]. Over the following 40 years, authors of placebo-controlled trials argued that these trials are required because 'the role of the [antibiotic] therapy is not clear' [22], or because 'it is still not sufficiently clarified whether acute exacerbations of chronic bronchitis should be treated with antibiotics' [23]. These statements reflect the ongoing debate about the usefulness of antibiotics for COPD exacerbations.

Discussion

Our historical analysis showed that many head-to-head trials of antibiotics for mild to moderate COPD exacerbations have been conducted although evidence from randomised placebo-controlled trials never showed that antibiotics were effective at all. So, in this case, the evaluation of antibiotics did not follow the general principle that placebo-controlled trials must have shown that the treatment is better than the placebo or a sham procedure, before head-to-head trials are to be conducted [9].

Our study has some strengths and limitations. We used a comprehensive literature search to identify trials. The selection of a widely prescribed drug for a major disease makes our 'case report' meaningful, because we could base our historical analysis on a large number of trials. A limitation of systematic reviews in COPD is the evolution of definitions and classifications of COPD over the years. This raises uncertainty about the nature of the study populations included in trials published before 1995 or even before 2000. Many trials included patients with 'chronic bronchitis' who did not present evidence of chronic airflow obstruction or poor reversibility of airflow obstruction.

It should be emphasised that the results of this study apply to antibiotic treatment for mild to moderate COPD exacerbations. In patients with severe exacerbations, antibiotics show a strong effect not only on treatment failure but also on mortality [5]. Our analysis of placebo-controlled trials differs to some extent to that of the Cochrane review [26] because we did not include a study [27] that was not a randomised but, in our opinion, a matched controlled study. However, we included the trial by Sachs et al [24] missed by the Cochrane review and received the original data from the authors. However, the Cochrane review [26] also showed that antibiotics have a significant effect on treatment failure in hospitalised patients but not in outpatients.

We have focused in our analysis on one major treatment for COPD patients. It remains unclear if head-to-head trials are conducted frequently in other areas without an evidence base from placebo-controlled trials. It is conceivable that this example of antibiotics is just the tip of the iceberg. A recent systematic review summarised placebo-controlled and head-to-head trials of exercise for low back pain [28]. Head-to-head trials were conducted over the same period of time as the placebo-controlled trials. The same applies to trials evaluating antidepressants for elderly people [29, 30] or antibiotics for acute otitis media in children [31, 32]. For these widely prescribed treatments for common conditions, it remains as yet uncertain whether the conduct of head-to-head trials was scientifically and ethically justified.

Further studies are warranted to estimate the magnitude of the phenomenon that conduct of head-to-head trials is not solidly based on evidence from placebo-controlled trials. It is unclear why investigators rarely refer to existing systematic reviews to justify their trials scientifically and ethically, although access to such systematic reviews has become so easy [33]. We also need to find out what triggers investigators to conduct head-to-head trials too early. The reports on head-to-head trials on antibiotics shed some light on this tendency. High plausibility that an intervention works may be one of the most important reasons. For antibiotics, evidence is available about their in-vitro activity against the bacteria commonly found in COPD exacerbations. Intuitively, one may extrapolate this to the clinical situation. Physicians are also confirmed in their habit of antibiotic prescription because most outpatients with mild to moderate exacerbations recover within 2 weeks. Yet they do not seem to be aware of the 'natural' recovery rate (that is, without antibiotics) in these patients, which is 80% or more and equal to that in patients receiving placebo [5].

In general, the pharmaceutical industry tends to favour placebo-controlled trials in order to show large effects and to avoid direct comparison with competitors. In situations like this, however, where comparisons with placebo do not favour a drug, the pharmaceutical industry might be more interested in head-to-head trials. Once a treatment, such as antibiotics for COPD exacerbations, is established in clinical practice an attractive market is available. If a company wants to enter this market it needs to provide a trial showing clinical non-inferiority of a new antibiotic and some advantages in terms of adverse effects or costs. Hence, chance aside, even a new antibiotic lacking specific activity will not be inferior to any established antibiotic in COPD outpatients. This will make it relatively easy to get approval from regulatory agencies, as long as the drug is safe.

As mentioned above, placebo-controlled trials continue to be conducted even if the effectiveness of a drug has been definitively established. Fergusson et al [2] provided an impressive example on that problem recently. They identified all comparisons of aprotinin, which limits perioperative bleeding and reduces the need for blood transfusions, with a placebo. After 12 placebo-controlled trials, the effect estimates stabilised at a cumulative OR of 0.25 for the need for blood transfusions favouring aprotinin. Nevertheless, another 52 randomised placebo-controlled trials were conducted although that was ethically not justifiable [3]. These trials cited previous randomised controlled trials very poorly so that readers were not aware that the question had been answered definitively by previous trials.

The unjustified conduct of placebo-controlled or head-to-head trials can be prevented if funding bodies and ethical committees ask investigators to present a systematic review that justifies a new trial. Such systematic reviews are often available already, for example, published by the Cochrane Collaboration. If not, investigators need to carry out a systematic review themselves and publish it regardless of the findings in order to stimulate a public discussion about the need for new trials. Uncertainty about the effectiveness of a treatment should be discussed openly because it may also encourage patients and physicians to participate in a new trial.

Conclusion

Our historical analysis showed that the evaluation of antibiotics for mild to moderate COPD exacerbations has been far from optimal. Head-to-head trials have been conducted without any supporting evidence from placebo-controlled trials. This phenomenon raises important scientific and ethical concerns and more studies are warranted to find out its prevalence, mechanisms and consequences in medicine. In the meantime, public funding bodies and ethical committees in particular should encourage the careful conduct or study of pertinent systematic reviews before supporting the conduct of new trials.

List of abbreviations

CI: 

confidence interval

COPD: 

chronic obstructive pulmonary disease

OR: 

odds ratio

Declarations

Acknowledgements

MAP's work was done at the University of Zurich. The Zurich Lung League funded this study with an unrestricted grant to the Horten Centre. MAP's work was supported by the Swiss National Science Foundation (grant # 3233B0-115216). These funding sources did not have any influence on the design, conduct, analysis and reporting of the study.

Authors’ Affiliations

(1)
Horten Centre for Patient-oriented Research and Knowledge Transfer, University of Zurich
(2)
Johns Hopkins Bloomberg School of Public Health, Department of Epidemiology, Johns Hopkins University
(3)
Academic Medical Center, Department of Clinical Epidemiology, Bioinformatics and Biostatistics, University of Amsterdam
(4)
Academic Medical Center, Department of General Practice, University of Amsterdam

References

  1. World Medical Association: Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2000, 284: 3043-3045. 10.1001/jama.284.23.3043.View ArticleGoogle Scholar
  2. Fergusson D, Glass KC, Hutton B, Shapiro S: Randomized controlled trials of aprotinin in cardiac surgery: could clinical equipoise have stopped the bleeding?. Clin Trials. 2005, 2: 218-229. 10.1191/1740774505cn085oa.View ArticlePubMedGoogle Scholar
  3. Michels KB, Rothman KJ: Update on unethical use of placebos in randomised trials. Bioethics. 2003, 17: 188-204. 10.1111/1467-8519.00332.View ArticlePubMedGoogle Scholar
  4. Sethi S: Bacteria in exacerbations of chronic obstructive pulmonary disease: phenomenon or epiphenomenon?. Proc Am Thorac Soc. 2004, 1: 109-114. 10.1513/pats.2306029.View ArticlePubMedGoogle Scholar
  5. Puhan MA, Vollenweider D, Latshang T, Steurer J, Steurer-Stey C: Exacerbations of chronic obstructive pulmonary disease: when are antibiotics indicated? A systematic review. Respir Res. 2007, 8: 30-10.1186/1465-9921-8-30.View ArticlePubMedPubMed CentralGoogle Scholar
  6. Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290: 1624-1632. 10.1001/jama.290.12.1624.View ArticlePubMedGoogle Scholar
  7. Schwartz D, Lellouch J: Explanatory and pragmatic attitudes in therapeutical trials. J Chronic Dis. 1967, 20: 637-648. 10.1016/0021-9681(67)90041-0.View ArticlePubMedGoogle Scholar
  8. Djulbegovic B, Clarke M: Scientific and ethical issues in equivalence trials. JAMA. 2001, 285: 1206-1208. 10.1001/jama.285.9.1206.View ArticlePubMedGoogle Scholar
  9. ICH Steering Committee: Harmonised tripartite guideline: choice of control group and related issues in clinical trials (E10). International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use: Geneva. 2000, [http://www.ich.org/LOB/media/MEDIA486.pdf]Google Scholar
  10. Straus SE, McAlister FA, Sackett DL, Deeks JJ: The accuracy of patient history, wheezing, and laryngeal measurements in diagnosing obstructive airway disease. CARE-COAD1 Group. Clinical assessment of the reliability of the examination-chronic obstructive airways disease. JAMA. 2000, 283: 1853-1857. 10.1001/jama.283.14.1853.View ArticlePubMedGoogle Scholar
  11. European Respiratory Society/American Thoracic Society: Standards for the diagnosis and treatment of patients with chronic obstructive pulmonary disease. Last accessed 5 November 2007., [http://www.ersnet.org/lrPresentations/copd/files/main/index.html]
  12. Allegra LG, Grassi C, Grossi E, Pozzi E, Blasi F, Frigerio D, Nastri A, Montanari C, Montanari M, Serra G: The role of antibiotics in the treatment of chronic bronchitis exacerbation: follow-up of a multicenter study. Ital J Chest Dis. 1991, 45: 138-148. <Author: Please check the title of the journal>Google Scholar
  13. Christiansen I, Midtgaard KA: comparison of sulfonamide and penicillin treatment of acute exacerbations in chronic bronchitis. Ugeskr Laeger. 1963, 125: 1041-1044.PubMedGoogle Scholar
  14. Berry DG, Fry J, Hindley CP, Hodson JM, Horder EJ, Horder JP, Marien EA, Rea JN, Ryle A, Curwen MP, Tomlinson AJ: Exacerbations of chronic bronchitis treatment with oxytetracycline. Lancet. 1960, 1: 137-139. 10.1016/S0140-6736(60)90056-8.View ArticlePubMedGoogle Scholar
  15. Elmes PCF, Fletcher CM, Dutton AA: Prophylactic use of oxytetracycline for exacerbations of chronic bronchitis. Br Med J. 1957, 5056: 1272-1275.View ArticleGoogle Scholar
  16. Fear EC, Edwards G: Antibiotic regimens in chronic bronchitis. Br J Dis Chest. 1962, 56: 153-162. 10.1016/S0007-0971(62)80012-6.View ArticlePubMedGoogle Scholar
  17. Wegmuller E: The treatment of chronic bronchitis with trimethoprim-sulphamethoxazole (bactrim) a double-blind trial in comparison with epicillin (spectacillin). Schweiz Rundsc Med Prax. 1979, 68: 944-949.Google Scholar
  18. Burrow G, Fox A, Daniel R: A comparative trial of minocin (minocycline hydrochloride) and ampicillin in the treatment of acute exacerbations of chronic bronchitis. J Int Med Res. 1975, 3: 304-308.Google Scholar
  19. Hamilton BA, O'Bryan T, Markanday S: Lomefloxacin vs amoxicillin in patients with acute exacerbations of chronic bronchitis. Drugs. 1993, 45 (Suppl 3): 411-412.View ArticleGoogle Scholar
  20. Fogarty C, de Wet R, Mandell L, Chang J, Rangaraju M, Nusrat R: Five-day telithromycin once daily is as effective as 10-day clarithromycin twice daily for the treatment of acute exacerbations of chronic bronchitis and is associated with reduced health-care resource utilization. Chest. 2005, 128: 1980-1988. 10.1378/chest.128.4.1980.View ArticlePubMedGoogle Scholar
  21. Willey RF, Gould JC, Grant IW: A comparison of ampicillin, erythromycin and erythromycin with sulphametopyrazine in the treatment of infective exacerbations of chronic bronchitis. Br J Dis Chest. 1978, 72: 13-20. 10.1016/0007-0971(78)90003-7.View ArticlePubMedGoogle Scholar
  22. Anthonisen NR, Manfreda J, Warren CPW: Antiobiotic therapy in exacerbations of chronic obstructive pulmonary disease. Ann Intern Med. 1987, 106: 196-204.View ArticlePubMedGoogle Scholar
  23. Jorgensen AF, Coolidge J, Pedersen PA, Petersen KP, Waldorff S, Widding E: Amoxicillin in treatment of acute uncomplicated exacerbations of chronic bronchitis. A double-blind, placebo-controlled multicentre study in general practice. Scand J Prim Health Care. 1992, 10: 7-11. 10.3109/02813439209014027.View ArticlePubMedGoogle Scholar
  24. Sachs AP, Koeter GH, Groenier KH, van der WD, Schiphuis J, Meyboom-de JB: Changes in symptoms, peak expiratory flow, and sputum flora during treatment with antibiotics of exacerbations in patients with chronic obstructive pulmonary disease in general practice. Thorax. 1995, 50: 758-763.View ArticlePubMedPubMed CentralGoogle Scholar
  25. Black P, Staykova T, Chacko E, Ram FS, Poole P: Prophylactic antibiotic therapy for chronic bronchitis. Cochrane Database Syst Rev. 2003, CD004105.Google Scholar
  26. Ram FS, Rodriguez-Roisin R, Granados-Navarrete A, Garcia-Aymerich J, Barnes NC: Antibiotics for exacerbations of chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2006, CD004403.Google Scholar
  27. Elmes PC, King TK, Langlands JH, Mackay JA, Wallace WF, Wade OL, Wilson TS: Value of ampicillin in the hospital treatment of exacerbations of chronic bronchitis. Br Med J. 1965, 2: 904-908.View ArticlePubMedPubMed CentralGoogle Scholar
  28. Hayden JA, van Tulder MW, Malmivaara A, Koes BW: Exercise therapy for treatment of non-specific low back pain. Cochrane Database Syst Rev. 2005, CD000335.Google Scholar
  29. Mottram P, Wilson K, Strobl J: Antidepressants for depressed elderly. Cochrane Database Syst Rev. 2006, CD003491.Google Scholar
  30. Wilson K, Mottram P, Sivanranthan A, Nightingale A: Antidepressant versus placebo for depressed elderly. Cochrane Database Syst Rev. 2001, CD000561.Google Scholar
  31. Glasziou PP, Del Mar CB, Sanders SL, Hayem M: Antibiotics for acute otitis media in children. Cochrane Database Syst Rev. 2004, CD000219.Google Scholar
  32. Kozyrskyj AL, Hildes-Ripstein GE, Longstaffe SE, Wincott JL, Sitar DS, Klassen TP, Moffatt ME: Short course antibiotics for acute otitis media. Cochrane Database Syst Rev. 2000, CD001095.Google Scholar
  33. Clarke M, Hopewell S, Chalmers I: Reports of clinical trials should begin and end with up-to-date systematic reviews of other relevant evidence: a status report. J R Soc Med. 2007, 100: 187-190. 10.1258/jrsm.100.4.187.View ArticlePubMedPubMed CentralGoogle Scholar

    34. Pre-publication history

    1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/6/28/prepub

Copyright

© Puhan et al; licensee BioMed Central Ltd. 2008

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Advertisement