Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research
BMC Medicine volume 6, Article number: 13 (2008)
Inadequate reporting is problematic for several reasons. If authors do not provide sufficient details concerning the conduct of their study, readers are left with an incomplete picture of what was done. As such, they are not able to judge the merits of the results and interpret them. The EQUATOR Network is a new initiative aimed at improving the clarity and transparency of reporting health research.
The reporting of medical research is not clear and transparent: an unacceptable scandal
Mental health continues to be a major health concern in many parts of the world. It is estimated that 5% to 10% of people are affected by depression . In 2006 the United States National Institutes of Health spent US$335 million on research into depression. Yet reports of randomized trials evaluating interventions to optimally manage individuals with depression are disturbingly inadequate, likely making their results of limited use to healthcare professionals, other decision makers and patients. Hotopf and colleagues  examined reports of 122 randomized controlled trials (RCTs) evaluating medical interventions for managing individuals with depression and found that only one provided any details about the randomization process used. Empirical evidence shows that inadequate reporting of randomization, a core feature of any randomized trial, is associated with biased estimates of the treatment effect of the order of 20% . Such problems are not unique to reports from depression trials. Inadequate reporting is pervasive to almost every area of health research [4–6]. Without complete, clear and transparent reports, readers cannot judge the reliability and usefulness of health research.
In the late 1970s the International Committee of Medical Journal Editors (ICMJE) published reporting guides for authors. These were limited only to formatting issues  although later the ICJME developed the 'Uniform Requirements for Manuscripts Submitted to Biomedical Journals' with a much broader scope . Other efforts have also been made [9, 10] although few focused on reporting the design, conduct and analysis of health research. In the mid-1990s the CONSORT Statement, a 22-item checklist and flow diagram, provided what might be considered the first reporting guideline focusing on what should be included in scientific reports of RCTs . Evidence shows that use of CONSORT improves the quality of reporting of RCTs . Journals increasingly find the CONSORT reporting guideline useful; more than 300 of them now directly endorse the CONSORT Statement .
The last decade has witnessed considerable activity in developing reporting guidelines: more than 80 of them now exist. They cover a broad spectrum; examples include recommendations for specific study designs (for example, diagnostic accuracy studies ), types of data (for example, harms assessed in randomized trials ) and sharing of data for microarray experiments (see, for example, ). Although a core set of steps are required to optimally develop any reporting guideline, a recent survey of 30 developers of reporting guidelines suggests that most guidelines are created idiosyncratically . Contributing factors include lack of a central repository of available guidelines and a paucity of literature to inform developers of how to develop a reporting guideline .
To help improve the quality of reporting health research, we established the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network  with initial funding from the UK NHS National Knowledge Service and National Institute for Health Research. This new initiative seeks to improve the quality of scientific publications by promoting transparent and accurate reporting. The network is developing resources and training related to the reporting of health research and will assist in the development, dissemination and implementation of robust reporting guidelines. A free newsletter is available electronically from the Network's website .
The Network has five major goals. First, for which there has already been some development, is to build a comprehensive web-based resource centre to develop and maintain up-to-date information, tools and other materials related to reporting health research. One of our first priorities is to develop online resources for editors and peer reviewers, including available literature, related to teaching scientific writing and reporting.
Second, is to set up a network of reporting guideline developers and to initiate and maintain mutual collaboration. Developing reporting guidelines is a new research activity and we are keen to act as a 'bridge' to bring together network members and provide them with scientific support for their guideline development. We are also working to fill the gap in the literature on how to optimally develop reporting guidelines.
Third, is to actively promote reporting guidelines and their use by developing online training courses for editors, peer reviews and researchers, and other activities raising awareness of the importance of reporting guidelines. Given the large number and broad scope of reporting guidelines it is possible that funders of health research will see them as an increasingly helpful resource to ensure that researchers they fund use appropriate guidelines to report their research. While this is at the end of the knowledge generation cycle, funders might also see the reporting guides as an important resource for helping to improve the quality of health research design and conduct.
Fourth, is to conduct a regular assessment of how journals implement reporting guidelines. If reporting guidelines are to achieve their intended goal it is important that they are endorsed appropriately in journals. Recent data indicate substantial room for improvement in this area .
Last, is to conduct an annual audit of reporting quality across the health literature. Most journals do not have an objective mechanism for gauging the quality of their published health research. We are proposing to complete an annual audit of the indexed literature and provide this feedback to the journals included on our sample. Continual annual monitoring of the literature will provide unique data on the influence reporting guidelines have on published literature and enable the EQUATOR Network to indirectly monitor its own progress.
The EQUATOR Network will hold its official launch meeting on 26 June 2008 in London, UK. The meeting will focus on a better understanding of the problems associated with health research reporting, the use of reporting guidelines and on finding potential solutions that could lead to an improvement of the health research literature. This is an open meeting that will be preceded by a half-day workshop for editors (see ).
In working to achieve these goals the EQUATOR Network will help ensure that the clarity and transparency of healthcare research is optimal for decisions made by healthcare professionals, funders, editors, peer reviewers, and readers.
Agency for Healthcare Research and Quality: Depression in Primary Care. 1993, Washington: US Department of Health and Human Services
Hotopf M, Lewis G, Normand C: Putting trials on trial – the costs and consequences of small trials in depression: a systematic review of methodology. J Epidemiol Community Health. 1997, 51: 354-358.
Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gotzsche PC: Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol. 2007, 36: 847-857. 10.1093/ije/dym087.
Anttila H, Malmivaara A, Kunz R, Autti-Rämö I, Mäkelä M: Quality of reporting of randomized, controlled trials in cerebral palsy. Pediatrics. 2006, 117: 2222-2230. 10.1542/peds.2005-1630.
Chan S, Bhandari M: The quality of reporting of orthopaedic randomized trials with use of a checklist for nonpharmacological therapies. J Bone Joint Surg. 2007, 89: 1970-1978. 10.2106/JBJS.F.01591.
Junhua Z, Hongcal S, Xiumel G, Boli Z, Yaozu X, Hongbo C, Ming R: Methodology and reporting quality of systematic review/meta-analysis of traditional Chinese medicine. J Altern Complement Med. 2007, 13: 797-805. 10.1089/acm.2007.7195.
International Steering Committee: Uniform requirements for manuscripts submitted to biomedical journals. Ann Intern Med. 1979, 90: 95-99.
International Committee of Medical Journal Editors (ICMJE): Uniform Requirements for Manuscripts Submitted to Biomedical Journals. [http://www.icmje.org]
Gardner MJ, Machin D, Campbell MJ: Statistical checklists. Statistics with Confidence. Edited by: Altman DG, Machin D, Bryant TN, Gardner MJ. 2000, London: BMJ Books, 191-201. 2
Squires BP, Elmslie TJ: Reports of randomized controlled trials: what editors want from authors and peer reviewers. Can Med Assoc J. 1990, 143: 381-382.
Moher D, Schulz KF, Altman DG, for the CONSORT group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. Ann Intern Med. 2001, 134: 657-662.
Plint AC, Moher D, Morrison A, Schulz KF, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomized controlled trials: a systematic review. Med J Aust. 2006, 185: 263-267.
CONSORT Statement. [http://www.consort-statement.org]
Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HCW, for the STARD group: Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD initiative. Ann Intern Med. 2003, 138: 40-44.
Ioannidis JPA, Evans S, Gotzsche PC, O'Neill RT, Altman DG, Schulz KF, Moher D, for the CONSORT Group: Better reporting of harms in randomized trials: an extension of the CONSORT Statement. Ann Intern Med. 2004, 141: 781-788.
Brazma A, Hingamp P, Quackenbush J, Sherlock G, Spellman P, Stoeckert C, Aach J, Ansorge W, Ball CA, Causton HC, Gaasterland T, Glenisson P, Holstege FC, Kim IF, Markowitz V, Matese JC, Parkinson H, Robinson A, Sarkans U, Schulze-Kremer S, Stewart J, Taylor R, Vilo J, Vingron M: Minimum information about a microarray experiment (MIAME) – toward standards for microarray data. Nat Genet. 2001, 29: 365-371. 10.1038/ng1201-365.
Simera I, Altman DG, Moher D, Schulz KF, Hoey J: Guidelines for reporting health research: the EQUATOR Network's survey of guideline authors. PLoS Med.
Altman DG, Moher D: Developing guidelines for reporting healthcare research: scientific rationale and procedures. Med Clin (Barc). 2005, 125 (Suppl 1): 8-13.
EQUATOR Network. [http://www.equator-network.org]
Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/6/13/prepub
DM, IS, KFS, JH, and DGA all conceived the paper. DM drafted the initial text and all authors helped edit it. All authors read and approved the final manuscript.
About this article
Cite this article
Moher, D., Simera, I., Schulz, K.F. et al. Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research. BMC Med 6, 13 (2008). https://doi.org/10.1186/1741-7015-6-13
- Health Research
- Reporting Guideline
- Consort Statement
- Equator Network
- Medical Journal Editor