Skip to main content

Advertisement

Global collaborative networks on meta-analyses of randomized trials published in high impact factor medical journals: a social network analysis

BMC Medicinevolume 12, Article number: 15 (2014) | Download Citation

Abstract

Background

Research collaboration contributes to the advancement of knowledge by exploiting the results of scientific efforts more efficiently, but the global patterns of collaboration on meta-analysis are unknown. The purpose of this research was to describe and characterize the global collaborative patterns in meta-analyses of randomized trials published in high impact factor medical journals over the past three decades.

Methods

This was a cross-sectional, social network analysis. We searched PubMed for relevant meta-analyses of randomized trials published up to December 2012. We selected meta-analyses (including at least randomized trials as primary evidence source) published in the top seven high impact factor general medical journals (according to Journal Citation Reports 2011): The New England Journal of Medicine, The Lancet, the BMJ, JAMA, Annals of Internal Medicine, Archives of Internal Medicine (now renamed JAMA Internal Medicine), and PLoS Medicine. Opinion articles, conceptual papers, narrative reviews, reviews without meta-analysis, reviews of reviews, and other study designs were excluded.

Results

Overall, we included 736 meta-analyses, in which 3,178 authors, 891 institutions, and 51 countries participated. The BMJ was the journal that published the greatest number of articles (39%), followed by The Lancet (18%), JAMA (15%) and the Archives of Internal Medicine (15%). The USA, the UK, and Canada headed the absolute global productivity ranking in number of papers. The 64 authors and the 39 institutions with the highest publication rates were identified. We also found 82 clusters of authors (one group with 55 members and one group with 54 members) and 19 clusters of institutions (one major group with 76 members). The most prolific authors were mainly affiliated with the University of Oxford (UK), McMaster University (Canada), and the University of Bern (Switzerland).

Conclusions

Our analysis identified networks of authors, institutions and countries publishing meta-analyses of randomized trials in high impact medical journals. This valuable information may be used to strengthen scientific capacity for collaboration and to help to promote a global agenda for future research of excellence.

Open Peer Review reports

Background

The past decades have seen the establishment of evidence synthesis, particularly systematic reviews and meta-analyses, as a key component of evidence based medicine (EBM) [1, 2]. Meta-analyses of randomized trials have become more widely accepted by clinicians, researchers and policy makers as a useful tool to critically assess the totality of evidence in a research question. When performed well and reported completely, incorporating explicit and detailed methods and results, such studies produce information that can have undoubtedly major, immediate effects on medical practice, research agendas and the establishment of healthcare policies.

Important milestones that may have encouraged research in this field, from the point of view of scientific publications and institutional development of EBM [1–4], include the creation of international research groups, centers, and consortia (such as the Centre for Evidence Based Medicine and The Cochrane Collaboration in the 1990s) in addition to groups developing reporting guidelines to ensure articles contain all essential information, such as QUOROM (Quality of Reporting of Meta-analyses) [5] and, more recently, PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) [6].

Global health challenges require research collaboration and multi-lateral programs on a global scale, owing to the nature and magnitude of the public health problems. Noteworthy examples include major environmental, political, and social determinants of health, as well as complex and changing clinical issues related to the conditions and risk factors that cause the highest burden of disease around the world [7–9]. Despite continuous efforts of individual scientists and institutions to remedy deficiencies in healthcare effectiveness and safety, multiple gaps and disparities remain. Research collaboration contributes to the advancement of knowledge by exploiting the results of scientific efforts more efficiently, but the global patterns of collaboration on meta-analysis are unknown. Given that meta-analyses can provide high-quality clinical evidence regarding the robustness of the effects of healthcare interventions to inform medical practice, there is an urgent need to evaluate and promote scientific activity and growth in the field of EBM [4, 10–12].

Social network analysis [13], the study of structure derived from the regularities in the patterning of relationships between social entities (which might be people or organizations), is grounded in the assessment of empirical data, and can provide an appropriate approach to identify top scientists and researchers, groups of excellence, and leading institutions. It also offers information to assess the citation patterns among papers within a specialty [14], to identify gaps in the evidence from scientific research [15], and to understand the structure and nature of relationships and interactions within a scientific community that collaborate to better achieve common or compatible goals [13, 16].

This study aimed to describe and characterize global collaborative patterns with regard to the conduct of meta-analyses of randomized trials published over the past three decades in high impact factor medical journals, by applying techniques from social network analysis.

Methods

Design and sample

In December 2012, we searched for reports of meta-analyses of randomized trials that were indexed in PubMed and published in one of the top seven high impact general medical journals, as identified in 2011, based on an impact factor of at least 10 (subject categories ‘Medicine, General & Internal’ of Journal Citation Reports, Thomson Reuters): The New England Journal of Medicine (NEJM), The Lancet, the British Medical Journal (BMJ), the Journal of the American Medical Association (JAMA), Annals of Internal Medicine, Archives of Internal Medicine (now renamed JAMA Internal Medicine) and PLoS Medicine. Specifically, the following terms were used for PubMed: (‘meta-analysis’[Publication Type] OR ‘meta-analysis as topic’[MeSH Terms] OR ‘meta-analysis’[All Fields]) AND (‘randomized controlled trial’[Publication Type] OR ‘randomized controlled trials as topic’[MeSH Terms] OR ‘randomized controlled trial’[All Fields]) AND (‘Lancet’[Journal] OR ‘N Engl J Med’[Journal] OR ‘JAMA’[Journal] OR ‘Br Med J’[Journal] OR ‘Br Med J (Clin Res Ed)’[Journal] OR ‘BMJ’[Journal] OR ‘PLoS Med’[Journal] OR ‘Ann Intern Med’[Journal] OR ‘Arch Intern Med’[Journal]) AND (hasabstract[text] AND ‘humans’[MeSH Terms]). We also performed complementary hand-searches and reviewed references of identified eligible reports to identify additional meta-analyses.

We included two types of articles from the eligible journals: original research reports and reviews (both incorporating meta-analyses of randomized trials). Editorials, commentaries, and other opinion articles were excluded. We also excluded conceptual papers, literature (narrative) reviews, reviews of reviews, meta-analysis of observational studies not considering randomized trials, single randomized trials, and other study designs (such as cost-effectiveness analyses and epidemiological studies).

For the purposes of this study, we selected all articles published in English and indexed in PubMed between January 1985 and December 2012. One researcher with expertise in evidence synthesis (FC-L) screened the titles and abstracts, and identified all potentially eligible articles. The same researcher excluded the articles not meeting the pre-specified criteria.

Data extraction

For each included paper, we extracted information on the year of publication, the journal title, and the authors’ names, institutional affiliation(s), and country of origin. This information was downloaded online through the Science Citation Index-Expanded (SCI-E) Web of Knowledge platform version 5, in April 2013. The Web of Knowledge platform is a database that contains all the above information, including the full addresses of all authors of every paper. We also used the SCI-E to determine the extent to which each study had been cited in the scientific peer-review literature using the ‘times cited’ number (that is, the number of times a publication has been cited by other publications). A process of standardization was conducted to bring together the different names of a particular author or institution. Specifically, one researcher (AA-A) checked the names by which an individual author appeared in two or more different forms (for example, ‘Gordon Guyatt’ or ‘Gordon H Guyatt’), using coincidence in that author’s place(s) of work as the basic criterion for normalization (for example, McMaster University, Canada). In the case of institutions, we unified the different variants to match the name recorded in public directories of institutions. Similarly, given that institutional names in many records included two or more institutions (for example, university hospitals, research centers and academic institutions), we proceeded to distinguish between these names by recording all variations of any individual macroinstitution as could be identified for each bibliographic record (for example, for the institutional address ‘Reproductive Medicine Unit, Department of Obstetrics & Gynaecology, University of Adelaide, Queen Elizabeth Hospital, Australia’, the standardization approach was to present ‘University of Adelaide, Australia’ separately from ‘Queen Elizabeth Hospital, Australia’). With all this information, we constructed a Microsoft Access database.

Data analysis

In this paper, we use the term ‘co-authorship’ to refer to joint authorship of a scientific paper by at least two individuals, and the term ‘institutional collaboration’ to refer to joint authorship by different institutions. ‘Intensity of collaboration or threshold’ refers to the number used to form clusters of authors and institutions (that is, the frequency of co-authorship between pairs of authors or of collaboration between institutions), and reflects a criterion to label identifiable clusters as research groups. Collaboration between authors (or institutions) was portrayed by calculating the number of papers, names, signatures and collaborations, the index of signatures per paper or collaboration index (which is the mean number of signatures per paper), and the index of authors per paper (mean number of authors per paper, considering only the different authors). A summary box with definitions of each of the measurements of collaboration is provided in the supplementary material (see Additional file 1: ‘Definitions of collaborative measurements’).

To construct co-authorship networks, we identified all combinations of pairs of authors for each paper. The number of co-authorships for each paper is related to the number of authors as is equal to

m ! m − n ! n ! ,

where m is the number of individual authors and n the number of elements in the groups constructed. Once co-authorship was quantified, we further established an a posteriori threshold of two or more collaborations between pairs of authors, in order to reduce the number of nodes and links that would prevent a clear view of the network, and thus center the analysis on the more intense co-authorship relationships. The same approach was applied to institutional and country authorship to construct the network of collaborations, although in this case, we applied an a posteriori threshold of three or more papers signed in co-authorship. The productivity and patterns of collaboration by author, institution and country were analyzed.

We used PAJEK [17], a software package for large network analysis that is free for non-commercial use, to analyze indicators and construct social networks.

Results

Number of meta-analyses

The PubMed search generated 804 records. Following screening of abstracts and full text articles, 724 publications were retained, and 12 additional publications were added from complementary searches of reference lists, thereby yielding a final sample of 736 included meta-analyses. The process of study selection is presented in Figure 1.

Figure 1
figure1

Selection of publications. Flow chart.

Full size image

General characteristics of the sample

The BMJ published the largest number of articles (n = 289; 39%), followed by The Lancet (n = 132; 18%), JAMA (n = 113; 15%) and the Archives of Internal Medicine (n = 112; 15%). Overall, 736 meta-analyses received 130,644 citations, of which 37,930 citations (29%) corresponded to BMJ, 34 911(27%) to The Lancet and 25,273 (19%) to JAMA. The number of publications increased exponentially over the study period (Table 1). Approximately three-quarters of the meta-analyses were reported during the most recent decade.

Table 1 General characteristics of the sample of study
Full size table

The included meta-analyses had a median of 5 authors, although 41 (6%) were single authored (Table 1). More than a quarter (214 [29%]) of the first authors were from the USA, with three countries (the USA, the UK and Canada) accounting for more than two-thirds of the meta-analyses published during the period of analysis (Table 1).

Production and collaboration patterns

Overall, 3,178 authors, 891 institutions and 51 countries worldwide were involved in the sample of articles. We identified 64 authors who published 5 or more papers (Table 2). The most prolific authors were Lau (15 papers), Guyatt (14), Peto (13), Yusuf (12), Cook (11) and Jüni (11). Many of the most prolific authors are affiliated with only a few academic institutions and/or medical centers; six are affiliated with the University of Oxford (Peto, Collins, Clarke, Baigent, Gray and Rothwell), five are affiliated with McMaster University (Guyatt, Yusuf, Cook, Douketis, and Eikelboom) and five are affiliated with the University of Bern and/or the Inselspital – Bern University Hospital (Jüni, Trelle, Egger, Reichenbach and Nüesch). Applying a threshold of 2 or more papers published as co-authors (Figures 2, 3, 4, 5, 6, 7), we identified 82 clusters of authors. Of these, 12 were identified as major co-authorship groups (1 with 55 members, 1 with 54 members, 1 with 27 members, 1 with 15, 4 with 14 members, 3 with 11 members, 1 with 10 members, 1 with 8 members, 5 with 7 members, 5 with 6 members and 3 with 5 members).

Table 2 Ranking of most prolific authors (five or more papers) and their collaborative patterns
Full size table
Figure 2
figure2

Co-authorship networks. Most productive cluster of authors, applying a threshold of two or more papers signed in co-authorship.

Full size image
Figure 3
figure3

Co-authorship networks. Second most productive cluster of authors, applying a threshold of two or more papers signed in co-authorship.

Full size image
Figure 4
figure4

Co-authorship networks. Main clusters of authors (≥ 15 members), applying a threshold of two or more papers signed in co-authorship.

Full size image
Figure 5
figure5

Co-authorship networks. Main clusters of authors (≤ 14 members), applying a threshold of two or more papers signed in co-authorship.

Full size image
Figure 6
figure6

Co-authorship networks. Main clusters of authors (≤ 11 members), applying a threshold of two or more papers signed in co-authorship.

Full size image
Figure 7
figure7

Co-authorship networks. Main clusters of authors (≤ 6 members), applying a threshold of two or more papers signed in co-authorship.

Full size image

Institutional productivity was headed by McMaster University (49 papers), University of Oxford (48 papers) and Harvard University (36 papers) (Table 3). Next came some of their affiliated hospitals or medical centers (Brigham and Women’s Hospital and the Radcliffe Infirmary, with 32 and 30, respectively). Applying a collaboration threshold of at least 3 papers signed with inter-institutional collaboration, we identified 19 clusters comprising a total of 120 institutions (Figures 8 and 9). Of these, the most important institutional cluster comprised 76 members.

Table 3 Ranking of most prolific institutions (≥ 10 papers) and their collaborative patterns
Full size table
Figure 8
figure8

Institutional networks. Most productive cluster of institutions applying a threshold of three or more papers signed in co-authorship.

Full size image
Figure 9
figure9

Institutional networks. Other relevant clusters of institutions applying a threshold of three or more papers signed in co-authorship.

Full size image

The productivity ranking for countries with respect to the number of papers (Table 4) was headed by the USA (310 papers), the UK (297 papers) and Canada (143 papers). After these countries came Australia (70 papers), and Italy and the Netherlands (57 papers each). The USA and the UK also headed the list of the number of different countries with which they had collaborated, as well as the total number of collaborations. Figure 10 shows a visual representation of the collaborative network between countries, in which we can see the relationships of some with respect to others and the position that each occupies in the network as a whole.

Table 4 Productivity and patterns of collaboration by countries
Full size table
Figure 10
figure10

Global collaborative network between countries. Note: Node sizes are proportional to the number of papers and line thicknesses are proportional to the number of collaborations.

Full size image

The 75 most cited articles by number of citations are listed in the supplementary material (see Additional file 2: ‘List of most cited meta-analyses’). Heavily cited meta-analyses include randomized trials examining the health effects of pharmacological interventions in cardiology and oncology (for example, antithrombotic trials, anti-platelet trials, antihypertensive trials, lipid-lowering trials, chemotherapy for diverse cancers such as breast cancer, lung cancer, or head and neck cancers).

Discussion

Generally, the visibility and recognition of scientific research activities benefits from increasing collaborative research [18]. Research collaboration plays an important role in science, policy and medicine [19, 20]. Research collaboration in the ‘Big Science’ era involves addressing important and relevant research questions that require a complex construction of multi-disciplinary teams of scientists and researchers, large-scale scientific structures, budgets of an unprecedented scale, and widespread sharing of scientific knowledge and data. Thus, meta-analysis can be considered a good example of ‘Big Science’ in medicine and clinical epidemiology [21], as quantitative evidence synthesis is the application, in practice, of the principle that science is cumulative [22, 23]. An obvious manifestation of this is the observed trend of 75 new randomized trials and 11 new systematic reviews being published daily, with a plateau in this growth not yet reached [24]. Therefore, promoting research collaboration in evidence synthesis is able to strengthen research activity, productivity and impact.

In general, we found a strong clustering of papers published in two British journals (BMJ and The Lancet accounted for 57% of meta-analyses), in contrast to other general medical journals (for example, the NEJM represented less than 2%). We hypothesized that these different findings between journals may potentially reflect an editorial policy and/or preference, with the BMJ, The Lancet and JAMA journals specifically being more interested in and/or promoting the publication of high-quality quantitative evidence synthesis.

Perhaps a relevant finding is that collaborative networks are expanding in multiple regions, revealing a discernable and well-established scientific community, with the most prolific authors and institutions having an important number of collaborations. As might be expected, the scientific community captured by the networks is centered on a nucleus of scientists and researchers from academia, medical centers and health research institutes from western high-income countries (North America, Western Europe and Australia/Oceania). Specifically, the most intense global collaborations took place between authors and institutions from the USA, the UK and Canada. However, although these three countries lead in the number of published high impact meta-analyses, the efforts during the period of study were global, with publications from authors and institutions in more than 50 different countries. Cultural links may have historically benefited some countries through alliances with nations and regions that speak the same language (as may be the case for the UK through alliances with Commonwealth countries that speak English) and have adopted similar scientific and research structures [25]. However, there is a clear over-representation of scientists based in western high-income countries, and the limited participation of low and middle income-based researchers could warrant further pragmatic action. Given that research resources and funding are often restricted, it is the responsibility of the scientific community to utilize the resources available most efficiently when exploring research priorities to afford the health needs of the population, stimulating north–south and west–east collaborations where possible. In fact, these results are consistent with those reported by Uthman et al. [26], who assessed the characteristics of the 100 most frequently cited meta-analysis related articles. Although the scope of our research is definitely different from that paper, those authors also showed that the USA, the UK and Canada have taken leadership in the production of citation papers, but no first author from low or middle income countries led one of the most cited papers.

The maps of scientific partnership show that authors who are ‘leaders’ and thus who may contribute collaboration, have more frequent and intense collaboration between other authors and institutions from different countries. The study also identifies highly cohesive cluster networks and provides considerable information on the structure that can be put to various purposes, such as funding agencies designing strategies for future scientific collaboration, agencies such as the World Health Organization promoting a global coordinated agenda for perceived high priority clinical topics, and sharing of reliable and innovative methodologies that can be linked to world-class educational and training opportunities.

There are several possible explanations for our findings. The use of modern communication and information technologies, especially the Internet, has diminished the role of geographical and territorial boundaries in the access and transmissibility of information [27]. This has enabled scientists, and particularly systematic reviewers, closer internalization of research and collaboration. Similarly, the creation of some international collaborations, including those conducting clinical trials, may have settled the groundwork for the subsequent realization of collaborative meta-analyses that may have a clear scientific and clinical impact. For example, according to SCI-E, the most cited meta-analysis article has received more than 2,500 citations; this was a paper by the Antithrombotic Trialists’ Collaboration [28] that contributed to determine the protective effects of anti-platelet therapy (such as low dose aspirin) for patients at high risk of occlusive vascular events. Analyses of the Oxford-based Early Breast Cancer Trialists Collaborative Group (EBCTCG) provided breakthrough examples of complete pictures of the evidence on the long-term effects of various therapies on early breast cancer [29–31].

Collaborative networks, an important form of social network analysis, have been intensively studied in many scientific disciplines, including biology, physics, medicine and economics [13, 16, 32–36]. To our knowledge, no study has previously described and characterized the global collaborative patterns and networks of published meta-analyses of randomized trials. Very few studies have reviewed evidence synthesis for decision-making using a research collaboration approach [35, 36], and although not directly comparable with our analysis, there are aspects worthy of comment. A recent paper by Wagstaff and Culyer [35] examined four decades of health economics research. They compared authors, institutions, countries and journals in terms of the volume of publications in the US, the UK and Canada; Harvard University, the World Bank and the MIT emerged at the top on a variety of measures. Previously, Greenberg et al. [36] conducted a review of cost-effectiveness analyses of the English-language articles indexed in PubMed since 2006, and observed that the most prolific authors were affiliated with renowned US institutions in the USA (for example, Harvard University, Stanford University and Tufts University, and their affiliated hospitals).

There are several limitations to our study. First, although the scientific production analysed has been drawn from an exhaustive analysis of the literature, it is possible that the search missed some relevant articles. Furthermore, some reports were published in journals without being indexed as meta-analyses, making them difficult to identify. The analyses inevitably represent an initial investigation, and a more detailed exploration is also needed. In addition, we restricted our analysis to meta-analyses that considered randomized trials as the primary source of clinical evidence, and therefore there may be scientists and researchers (or institutions) who do not appear because their papers are not reflected in the collaborative networks (for example, genetic epidemiology). It would be interesting to explore whether the use of alternative sources (such as observational research, descriptive epidemiology, molecular genetics, non-clinical studies) resulted in similar results to those reported here. Our analysis was also limited in scope, focusing only on original research and reviews articles. Undoubtedly, there are other important reports (for example, methodological [37–39] and conceptual papers [6, 40, 41]) that also merit consideration. Second, we excluded the Cochrane Library, specifically, the Cochrane Database of Systematic Reviews, a major source of systematic reviews. However, to date its impact factor is smaller than that of any of the included journals. Given the dynamic nature of the field, other opportunities for further research include examining the evolution of the identified networks over time (for example, by means of longitudinal analysis) also considering papers published in multi-disciplinary journals or those included in journals belonging to other categories.

Additionally, there were no further inquiries or attempts to verify the quality of reporting of the meta-analyses in our sample. Previous research [42] has addressed this issue, pointing out that some of the meta-analyses published in leading medical journals have important methodological limitations. Third, as in many bibliometric analyses, the importance of normalizing the names of scientists, researchers and their institutions is fundamental to avoiding potential errors caused in recognizing variations in the name of a single author. Nevertheless, we conducted a careful manual validation of the bibliographic references to avoid these potential errors. In the case of authors, the criterion followed with two or more variants of a name or surname was to check the coincidence of the different variants with the workplace. As discussed elsewhere [34], this procedure does not assure complete certainty. It does not take into account possible changes in the author’s workplace, nor does it avoid the problem where the same bibliographic name refers to the scientific production of two or more authors, although the fact that a single field and a short chronologic period were being analyzed helped to minimize this kind of error. For institutional names, the main problem is that the same name frequently applies to two or more institutions, something that is common for authors who work in institutes or hospitals connected to universities. In such cases, we opted to assign as many names to the macroinstitutions as could be identified. Although this resulted in the problem of multiplying the number of institutions in the recount, it was necessary in order to avoid losing information concerning the macroinstitutions occurring in second place or later in the list of names. The same criterion of multiplying the names was used in the case of the institutes and other research organizations, sometimes administratively dependent on one macroinstitution, the result being that a ‘fictitious’ inter-institutional collaboration may have been obtained.

Conclusions

Our study identified the most significant collaborative networks of authors, institutions and countries publishing meta-analyses of randomized trials in high impact medical journals. This information may be used to strengthen scientific capacity for global collaboration and help to build a cooperative scientific agenda for future research of excellence in the field of clinical evidence synthesis in a manner similar to how some international clinical trial collaborations have developed. We hope that this analysis will be useful as policy makers, researchers and institutions look to the future.

Author’s information

RA-B and DM are joint senior authors.

References

  1. 1.

    Evidence-Based Medicine Working Group: Evidence-based medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-2425. 10.1001/jama.1992.03490170092032.

  2. 2.

    Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn’t. BMJ. 1996, 312: 71-72. 10.1136/bmj.312.7023.71.

  3. 3.

    Cochrane AL: Effectiveness and Efficiency. Random Reflections on Health Services. 1972, London: Nuffield Provincial Hospitals Trust

  4. 4.

    Higgins JPT: Green S, editors: Cochrane Handbook for Systematic Reviews of Interventions. 2008, Chichester: Wiley

  5. 5.

    Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF: Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet. 1999, 354: 1896-1900. 10.1016/S0140-6736(99)04149-5.

  6. 6.

    Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.

  7. 7.

    Boekholt P, Edler J, Cunningham P, Flanagan K, European Commision: Drivers of International collaboration in research. 2009, Luxembourg: Publications Office of the European Union

  8. 8.

    Murray CJ, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, Ezzati M, Shibuya K, Salomon JA, Abdalla S, Aboyans V, Abraham J, Ackerman I, Aggarwal R, Ahn SY, Ali MK, Alvarado M, Anderson HR, Anderson LM, Andrews KG, Atkinson C, Baddour LM, Bahalim AN, Barker-Collo S, Barrero LH, Bartels DH, Basáñez MG, Baxter A, Bell ML, Benjamin EJ, et al: Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012, 380: 2197-2223. 10.1016/S0140-6736(12)61689-4.

  9. 9.

    Murray CJ, Lopez AD: Measuring the global burden of disease. N Engl J Med. 2013, 369: 448-457. 10.1056/NEJMra1201534.

  10. 10.

    Concato J, Shah N, Horwitz RI: Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 2000, 342: 1887-1892. 10.1056/NEJM200006223422507.

  11. 11.

    Davidoff F, Haynes B, Sackett D, Smith R: Evidence based medicine. BMJ. 1995, 310: 1085-1086. 10.1136/bmj.310.6987.1085.

  12. 12.

    Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.

  13. 13.

    Newman ME: Coauthorship networks and patterns of scientific collaboration. Proc Natl Acad Sci USA. 2004, 101: 5200-5205. 10.1073/pnas.0307545100.

  14. 14.

    Greenberg SA: How citation distortions create unfounded authority: analysis of a citation network. BMJ. 2009, 339: b2680-10.1136/bmj.b2680.

  15. 15.

    Kappagoda S, Ioannidis JP: Neglected tropical diseases: survey and geometry of randomised evidence. BMJ. 2012, 345: e6512-10.1136/bmj.e6512.

  16. 16.

    Catalá-López F, Alonso-Arroyo A, Aleixandre-Benavent R, Ridao M, Bolaños M, García-Altés A, Sanfélix-Gimeno G, Peiró S: Coauthorship and institutional collaborations on cost-effectiveness analyses: a systematic network analysis. PLoS One. 2012, 7: e38012-10.1371/journal.pone.0038012.

  17. 17.

    Batagelj V, Mrvar A: Pajek 1.28. Program for large network analysis. 2010, Ljubljana: University of Ljubljana

  18. 18.

    Glänzel W, Schubert A: Analyzing scientific networks through coauthorship. In Handbook of Quantitative Science and Technology Research: the Use of Publication and Patent Statistics in Studies of S&T Systems. Edited by Moed HF, Glanzel W, Schmoch U. 2005, Dordrecht: Springer

  19. 19.

    Adams J: Collaborations: The fourth age of research. Nature. 2013, 497: 557-560. 10.1038/497557a.

  20. 20.

    Katz JS, Hicks D, Narin F, Hamilton K: International collaboration. Nature. 1996, 38: 16.

  21. 21.

    Davey Smith G: Big business, big science?. Int J Epidemiol. 2008, 37: 1-3. 10.1093/ije/dym289.

  22. 22.

    Chalmers I, Hedges LV, Cooper H: A brief history of research synthesis. Eval Health Prof. 2002, 25: 12-37. 10.1177/0163278702025001003.

  23. 23.

    Tricco AC, Tetzlaff J, Moher D: The art and science of knowledge synthesis. J Clin Epidemiol. 2011, 64: 11-20. 10.1016/j.jclinepi.2009.11.007.

  24. 24.

    Bastian H, Glasziou P, Chalmers I: Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?. PLoS Med. 2010, 7: e1000326-10.1371/journal.pmed.1000326.

  25. 25.

    Adams J: Collaborations: the rise of research networks. Nature. 2012, 490: 335-336. 10.1038/490335a.

  26. 26.

    Uthman OA, Okwundu CI, Wiysonge CS, Young T, Clarke A: Citation classics in systematic reviews and meta-analyses: who wrote the top 100 most cited articles?. PLoS One. 2013, 8: e78517-10.1371/journal.pone.0078517.

  27. 27.

    Pan RK, Kaski K, Fortunato S: World citation and collaboration networks: uncovering the role of geography in science. Sci Rep. 2012, 2: 902.

  28. 28.

    Antithrombotic Trialists’ Collaboration: Collaborative meta-analysis of randomised trials of antiplatelet therapy for prevention of death, myocardial infarction, and stroke in high risk patients. BMJ. 2002, 324: 71-86. 10.1136/bmj.324.7329.71.

  29. 29.

    Early Breast Cancer Trialists’ Collaborative Group (EBCTCG): Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15-year survival: an overview of the randomised trials. Lancet. 2005, 365: 1687-1717.

  30. 30.

    Early Breast Cancer Trialists’ Collaborative Group: Polychemotherapy for early breast cancer: an overview of the randomised trials. Lancet. 1998, 352: 930-942.

  31. 31.

    Early Breast Cancer Trialists’ Collaborative Group: Effects of radiotherapy and surgery in early breast cancer. An overview of the randomized trials. N Engl J Med. 1995, 333: 1444-1455.

  32. 32.

    Martin T, Ball B, Karrer B, Newman ME: Coauthorship and citation patterns in the Physical Review. Phys Rev E Stat Nonlin Soft Matter Phys. 2013, 88: 012814.

  33. 33.

    Morel CM, Serruya SJ, Penna GO, Guimarães R: Co-authorship network analysis: a powerful tool for strategic planning of research, development and capacity building programs on neglected diseases. PLoS Negl Trop Dis. 2009, 3: e501-10.1371/journal.pntd.0000501.

  34. 34.

    González-Alcaide G, Aleixandre-Benavent R, Navarro-Molina C, Valderrama-Zurián JC: Coauthorship networks and institutional collaboration patterns in reproductive biology. Fertil Steril. 2008, 90: 941-956. 10.1016/j.fertnstert.2007.07.1378.

  35. 35.

    Wagstaff A, Culyer AJ: Four decades of health economics through a bibliometric lens. J Health Econ. 2012, 31: 406-439. 10.1016/j.jhealeco.2012.03.002.

  36. 36.

    Greenberg D, Rosen AB, Wacht O, Palmer J, Neumann PJ: A bibliometric review of cost-effectiveness analyses in the economic and medical literature: 1976–2006. Med Decis Making. 2010, 30: 320-327. 10.1177/0272989X09360066.

  37. 37.

    Higgins JP, Thompson SG, Deeks JJ, Altman DG: Measuring inconsistency in meta-analyses. BMJ. 2003, 327: 557-560. 10.1136/bmj.327.7414.557.

  38. 38.

    Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, Carpenter J, Rücker G, Harbord RM, Schmid CH, Terzlaff J, Deeks K, Deeks JJ, Peters J, Macaskill P, Schwarzer G, Duval S, Altman DG, Moher D, Higgins JP: Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011, 343: d4002-10.1136/bmj.d4002.

  39. 39.

    Riley RD, Higgins JP, Deeks JJ: Interpretation of random effects meta-analyses. BMJ. 2011, 342: d549-10.1136/bmj.d549.

  40. 40.

    Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009, 6: e1000100-10.1371/journal.pmed.1000100.

  41. 41.

    Mills EJ, Ioannidis JP, Thorlund K, Schünemann HJ, Puhan MA, Guyatt GH: How to use an article reporting a multiple treatment comparison meta-analysis. JAMA. 2012, 308: 1246-1253. 10.1001/2012.jama.11228.

  42. 42.

    Gerber S, Tallon D, Trelle S, Schneider M, Jüni P, Egger M: Bibliographic study showed improving methodology of meta-analyses published in leading journals 1993–2002. J Clin Epidemiol. 2007, 60: 773-780. 10.1016/j.jclinepi.2006.10.022.

Pre-publication history

  1. The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/12/15/prepub

Download references

Funding

This study received no specific funding. DM is funded by a University Research Chair, University of Ottawa; and BH is a Canadian Institutes of Health Research DSEN (Drug Safety and Effectiveness Network) New Investigator.

Author information

Affiliations

  1. Division of Pharmacoepidemiology and Pharmacovigilance, Spanish Medicines and Healthcare Products Agency (AEMPS), Madrid, Spain

    • Ferrán Catalá-López

  2. Fundación Instituto de Investigación en Servicios de Salud, Valencia, Spain

    • Ferrán Catalá-López

  3. López Piñero Institute for the History of Medicine and Science (IHMC), Spanish National Research Council (CSIC) and University of Valencia, Valencia, Spain

    • Adolfo Alonso-Arroyo
    •  & Rafael Aleixandre-Benavent

  4. Department of History of Science and Documentation, University of Valencia, Valencia, Spain

    • Adolfo Alonso-Arroyo

  5. Clinical Epidemiology Program, Ottawa Hospital Research Institute (OHRI), Ottawa, ON, Canada

    • Brian Hutton
    •  & David Moher

Authors

  1. Search for Ferrán Catalá-López in:

  2. Search for Adolfo Alonso-Arroyo in:

  3. Search for Brian Hutton in:

  4. Search for Rafael Aleixandre-Benavent in:

  5. Search for David Moher in:

Corresponding author

Correspondence to Ferrán Catalá-López.

Additional information

Competing interests

The authors declare that they have no competing interest.

Authors’ contributions

FC-L conceived the original idea. AA-A, RA-B and FC-L designed the study. AA-A and FC-L collected the data and performed the statistical analysis. FC-L and AA-A take responsibility for the integrity of the data and the accuracy of the data analysis. DM, BH and FC-L interpreted the data. All authors wrote and/or critically revised the manuscript for important intellectual content. All authors approved the final version of the manuscript. FC-L is the guarantor.

Electronic supplementary material

Additional file 1: Definitions of collaborative measurements.(DOC 48 KB)

Additional file 2: List of most cited meta-analyses.(DOC 177 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Authors’ original file for figure 4

Authors’ original file for figure 5

Authors’ original file for figure 6

Authors’ original file for figure 7

Authors’ original file for figure 8

Authors’ original file for figure 9

Authors’ original file for figure 10

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Keywords

  • Authorship
  • Evidence-based medicine
  • Meta-analysis
  • Randomized controlled trial
  • Scientific collaboration
  • Social network analysis

BMC Medicine

ISSN: 1741-7015

Contact us