Analysis of sex and gender-specific research reveals a common increase in publications and marked differences between disciplines
© Oertelt-Prigione et al; licensee BioMed Central Ltd. 2010
Received: 4 August 2010
Accepted: 10 November 2010
Published: 10 November 2010
The incorporation of sex and gender-specific analysis in medical research is increasing due to pressure from public agencies, funding bodies, and the clinical and research community. However, generations of knowledge and publication trends in this discipline are currently spread over distinct specialties and are difficult to analyze comparatively.
Using a text-mining approach, we have analysed sex and gender aspects in research within nine clinical subspecialties - Cardiology, Pulmonology, Nephrology, Endocrinology, Gastroenterology, Haematology, Oncology, Rheumatology, Neurology - using six paradigmatic diseases in each one. Articles have been classified into five pre-determined research categories - Epidemiology, Pathophysiology, Clinical research, Management and Outcomes. Additional information has been collected on the type of study (human/animal) and the number of subjects included. Of the 8,836 articles initially retrieved, 3,466 (39%) included sex and gender-specific research and have been further analysed.
Literature incorporating sex/gender analysis increased over time and displays a stronger trend if compared to overall publication increase. All disciplines, but cardiology (22%), demonstrated an underrepresentation of research about gender differences in management, which ranges from 3 to 14%. While the use of animal models for identification of sex differences in basic research varies greatly among disciplines, studies involving human subjects are frequently conducted in large cohorts with more than 1,000 patients (24% of all human studies).
Heterogeneity characterizes sex and gender-specific research. Although large cohorts are often analysed, sex and gender differences in clinical management are insufficiently investigated leading to potential inequalities in health provision and outcomes.
Gender medicine has evolved as an independent research field over the last decades. The establishment of its scientific validity through rigorous research has been a fruitful approach which is leading to its acceptance and the growth of scientific knowledge. Gender medicine originated from specialty-specific, initially mostly cardiologic, research questions and analysis has been frequently performed in the context of a particular discipline. Research on sex and gender differences includes a range of different approaches, from basic science and etiopathogenetic research, to the analysis of differences in signs and symptoms, diagnostics and management [1–7].
Research publications in medicine increased over time and this might prompt the assumption that relevant and novel research topics are more frequently investigated today. However, this might not be true. Topics can be abandoned as time passes and interests within the scientific community shift . Funding agencies are encouraging the incorporation of sex and gender aspects into biomedical research and leading scientific journals are requesting its inclusion into data analysis [9–13]. This is promoting increasing attention to the subject; however, this methodological shift appears to be a lengthy process. In fact, the expected increase in gender-specific research publications over time has never been quantified.
In addition to publication trend differences, it is not known whether some disciplines are more inclined to one research approach rather than to others, and if differences in research design and cohort size exist. Specialty-specific interests have driven the development of the discipline and might be influencing its evolution.
At present, a quantitative and exploratory analysis of gender research is lacking. An overview about the discipline's development would, however, allow for a more systematic approach to present and future research definitions. Comparison among specialties might offer insight into distinct research practice and highlight fundamental gaps that might be subsequently explored. Furthermore, information about sex differences in a specific area of medicine could be relevant to others, as basic mechanisms and differences in clinical management may be similar. Knowing that one specialty offers abundant information about, for example, pathophysiologic research could encourage exploration of similar mechanisms in related disciplines using appropriately modified approaches.
The present study offers a systematic classification of research in gender medicine to provide an initial overview of the field, highlight relevant differences in research approaches between clinical disciplines and identify relevant information gaps.
research conducted in both females and males
description of the differences between the sexes/genders
presentation of sex/gender specific analysis
A specific search tool was developed for the present project in collaboration with the Bioinformatics department of our university. A text-mining algorithm (GenderMedST) based on the Lucene platform  and an appropriately designed database (GenderMedDB) have been used for collection and archiving of relevant literature. Apache Lucene is an open-source text-mining platform written in Java. It enables the identification of selected query terms defined by the operator in diverse text sources.
A series of search terms was defined to identify relevant literature. These were "sex difference(s)", "sexual difference(s)", "gender difference(s)", "sexually dimorph(ic)", "sexual dimorphism", "sex dependent", "sex based", "gender based", and "gender dependent". MeSH vocabulary was used for disease definitions and synonyms. MeSH (medical subject headings) represents the National Library of Medicine's vocabulary thesaurus. It is used for the indexing of articles within PubMed and can be applied for the identification of synonyms of disease descriptions.
Abstracts are screened by two independent graders and classified according to the following selection criteria:
Description of "sex/gender" specific differences in the analysed species (human, mouse, rat, and so on.)
Analysis of data with respect to sex/gender-specific differences.
Absence of sex/gender-specific description and analysis of results
Presence of generalized statements without descriptions of performed analysis, for example, "no gender differences were found".
Reference to the analysed condition (for example, "hypertension") only as co-morbidity, confounder, or anamnestic finding.
Selection of specialties and diseases
We selected nine subspecialties in the area of Internal Medicine. The selected specialties were chosen according to standard division of clinical practice and for their ability to represent a broad range of potentially distinct approaches. The following specialties were included: cardiology, pulmonology, nephrology, gastroenterology/hepatology, rheumatology, endocrinology, neurology, haematology and oncology.
Overview of retrieved articles in each discipline
Systemic Lupus Erythematosus
Coronary Heart Disease
Polycystic Kidney Disease
Inflammatory Bowel Disease
Renal Artery Stenosis
AIH PBC PSC
Classification of literature
Literature was classified into the following five research categories: epidemiology, pathophysiology, clinical research, management and outcomes research.
Categories identified the following research:
Epidemiology - data on incidence, prevalence, mortality from survey or routine data, risk factor identification, evaluation and combination
Pathophysiology - basic research investigating pathogenic mechanisms
Clinical research - data on differences in signs and symptoms, differences in routine analyses used for clinical practice and diagnosis
Management - differences in pharmacological, invasive and non-invasive management
Outcomes - long-term consequences of the disease, its management or absence of management
Reviews were recorded separately, as this type of publication frequently contains information matching two or more of the defined categories.
Data on the object of study (human/animal) were extracted from the selected publications as well as the number of participants in the study as stated in the abstract. Studies employing animal models were classified as "pathophysiology".
Publication trends of single diseases (myocardial infarction and asthma)
Publication trends of single diseases used as comparison for sex/gender specific literature were acquired through the PubMed database using the "Limits" option and identifying all publications about the investigated disease published from 1.1.year to 31.12.year.
All information was stored in a "MySQL" (Oracle, Redwood City, CA, USA) database. MySQL is a relational database management system. Descriptive statistics were performed using the "Query Browser" tool included in the MySQL GUI programs. These additional features and upgrades to the MySQL program enable the selection and analysis of specific sets of data within the database. Numerical outputs were then transferred into Excel (Microsoft Corp., Redmond, WA, USA) spreadsheet application for graphics design.
For comparison of publication trends, log(2) of the overall numbers and of the sex/gender specific publications were calculated and tabulated. The comparison was completed by the ratio between the two values × 1,000.
Quantification of publications
A total of 8,836 articles containing the defined search terms were identified by the text-mining tool. Of these, 3,499 matched the inclusion criteria and were further classified according to the pre-defined categories. Publication numbers varied greatly among disciplines and diseases (Table 1). Of all specialties analysed, Cardiology (n = 1,128) and Endocrinology (n = 973) contained most literature including sex/gender-specific analysis, while Nephrology (n = 171) included the least. Three conditions (hypertension, diabetes and obesity) offered more then 300 articles matching our selection criteria; two additional ones (myocardial infarction and coronary artery disease) led to 200 to 300 publication hits. However, great variability characterized these findings. Five or fewer matching publications were retrieved in six cases (renal artery stenosis, IgA nephropathy, AIH/PBC/PSC, Addison's/Cushing, purpura, agranulocytosis). Intra-specialty variations are also significant, as most disciplines include diseases with very different incorporation of sex/gender-specific analysis.
Sex/gender specific literature increased more than disease-specific publications
Research approaches vary within single disciplines
We classified reviews as a separate category as these publications frequently encompass research data from different sources. Nonetheless, this information is significant as reviews reflect the development of scientific knowledge based on original publications. Percentages of review publications are stable ranging from 8% (Multiple Sclerosis) to 16% (Alzheimer's Disease).
Differences in the use of animal models in basic research
Animal models represent one tool for the investigation of disease pathogenesis; however, these models are used more frequently in some fields than in others. To identify differences in utilization of animal models for sex-specific research, the appropriate data were collected and compared to the overall percentages of pathophysiology research (Figure 2B). If all basic research was performed in animal models, the two percentages should be identical. This is never the case, but more substantial variations exist. As illustrated in part A, Nephrology (55%), Neurology (49%) and Rheumatology (47%) were the disciplines with the highest frequencies of basic research. However, research on animal models represents 73% of basic research (40% of all publications) in Nephrology, 51% (25% of all publications) in Neurology and 60% (28% of all publications) in Rheumatology.
The discipline with the least amount of publications on basic research was Pulmonology (22%). Of this total, only 27% was performed in animal models (6% of all research in the field).
Study population size in human studies
Lack of investigation of sex/gender differences in management research
Not surprisingly, given the history of gender medicine, myocardial infarction (36%) and coronary artery disease (31%) offer most information on the subject, together with atrial fibrillation (31%). Asthma (24%), COPD (22%), kidney failure (22%) and leukemia (25%) also offer relatively significant amounts of information about differences in management.
Gender medicine is a novel and rapidly evolving discipline of research. The present study shows how in the last 30 years, publications including sex and gender differences have progressively increased and more strikingly since the 1990s. Different medical disciplines incorporate this type of analysis in different manners, choosing distinct research approaches, experimental designs and cohort sizes; however, one feature common to all disciplines, but cardiology, is the dramatic underrepresentation of investigation of sex and gender differences in clinical management.
This particular aspect needs to be emphasized and critically evaluated. Research on clinical management, that is, diagnostic approaches, referral practices, invasive and non-invasive therapy choices, is essential in understanding, shaping and improving our everyday clinical practice. Lack of knowledge about gender differences and inadequacies in health care provision have led to significant and potentially fatal imbalances in outcomes. This has been demonstrated in the field of cardiology, where the numbers of women dying of heart infarction at a young age [15–17] significantly dropped after two decades of research and the dissemination of essential information about gender differences in clinical presentation, symptoms, diagnostic and therapeutic approaches [18, 19]. Examples from other disciplines are following [20, 21]; however, the information is still scarce and the benefits of this additional knowledge not yet widely accepted by the medical community.
Despite this critical lack of information we found a relevant increase in sex and gender-specific analysis over time, with publications markedly rising since the 1990s. This confirms early reports from the 1990s conducted on a limited set of medical journals [22, 23]. The phenomenon might be related to several factors. On the one side, the previously mentioned eye-opening reports about unexpectedly high numbers of female fatalities due to heart infarction  might have played a role, as well as the predominantly female fatalities related to torsade de pointes as a side effect of drug therapy [24, 25]. Both events have highlighted a previously ignored problem and created the momentum for the implementation of guidelines by the FDA  and NIH [11, 26]. Nonetheless, although the attention toward the topic is increasing, the publication numbers we are identifying are far from satisfactory.
This type of research might still be constrained by limited funds, as there are no specific funding agencies and still few calls for sex and gender-specific research. The difficulty in achieving publications in high impact journals might also play a role. While gender medicine is gaining attention in the scientific community, as demonstrated by the recent editorials in influential journals [10, 27–30], several editors do not consider the topic worthy of publication and refer authors to the few gender medicine journals. Some causes for this imbalance might also be inherent in the project design. Information about sex and gender specific analysis might be included only in the body of the article and thus not captured by our research strategy; however, this should account only for a minority of the publications. Furthermore, it should be clarified that gender specific analysis is not limited to the enumeration of the number of female and male subjects in the study cohort, but extends beyond that in the form of distinct subgroup analyses . This is not performed in many research publications and failure to do so may lead to incomplete or biased results leading to wrong conclusions and actions . Misleading and, at times, incorrect use of the terminology "sex" and "gender" also plays a role. Authors not familiar with the subject oftentimes use the words interchangeably or use the term "gender" for any distinction between subjects, even if this is related to purely biological differences. This represents a further hurdle to the systematic analysis of publications. If one wanted to clearly identify which articles analysed solely biological differences and which ones cultural and psychosocial distinctions, many publications identifying "gender differences" would have to be reclassified as "sex differences". This warrants further analysis in the future.
Our analysis also revealed how the percentage of basic research performed in animal models varies greatly among disciplines. This is an interesting finding and may reflect intrinsic differences in the use of animal models in different specialties. The importance of using both female and male animals in basic research for etiologic investigations or drug testing is being increasingly recognized . Sex differences in rodent and other animal models have been identified in wild type and congenic animals used in diverse disciplines. However, the variability of reaction in female animals due to their hormonal cycle and the potentially increased costs related to the need for larger numbers of animals to account for this variability during analysis still deters many investigators from doing so.
Last, a systematic collection of data is instrumental for research development and identification of needs and relevant questions. Diversity is the main focus of this area of research, but limited the possibility for comparison of strategies in the past. As we have seen, management research needs much attention if we strive to improve gender-sensitive health care, and although sex and gender-specific analyses are increasing, they are not increasing nearly as much as good research practice would lead us to expect. The present work represents a basic assessment of the status quo and will be used as basis for a public database, which will be made accessible to researchers in the field and open for input of their own research publications. We believe that this platform will encourage exchange among researchers interested in sex and gender-specific research and offer opportunities for fruitful cooperation to close some of the gaps identified in this analysis.
The present work represents the first systematic analysis of the incorporation of sex and gender in research design and evaluation in medicine. Marked heterogeneity characterizes different disciplines, possibly reflecting research approaches and gender roles in the specialties themselves. While a progressive increase in the literature can be noted, a striking underrepresentation of research about gender differences in management characterizes all disciplines but cardiology. Given that the area of clinical management has been identified as crucial in the perpetuation of differences in health care provision, this gap needs to be addressed and possibly closed in the future. This data is also needed for the update and improvement of clinical guidelines to include information about sex and gender differences. We believe that all areas where less then 10% of the performed research is about differences in management, that is, Gastroenterology, Nephrology, Rheumatology and Oncology, definitely need to improve this area. However, most other disciplines only slightly exceed these 10% and are thus amenable to improvement as well. Specific analysis of differences in symptoms, diagnostic accuracy and therapy provision need to be addressed. To date the area of Cardiology can be considered the most productive in addressing these concerns and also in partially translating some results into recommendations for practice.
Furthermore, the use of large cohorts for human studies does not automatically guarantee gender-specific analysis and should thus be regarded as a positive evolution, but not a solution. Gender aspects have to be actively identified and analysed in each study.
This work is supported by a research grant of the German Ministry of Education and Research (BMBF 01FW0803).
The authors would like to thank Mr. Konstantin Baumann for help with data evaluation and Dr. Mathias Dunkel for technical support with the setup of the database.
- Legato MJ: Beyond women's health the new discipline of gender-specific medicine. Med Clin North Am. 2003, 87: 917-937. 10.1016/S0025-7125(03)00063-4. viiPubMedView Article
- Anderson GD: Gender differences in pharmacological response. Int Rev Neurobiol. 2008, 83: 1-10. 10.1016/S0074-7742(08)00001-9.PubMedView Article
- Goldberg RJ, O'Donnell C, Yarzebski J, Bigelow C, Savageau J, Gore JM: Sex differences in symptom presentation associated with acute myocardial infarction: a population-based perspective. Am Heart J. 1998, 136: 189-195. 10.1053/hj.1998.v136.88874.PubMedView Article
- Maynard C, Litwin PE, Martin JS, Weaver WD: Gender differences in the treatment and outcome of acute myocardial infarction. Results from the Myocardial Infarction Triage and Intervention Registry. Arch Intern Med. 1992, 152: 972-976. 10.1001/archinte.152.5.972.PubMedView Article
- Oertelt-Prigione S, Regitz-Zagrosek V: Gender aspects in cardiovascular pharmacology. J Cardiovasc Transl Res. 2009, 2: 258-266. 10.1007/s12265-009-9114-9.PubMedView Article
- Regitz-Zagrosek V: Therapeutic implications of the gender-specific aspects of cardiovascular disease. Nat Rev Drug Discov. 2006, 5: 425-438. 10.1038/nrd2032.PubMedView Article
- Nordmeyer J, Eder S, Mahmoodzadeh S, Martus P, Fielitz J, Bass J, Bethke N, Zurbrugg HR, Pregla R, Hetzer R, Regitz-Zagrosek V: Upregulation of myocardial estrogen receptors in human aortic stenosis. Circulation. 2004, 110: 3270-3275. 10.1161/01.CIR.0000147610.41984.E8.PubMedView Article
- Michon F, Tummers M: The dynamic interest in topics within the biomedical scientific community. PLoS One. 2009, 4: e6544-10.1371/journal.pone.0006544.PubMedPubMed CentralView Article
- Correa-De-Araujo R: Serious gaps: how the lack of sex/gender-based research impairs health. J Womens Health (Larchmt). 2006, 15: 1116-1122. 10.1089/jwh.2006.15.1116.View Article
- Kim AM, Tingen CM, Woodruff TK: Sex bias in trials and treatment must end. Nature. 2010, 465: 688-689. 10.1038/465688a.PubMedView Article
- NIH: NIH Guidelines on the inclusion of women and minorities as subjects in clinical research. 2001, Health UNIo ed.: NIH
- Obias-Manno D, Scott PE, Kaczmarczyk J, Miller M, Pinnow E, Lee-Bishop L, Jones-London M, Chapman K, Kallgren D, Uhl K: The Food and Drug Administration Office of Women's Health: impact of science on regulatory policy. J Womens Health (Larchmt). 2007, 16: 807-817. 10.1089/jwh.2006.0135.View Article
- Geller SE, Adams MG, Carnes M: Adherence to federal guidelines for reporting of sex and race/ethnicity in clinical trials. J Womens Health (Larchmt). 2006, 15: 1123-1131. 10.1089/jwh.2006.15.1123.View Article
- McCandless MHE, Gospodnetić O: Lucene in Action. 2008, Manning Publications, Second
- Vaccarino V, Horwitz RI, Meehan TP, Petrillo MK, Radford MJ, Krumholz HM: Sex differences in mortality after myocardial infarction: evidence for a sex-age interaction. Arch Intern Med. 1998, 158: 2054-2062. 10.1001/archinte.158.18.2054.PubMedView Article
- Vaccarino V, Rathore SS, Wenger NK, Frederick PD, Abramson JL, Barron HV, Manhapra A, Mallik S, Krumholz HM: Sex and racial differences in the management of acute myocardial infarction, 1994 through 2002. N Engl J Med. 2005, 353: 671-682. 10.1056/NEJMsa032214.PubMedPubMed CentralView Article
- Demirovic J, Blackburn H, McGovern PG, Luepker R, Sprafka JM, Gilbertson D: Sex differences in early mortality after acute myocardial infarction (the Minnesota Heart Survey). Am J Cardiol. 1995, 75: 1096-1101. 10.1016/S0002-9149(99)80737-1.PubMedView Article
- Towfighi A, Zheng L, Ovbiagele B: Sex-specific trends in midlife coronary heart disease risk and prevalence. Arch Intern Med. 2009, 169: 1762-1766. 10.1001/archinternmed.2009.318.PubMedView Article
- Vaccarino V, Parsons L, Peterson ED, Rogers WJ, Kiefe CI, Canto J: Sex differences in mortality after acute myocardial infarction: changes from 1994 to 2006. Arch Intern Med. 2009, 169: 1767-1774. 10.1001/archinternmed.2009.332.PubMedPubMed Central
- Legato MJ, Gelzer A, Goland R, Ebner SA, Rajan S, Villagra V, Kosowski M: Gender-specific care of the patient with diabetes: review and recommendations. Gend Med. 2006, 3: 131-158. 10.1016/S1550-8579(06)80202-0.PubMedView Article
- Postma DS: Gender differences in asthma development and progression. Gend Med. 2007, 4: S133-146. 10.1016/S1550-8579(07)80054-4.PubMedView Article
- Charney P, Morgan C: Do treatment recommendations reported in the research literature consider differences between women and men?. J Womens Health (Larchmt). 1996, 5: 579-584. 10.1089/jwh.1996.5.579.View Article
- Merkatz R: Promoting gender analysis in peer-reviewed scientific journals: a call to publishers. J Womens Health (Larchmt). 1996, 5: 525-527. 10.1089/jwh.1996.5.525.View Article
- Makkar RR, Fromm BS, Steinman RT, Meissner MD, Lehmann MH: Female gender as a risk factor for torsades de pointes associated with cardiovascular drugs. JAMA. 1993, 270: 2590-2597. 10.1001/jama.270.21.2590.PubMedView Article
- Wysowski DK, Swartz L: Adverse drug event surveillance and drug withdrawals in the United States, 1969-2002: the importance of reporting suspected reactions. Arch Intern Med. 2005, 165: 1363-1369. 10.1001/archinte.165.12.1363.PubMedView Article
- Baird KL: The new NIH and FDA medical research policies: targeting gender, promoting justice. J Health Polit Policy Law. 1999, 24: 531-565.PubMed
- Putting gender on the agenda. Nature. 2010, 465: 665.
- Oertelt-Prigione S, Regitz-Zagrosek V: Women's cardiovascular health: prevention is key. Arch Intern Med. 2009, 169: 1740-1741. 10.1001/archinternmed.2009.353.PubMedView Article
- Zucker I, Beery AK: Males still dominate animal studies. Nature. 2010, 465: 690-10.1038/465690a.PubMedView Article
- Wald C, Wu C: Biomedical research. Of mice and women: the bias in animal models. Science. 327: 1571-1572. 10.1126/science.327.5973.1571.
- Alexanderson K: An assessment protocol for gender analysis of medical literature. Women Health. 1999, 29: 81-98. 10.1300/J013v29n02_06.PubMedView Article
- Rathore SS, Wang Y, Krumholz HM: Sex-based differences in the effect of digoxin for the treatment of heart failure. N Engl J Med. 2002, 347: 1403-1411. 10.1056/NEJMoa021266.PubMedView Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/8/70/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.