Skip to main content

Standardizing the reporting of Mendelian randomization studies

Peer Review reports

Background

Mendelian randomization (MR), i.e., instrumental variable analysis using genetic instruments, is increasingly used in epidemiologic investigations to improve causal inference within an observational study design. This paradigm is more robust to environmental confounding and reverse causation than traditional epidemiological study designs and can be implemented using summary statistics from genome wide association studies (GWAS) [1]. For example, BMC Medicine has already published 11 MR studies between 1 January and 5 April 2023, in comparison to only 4 studies published in the year of 2018. In view of this trend, BMC Medicine has recently updated the submission guidelines where authors of MR studies are strongly encouraged to report their studies according to the STROBE-MR checklist (https://bmcmedicine.biomedcentral.com/submission-guidelines/preparing-your-manuscript/research-articles) [2]. It is hoped that their standardized reporting is of benefit to journal editors, reviewers, and readers for critically appraising the evidence and facilitating its interpretation.

STROBE-MR checklist to improve reporting of MR studies

Reporting of MR studies has been variable, hence limiting potential for appraisal [3]. Consequently, the STROBE-MR checklist (https://www.strobe-mr.org/) has been developed to help authors ensure reporting of all the details essential for evaluating the quality and validity of an MR study [2]. The checklist includes 20 main items and 30 subitems covering different aspects, ranging from assessing underlying assumptions and characteristics of the underlying GWAS, to the reporting of corresponding findings [2]. Reporting based on STROBE-MR will hopefully help authors ensure that all relevant elements of the MR study are considered. This would also help avoid pitfalls (e.g., lack of allele harmonization) that can drastically impact the validity of the study [4].

However, more checks on the STROBE-MR checklist do not necessarily mean the MR study is of better quality. For example, authors may inaccurately report assumptions for sensitivity analyses or use wrong unit for exposures. Furthermore, a credible MR study requires careful design by the authors. Examples of additional considerations include those related to selection bias for diseases having a late age of onset (e.g., Alzheimer’s disease) [1]; possibility of substantial biasing pleiotropy related to genetic variants for particular phenotypes (e.g., observed drug use); the choice of GWAS (e.g., only relying on data curated in particular databases which may not be most up-to-date and hence may limit statistical power); and relevance of instruments in the outcome GWAS (e.g., the use of smoking intensity instruments among smokers only). Conversely, not all elements of the checklist may be applicable to every type of MR study. For example, where a single unweighted genetic variant is used as an instrument, details of the statistical methods used to generate the MR estimate are less applicable, as these are only variant-trait associations.

Other forms of Mendelian randomization studies and emerging methodologies

The STROBE-MR checklist primarily focuses on conventional MR studies that assess the impact of an exposure on a disease outcome. However, there are emerging forms of MR studies (e.g., drug-target MR studies) that require reporting of additional information, which has only been touched upon briefly in STROBE-MR [2]. Specifically, drug target MR studies investigate the effects of drug target perturbation by leveraging variants in the putative gene regions as instruments [5]. As a result, this form of MR requires reporting of additional information, such as clear description of the gene region, the trait used to identify genetic instruments, corresponding MR methods, and whether the analysis was corroborated with colocalization analyses [6]. Similarly, MR studies now also increasingly consider circulating proteins as exposures. This form of MR study has different selection criteria for instruments. Specifically, cis-protein quantitative trait loci (cis-pQTL), defined as the variants in the protein encoding gene region, are often preferred as they are generally less prone to having pleiotropic effects as compared to trans-pQTL variants, which are selected from throughout the genome rather than the corresponding protein’s gene region. Such MR study often also includes colocalization to assess whether a distinct variant at a locus explains the genetic associations with two traits. Conventional sensitivity analyses such as weighted median and MR-Egger are likely inappropriate given these cis-variants are highly correlated and hence are susceptible to the same degree of bias from pleiotropic associations. Authors using these various MR designs should therefore consult respective guidelines or recommendations for proper reporting regarding the items in STROBE-MR checklist [5, 7]. Furthermore, MR methods have been evolved rapidly and authors should be mindful of the new methodologies which may outperform previous methods. One recent example is the use of doubly ranked stratification method instead of residual based method when assessing non-linear effects with MR [8].

Conclusions

In conclusion, adherence to STROBE-MR checklist will likely improve reporting of MR studies for better evaluation and interpretation by those involved in the peer review process, as well as the end users. Authors of MR studies should be aware of any additional information needs to be reported based on the respective designs for proper assessment. Via triangulation of evidence, well-conducted MR studies can complement findings from traditional epidemiological studies and randomized controlled trials, collectively contributing to a more solid evidence base for public health policies and prioritization of clinical trial study for communicable and non-communicable diseases [9, 10].

Availability of data and materials

Not applicable.

References

  1. Sanderson E, Glymour MM, Holmes MV, et al. Mendelian randomization. Nat Rev Methods Primers. 2022;2(1):6. https://doi.org/10.1038/s43586-021-00092-5.

    Article  CAS  Google Scholar 

  2. Skrivankova VW, Richmond RC, Woolf BAR, et al. Strengthening the reporting of observational studies in epidemiology using mendelian randomisation (STROBE-MR): explanation and elaboration. BMJ. 2021;375:n2233. https://doi.org/10.1136/bmj.n2233. Published Online First: 2021/10/28.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Boef AG, Dekkers OM, le Cessie S. Mendelian randomization studies: a review of the approaches used and the quality of reporting. Int J Epidemiol. 2015;44(2):496–511. https://doi.org/10.1093/ije/dyv071. Published Online First: 2015/05/09.

    Article  PubMed  Google Scholar 

  4. Hartwig FP, Davies NM, Hemani G, et al. Two-sample Mendelian randomization: avoiding the downsides of a powerful, widely applicable but potentially fallible technique. Int J Epidemiol. 2016;45(6):1717–26. https://doi.org/10.1093/ije/dyx028.

    Article  PubMed  Google Scholar 

  5. Gill D, Georgakis MK, Walker VM, et al. Mendelian randomization for studying the effects of perturbing drug targets. Wellcome Open Res. 2021;6:16. https://doi.org/10.12688/wellcomeopenres.16544.2. Published Online First: 2021/03/03.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Zuber V, Grinberg NF, Gill D, et al. Combining evidence from Mendelian randomization and colocalization: review and comparison of approaches. Am J Hum Genet. 2022;109(5):767–82. https://doi.org/10.1016/j.ajhg.2022.04.001. Published Online First: 2022/04/23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Burgess S, Mason AM, Grant AJ, et al. Using genetic association data to guide drug discovery and development: review of methods and applications. Am J Hum Genet. 2023;110(2):195–214. https://doi.org/10.1016/j.ajhg.2022.12.017. Published Online First: 2023/02/04.

    Article  CAS  PubMed  Google Scholar 

  8. Burgess S, Wood AM, Butterworth AS. Mendelian randomisation and vitamin D: the importance of model assumptions - authors’ reply. Lancet Diabetes Endocrinol. 2023;11(1):15–6. https://doi.org/10.1016/S2213-8587(22)00344-8. Published Online First: 2022/12/18.

    Article  CAS  PubMed  Google Scholar 

  9. Holmes MV, Ala-Korpela M, Davey SG. Mendelian randomization in cardiometabolic disease: challenges in evaluating causality. Nat Rev Cardiol. 2017;14(10):577–90. https://doi.org/10.1038/nrcardio.2017.78. Published Online First: 2017/06/02.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Luo S, Liang Y, Wong THT, et al. Identifying factors contributing to increased susceptibility to COVID-19 risk: a systematic review of Mendelian randomization studies. Int J Epidemiol. 2022. https://doi.org/10.1093/ije/dyac076. Published Online First: 2022/04/22.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

None.

Funding

None declared.

Author information

Authors and Affiliations

Authors

Contributions

S.L.A.Y wrote the first draft of this commentary, with feedback from D.G. All authors read and approved the final manuscript. S.L.A.Y had primary responsibility for final content.

Corresponding author

Correspondence to Shiu Lun Au Yeung.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Shiu Lun Au Yeung is currently an editorial board member of BMC Medicine. Dipender Gill is currently an editorial advisor of BMC Medicine.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Au Yeung, S., Gill, D. Standardizing the reporting of Mendelian randomization studies. BMC Med 21, 187 (2023). https://doi.org/10.1186/s12916-023-02894-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12916-023-02894-8

Keywords