Skip to main content

Table 2 Risk of bias assessment. Three ‘Yes’ assessments results in an overall assessment of evidence-based

From: Checklists to detect potential predatory biomedical journals: a systematic review

Study Represent 1+ stakeholder groups (Y/N/U)* Gather data for checklist development (Y/N/Only citations/ U) Does the checklist meet at least one of these criteria?
(count only the last column in total)
Pilot test
(Y/N/U)
Includes number of criteria to be considered predatory (Y/N) Overall assessment (is it evidence-based?) (Y/N)
Title (Y/N) Fits on one page (Y/N) Each item one sentence (Y/N) Meets at least one of these (Y/N)
Checklists from electronic journal databases (n = 53)
[REFERENCE CHECKLIST] Shamseer, 2017 [13] U Y Y Y Y Y U N N
Beall, 2012 [10] U U N N N N U N N
Beall, 2013 [15] U Y Y Y Y Y U N N
Crawford, 2014 [82] U U N Y Y Y U N N
Knoll, 2014 [83] U Only citations Y Y N Y U N N
Lukic, 2014 [84] U Only citations N Y N Y U N N
Beall, 2015 [85] U Only citations N N N N U N N
Bhad, 2015 [86] U U Y Y Y Y U N N
Bradley-Springer, 2015 [87] U Only citations N Y N Y U N N
Hemmat Esfe, 2015 [88] U Only citations N Y Y Y U N N
INANE Predatory Publishing Practices Collaborative, 2015 [89] U U Y Y Y Y U N N
Pamukcu Gunaydin, 2015 [90] U Only citations N Y N Y U N N
Proehl, 2015 [91] U U N Y Y Y U N N
Stone, 2015 [92] U Only citations N Y Y Y U N N
Yucha, 2015 [93] U U Y Y Y Y U N N
Cariappa, 2016 [94] U Only citations Y Y Y Y U N N
Carroll, 2016 [95] U Y Y Y Y Y U N N
Dadkhah, 2016 [96] U Y Y Y Y Y Y Y Y
Fraser, 2015 [97] U Only citations Y Y Y Y U N N
Glick, 2016 [98] U U Y Y Y Y U N N
Glick, 2016a [99] U Only citations Y Y Y Y U N N
Hansoti, 2016 [100] Y Y N Y N Y U N Y
Morley, 2016 [101] U U N N N N U N N
Nolan, 2016 [102] U U N Y N Y U N N
Ward, 2016 [103] U U N N N N U N N
Abadi, 2017 [16] U U N Y Y Y U N N
Balehegn, 2017 [30] U Only citations N Y Y Y U N N
Berger, 2017 [17] U U N Y N Y U N N
Das, 2017 [18] U Only citations Y Y Y Y U N N
Erfanmanesh, 2017 [19] U Only citations Y Y Y Y U N N
Eriksson, 2017 [20] U U Y Y Y Y U N N
Janodia, 2017 [21] U U Y Y N Y U N N
Khan, 2017 [22] Y Only citations Y Y N Y U N N
Klyce, 2017 [23] U Only citations Y Y Y Y U N N
Manca, 2017 [24] U Only citations N Y N Y U N N
Miller, 2017 [25] U U Y Y Y Y U N N
Misra, 2017 [26] U Y Y Y Y Y U N N
Mouton, 2017 [27] U U Y Y N Y Y Y Y
Oren, 2017 [28] U U Y Y Y Y U N N
Shamseer, 2017 [13] U Y Y Y Y Y U N N
Stratton, 2017 [29] U U Y Y Y Y U N N
Ajuwon, 2018 [33] U Only citations Y Y Y Y U N N
Bowman, 2018 [34] U U Y Y N Y U N N
Gerberi, 2018 [35] U Only citations Y Y N Y U N N
Pamukcu Gunaydin, 2018 [36] U Only citations Y Y N Y U N N
Kokol, 2018 [37] U Y N Y Y Y U N N
Lewinski, 2018 [38] U Y Y Y N Y U N N
McCann, 2018 [31] U Y Y Y Y Y U N N
Memon, 2018 [39] U Y Y Y Y Y U N N
Nnaji, 2018 [40] U Only citations Y N N Y U N N
O’Donnell, 2018 [32] U Only citations N N N N U N N
Power, 2018 [41] U Only citations N N N N U N N
Richtig, 2018 [42] U Only citations Y Y N Y U N N
Wikipedia, 2019 [104] U Only citations N Y Y Y U N N
Checklists from university library websites (n = 30)
[REFERENCE CHECKLIST] Shamseer, 2017 [13] U Y Y Y Y Y U N N
Carlson, 2014 [43] U Y N N N N U N N
Clark, 2015 [1] U U N Y N Y U N N
University of Edinburgh, 2015 [44] U U Y Y Y Y U N N
Africa Check, 2017 [45] U Only citations N Y N Y U N N
Cabell’s - Clarivate, 2017 [46] Y U N N Y Y U N N
Duke University Medical Center, 2017 [47] U U N N N N U N N
University of Calgary, 2017 [48] U U N Y N Y U N N
Coopérer en information scientifique et technique, 2018 [49] U U N N Y Y U N N
Eaton, University of Calgary, 2018 [50] U Y N Y Y Y U N N
Lapinski, Harvard University, 2018 [51] U U N N N N U N N
Sorbonne Université, 2018 [52] U U Y Y Y Y U N N
University of Alberta, 2018 [54] U U N N N N U N N
University of British Columbia, 2018 [53] U Only citations Y N N Y U N N
University of Toronto Libraries, 2018 [55] Y U N N N N U Y N
Dalhousie University, 2019 [56] U U Y Y N Y U N N
McGill University, 2019 [57] U U N Y N Y U N N
McMaster University, 2019 [58] U U N Y Y Y U N N
Prater - American Journal Experts, 2019 [59] Y U N N N N U N N
Ryerson University Library, 2019 [60] U U N Y N Y U N N
Université Laval, 2019 [61] U U N Y N Y U N N
University of Cambridge, 2019 [62] U U N Y N Y U N N
University of Pretoria, 2019 [63] U U N Y Y Y U N N
University of Queensland Library, 2019 [65] U U N Y N Y U N N
University of Queensland Library, 2019a [64] U U N Y N Y U N N
University of Witwatersrand, 2019 [66] U U Y N Y Y U N N
Canadian Association of Research Libraries, ND [67] U U N Y Y Y U N N
Columbia University Libraries, ND [68] U U N Y N Y U N N
Technion Library, ND [69] U U N Y N Y U N N
UC Berkeley, ND [70] U U N Y N Y U N N
University of Ottawa Scholarly Communication, ND [71] U U N Y N Y U N N
Checklists from YouTube (n = 10) [URLs available athttps://osf.io/eds9f/]
[REFERENCE CHECKLIST] Shamseer, 2017 [13] U Y (cross-sectional study on journals) Y Y Y Y U N N
Robbins S, Western Sydney University, 2015 [72] U U Y Y Y Y U N N
Attia, 2017 [73] U U Y N N Y U N N
Kysh, USC Keck School of Medicine, 2017 [74] U U Y Y Y Y U N N
McKenna, Rhodes University, 2017 [75] U U Y Y Y Y U N N
Nicholson, University of Witwatersrand, 2017 [76] U U Y N N Y U N N
Raszewski, 2017 [77] U U Y Y N Y U N N
Seal-Roberts, Springer Healthcare, 2017 [78] U U Y Y Y Y U N N
Menon, SCMS Group of Educational Institutions, India and Berryman, Cabells, 2018 [79] U U Y Y Y Y U N N
Office of Scholarly Communication, Cambridge University, 2018 [80] U U N N Y Y U N N
Weigand, UNC Libraries, 2018 [81] U U N Y Y Y U N N
  1. *Y Yes, N No, U Unclear