Table 2 Risk of bias assessment. Three ‘Yes’ assessments results in an overall assessment of evidence-based
From: Checklists to detect potential predatory biomedical journals: a systematic review
Study | Represent 1+ stakeholder groups (Y/N/U)* | Gather data for checklist development (Y/N/Only citations/ U) | Does the checklist meet at least one of these criteria? (count only the last column in total) | Pilot test (Y/N/U) | Includes number of criteria to be considered predatory (Y/N) | Overall assessment (is it evidence-based?) (Y/N) | |||
|---|---|---|---|---|---|---|---|---|---|
Title (Y/N) | Fits on one page (Y/N) | Each item one sentence (Y/N) | Meets at least one of these (Y/N) | ||||||
Checklists from electronic journal databases (n = 53) | |||||||||
[REFERENCE CHECKLIST] Shamseer, 2017 [13] | U | Y | Y | Y | Y | Y | U | N | N |
Beall, 2012 [10] | U | U | N | N | N | N | U | N | N |
Beall, 2013 [15] | U | Y | Y | Y | Y | Y | U | N | N |
Crawford, 2014 [82] | U | U | N | Y | Y | Y | U | N | N |
Knoll, 2014 [83] | U | Only citations | Y | Y | N | Y | U | N | N |
Lukic, 2014 [84] | U | Only citations | N | Y | N | Y | U | N | N |
Beall, 2015 [85] | U | Only citations | N | N | N | N | U | N | N |
Bhad, 2015 [86] | U | U | Y | Y | Y | Y | U | N | N |
Bradley-Springer, 2015 [87] | U | Only citations | N | Y | N | Y | U | N | N |
Hemmat Esfe, 2015 [88] | U | Only citations | N | Y | Y | Y | U | N | N |
INANE Predatory Publishing Practices Collaborative, 2015 [89] | U | U | Y | Y | Y | Y | U | N | N |
Pamukcu Gunaydin, 2015 [90] | U | Only citations | N | Y | N | Y | U | N | N |
Proehl, 2015 [91] | U | U | N | Y | Y | Y | U | N | N |
Stone, 2015 [92] | U | Only citations | N | Y | Y | Y | U | N | N |
Yucha, 2015 [93] | U | U | Y | Y | Y | Y | U | N | N |
Cariappa, 2016 [94] | U | Only citations | Y | Y | Y | Y | U | N | N |
Carroll, 2016 [95] | U | Y | Y | Y | Y | Y | U | N | N |
Dadkhah, 2016 [96] | U | Y | Y | Y | Y | Y | Y | Y | Y |
Fraser, 2015 [97] | U | Only citations | Y | Y | Y | Y | U | N | N |
Glick, 2016 [98] | U | U | Y | Y | Y | Y | U | N | N |
Glick, 2016a [99] | U | Only citations | Y | Y | Y | Y | U | N | N |
Hansoti, 2016 [100] | Y | Y | N | Y | N | Y | U | N | Y |
Morley, 2016 [101] | U | U | N | N | N | N | U | N | N |
Nolan, 2016 [102] | U | U | N | Y | N | Y | U | N | N |
Ward, 2016 [103] | U | U | N | N | N | N | U | N | N |
Abadi, 2017 [16] | U | U | N | Y | Y | Y | U | N | N |
Balehegn, 2017 [30] | U | Only citations | N | Y | Y | Y | U | N | N |
Berger, 2017 [17] | U | U | N | Y | N | Y | U | N | N |
Das, 2017 [18] | U | Only citations | Y | Y | Y | Y | U | N | N |
Erfanmanesh, 2017 [19] | U | Only citations | Y | Y | Y | Y | U | N | N |
Eriksson, 2017 [20] | U | U | Y | Y | Y | Y | U | N | N |
Janodia, 2017 [21] | U | U | Y | Y | N | Y | U | N | N |
Khan, 2017 [22] | Y | Only citations | Y | Y | N | Y | U | N | N |
Klyce, 2017 [23] | U | Only citations | Y | Y | Y | Y | U | N | N |
Manca, 2017 [24] | U | Only citations | N | Y | N | Y | U | N | N |
Miller, 2017 [25] | U | U | Y | Y | Y | Y | U | N | N |
Misra, 2017 [26] | U | Y | Y | Y | Y | Y | U | N | N |
Mouton, 2017 [27] | U | U | Y | Y | N | Y | Y | Y | Y |
Oren, 2017 [28] | U | U | Y | Y | Y | Y | U | N | N |
Shamseer, 2017 [13] | U | Y | Y | Y | Y | Y | U | N | N |
Stratton, 2017 [29] | U | U | Y | Y | Y | Y | U | N | N |
Ajuwon, 2018 [33] | U | Only citations | Y | Y | Y | Y | U | N | N |
Bowman, 2018 [34] | U | U | Y | Y | N | Y | U | N | N |
Gerberi, 2018 [35] | U | Only citations | Y | Y | N | Y | U | N | N |
Pamukcu Gunaydin, 2018 [36] | U | Only citations | Y | Y | N | Y | U | N | N |
Kokol, 2018 [37] | U | Y | N | Y | Y | Y | U | N | N |
Lewinski, 2018 [38] | U | Y | Y | Y | N | Y | U | N | N |
McCann, 2018 [31] | U | Y | Y | Y | Y | Y | U | N | N |
Memon, 2018 [39] | U | Y | Y | Y | Y | Y | U | N | N |
Nnaji, 2018 [40] | U | Only citations | Y | N | N | Y | U | N | N |
O’Donnell, 2018 [32] | U | Only citations | N | N | N | N | U | N | N |
Power, 2018 [41] | U | Only citations | N | N | N | N | U | N | N |
Richtig, 2018 [42] | U | Only citations | Y | Y | N | Y | U | N | N |
Wikipedia, 2019 [104] | U | Only citations | N | Y | Y | Y | U | N | N |
Checklists from university library websites (n = 30) | |||||||||
[REFERENCE CHECKLIST] Shamseer, 2017 [13] | U | Y | Y | Y | Y | Y | U | N | N |
Carlson, 2014 [43] | U | Y | N | N | N | N | U | N | N |
Clark, 2015 [1] | U | U | N | Y | N | Y | U | N | N |
University of Edinburgh, 2015 [44] | U | U | Y | Y | Y | Y | U | N | N |
Africa Check, 2017 [45] | U | Only citations | N | Y | N | Y | U | N | N |
Cabell’s - Clarivate, 2017 [46] | Y | U | N | N | Y | Y | U | N | N |
Duke University Medical Center, 2017 [47] | U | U | N | N | N | N | U | N | N |
University of Calgary, 2017 [48] | U | U | N | Y | N | Y | U | N | N |
Coopérer en information scientifique et technique, 2018 [49] | U | U | N | N | Y | Y | U | N | N |
Eaton, University of Calgary, 2018 [50] | U | Y | N | Y | Y | Y | U | N | N |
Lapinski, Harvard University, 2018 [51] | U | U | N | N | N | N | U | N | N |
Sorbonne Université, 2018 [52] | U | U | Y | Y | Y | Y | U | N | N |
University of Alberta, 2018 [54] | U | U | N | N | N | N | U | N | N |
University of British Columbia, 2018 [53] | U | Only citations | Y | N | N | Y | U | N | N |
University of Toronto Libraries, 2018 [55] | Y | U | N | N | N | N | U | Y | N |
Dalhousie University, 2019 [56] | U | U | Y | Y | N | Y | U | N | N |
McGill University, 2019 [57] | U | U | N | Y | N | Y | U | N | N |
McMaster University, 2019 [58] | U | U | N | Y | Y | Y | U | N | N |
Prater - American Journal Experts, 2019 [59] | Y | U | N | N | N | N | U | N | N |
Ryerson University Library, 2019 [60] | U | U | N | Y | N | Y | U | N | N |
Université Laval, 2019 [61] | U | U | N | Y | N | Y | U | N | N |
University of Cambridge, 2019 [62] | U | U | N | Y | N | Y | U | N | N |
University of Pretoria, 2019 [63] | U | U | N | Y | Y | Y | U | N | N |
University of Queensland Library, 2019 [65] | U | U | N | Y | N | Y | U | N | N |
University of Queensland Library, 2019a [64] | U | U | N | Y | N | Y | U | N | N |
University of Witwatersrand, 2019 [66] | U | U | Y | N | Y | Y | U | N | N |
Canadian Association of Research Libraries, ND [67] | U | U | N | Y | Y | Y | U | N | N |
Columbia University Libraries, ND [68] | U | U | N | Y | N | Y | U | N | N |
Technion Library, ND [69] | U | U | N | Y | N | Y | U | N | N |
UC Berkeley, ND [70] | U | U | N | Y | N | Y | U | N | N |
University of Ottawa Scholarly Communication, ND [71] | U | U | N | Y | N | Y | U | N | N |
Checklists from YouTube (n = 10) [URLs available athttps://osf.io/eds9f/] | |||||||||
[REFERENCE CHECKLIST] Shamseer, 2017 [13] | U | Y (cross-sectional study on journals) | Y | Y | Y | Y | U | N | N |
Robbins S, Western Sydney University, 2015 [72] | U | U | Y | Y | Y | Y | U | N | N |
Attia, 2017 [73] | U | U | Y | N | N | Y | U | N | N |
Kysh, USC Keck School of Medicine, 2017 [74] | U | U | Y | Y | Y | Y | U | N | N |
McKenna, Rhodes University, 2017 [75] | U | U | Y | Y | Y | Y | U | N | N |
Nicholson, University of Witwatersrand, 2017 [76] | U | U | Y | N | N | Y | U | N | N |
Raszewski, 2017 [77] | U | U | Y | Y | N | Y | U | N | N |
Seal-Roberts, Springer Healthcare, 2017 [78] | U | U | Y | Y | Y | Y | U | N | N |
Menon, SCMS Group of Educational Institutions, India and Berryman, Cabells, 2018 [79] | U | U | Y | Y | Y | Y | U | N | N |
Office of Scholarly Communication, Cambridge University, 2018 [80] | U | U | N | N | Y | Y | U | N | N |
Weigand, UNC Libraries, 2018 [81] | U | U | N | Y | Y | Y | U | N | N |