Skip to main content

Table 6 Sensitivity, specificity, positive likelihood ratio, and negative likelihood ratio for usual peer review and ECRs using COBPeer for each item

From: Accuracy in detecting inadequate research reporting by early career peer reviewers using an online CONSORT-based peer-review tool (COBPeer) versus the usual peer-review process: a cross-sectional diagnostic study

 Sensitivity (%)Specificity (%)Positive likelihood ratioNegative likelihood ratio
ECRUsual peer reviewp valueECRUsual peer reviewp valueECRUsual peer reviewECRUsual peer review
All domains83.6 [79.7–87.0]19.0 [15.4–23.1]< 0.00162.9 [59.1–66.6]79.9 [76.6–82.9]< 0.0012.26 [2.02–2.51]0.94 [0.73–1.21]0.26 [0.21–0.33]1.01 [0.96–1.08]
All CONSORT domains85.7 [81.8–89.1]19.7 [15.9–24.1]< 0.00160.9 [56.7–64.9]77.2 [73.6–80.6]< 0.0012.19 [1.96–2.44]0.87 [0.67–1.12]0.23 [0.18–0.30]1.04 [0.97–1.11]
- Item 6a (Outcomes)94.8 [85.6–98.9]27.6 [16.7–40.9]< 0.00142.6 [30.0–55.9]57.4 [44.1–70.0]0.161.65 [1.32–2.07]0.65 [0.39–1.08]0.12 [0.04–0.38]1.26 [0.97–1.65]
- Item 8a (Randomization/sequence generation)76.3 [59.8–88.6]34.2 [19.6–51.4]< 0.00185.2 [75.6–92.1]76.5 [65.8–85.2]0.215.15 [2.97–8.94]1.46 [0.81–2.63]0.28 [0.16–0.50]0.86 [0.66–1.11]
- Item 9 (Allocation concealment mechanism)82.3 [70.5–90.8]8.1 [2.7–17.8]< 0.00171.9 [58.5–83.0]87.7 [76.3–94.9]0.052.93 [1.90–4.51]0.66 [0.22–1.95]0.25 [0.14–0.43]1.04 [0.93–1.18]
- Items 11/1b (Blinding)56.9 [42.2–70.7]19.6 [9.8–33.1]< 0.00176.5 [64.6–85.9]83.8 [72.9–91.6]0.382.42 [1.48–3.95]1.21 [0.56–2.63]0.56 [0.40–0.79]0.96 [0.81–1.14]
- Items 13a/13b (Participant flow)92.3 [79.1–98.3]17.9 [7.5–33.5]< 0.00121.3 [12.9–31.8]78.8 [68.2–87.1]< 0.0011.17 [1.01–1.36]0.84 [0.38–1.87]0.36 [0.11–1.16]1.04 [0.87–1.25]
- Item 17a (Outcomes and estimation)93.8 [82.8–98.7]33.3 [20.4–48.4]< 0.00156.3 [44.0–68.1]64.8 [52.5–75.8]0.422.15 [1.63–2.82]0.95 [0.57–1.58]0.11 [0.04–0.34]1.03 [0.79–1.34]
- Item 19 (Harms)97.2 [90.2–99.7]9.9 [4.1–19.3]< 0.0018.3 [2.3–20.0]75.0 [60.4–86.3]< 0.0011.06 [0.97–1.16]0.39 [0.17–0.93]0.34 [0.06–1.77]1.20 [1.00–1.44]
- Item 23 (Trial registration)88.9 [65.3–98.6]11.1 [1.4–34.7]< 0.00195.1 [88.8–98.4]88.1 [80.2–93.7]0.0917.96 [7.52–42.86]0.94 [0.23–3.83]0.12 [0.03–0.43]1.01 [0.84–1.21]
Switched outcomes61.1 [43.4–76.9]11.1 [3.1–26.1]< 0.00177.1 [66.6–85.6]97.6 [91.6–99.7]< 0.0012.67 [1.66–4.28]4.61 [0.88–24.05]0.50 [0.33–0.77]0.91 [0.81–1.03]