
CP


AB

Include

Pending

Totals


Include

17^{a}

0^{b}

17^{m1}

Exclude

0^{c}

3^{d}

3^{m0}

Totals

17^{n1}

3^{n0}

20^{n}

 (a) and (d) represent the number of times the two observers agree while (b) and (c) represent the number of times the two observers disagree, m_{1} = row total number for inclusions, m_{0} = row total number of exclusions,n_{1} = column total for inclusions, n_{0} = column total for exclusions