Table 3

Differences in pooled κ values (n=20) among subgroups according to number of reviewers, reviewer experience and reviewer training

nPooled κ* (SD)95% CIp Value†
Group of reviewers
 Max 570.80 (0.07)0.66 to 0.940.006
 >5–2070.52 (0.06)0.40 to 0.64
 >2060.54 (0.02)0.50 to 0.59
 Total20
Reviewer experience (records/reviewer)
 <10070.71 (0.06)0.58 to 0.840.062
 100–30060.51 (0.04)0.43 to 0.58
 >30070.53 (0.04)0.45 to 0.62
 Total20
Training
 <1 day40.53 (0.07)0.37 to 0.680.809
 1 day40.56 (0.14)0.25 to 0.87
 >1 day50.57 (0.05)0.45 to 0.67
 Total13
  • *Pooled κ weighted for the number of records on which the κ value is calculated.

  • †p Values are obtained with the prevalence rate as covariate.