Table 3

Criteria for evaluating the quality of the psychometric properties

Measurement propertyRating*Criteria
Reliability+Intraclass correlation coefficient or weighted Kappa ≥ 0.70
?Intraclass correlation coefficient or weighted Kappa not reported
Intraclass correlation coefficient or weighted Kappa < 0.70
Measurement error+Smallest detectable change or limits of agreement < minimal important change†
?Minimal important change not defined
Smallest detectable change or limits of agreement > minimal important change†
Hypotheses testing for+The results are in accordance with the hypothesis‡
construct validity?Hypothesis is not defined (by the review committee)
The result is not in agreement with the hypothesis‡
Criterion validity+Correlation with gold/reference standard ≥ 0.70 or area under the curve ≥ 0.70
?Not all information for ‘+’ reported
Correlation with gold/reference standard < 0.70 or area under the curve < 0.70
Responsiveness+The results are in agreement with the hypothesis‡ or area under the curve ≥ 0.70
?Hypothesis is not defined (by the review committee)
The result is not in agreement with the hypothesis‡ or area under the curve < 0.70
  • The criteria list has been adapted from Prinsen et al.53

  • *Rating: ‘+’=sufficient, ‘?’=indeterminate, ‘– ‘=insufficient.

  • †This rating of evidence may be obtained from different studies.

  • ‡The findings of all studies must be complied together and then it must be decided if 75% of the findings are in agreement with the hypotheses.