Inter-rater agreement of experts’ evaluations and operational characteristics of the method for assessment of the appropriateness of hospitalisations
| Statistics | General medicine n=100 | Cardiology n=70 | Neurology n=119 | Surgery n=92 | Total pilot sample n=381 |
| Appropriateness of admissions | |||||
| Sensitivity (%) | 84.8 | 96.3 | 96.4 | 97.3 | 95.1 |
| Specificity (%) | 73.1 | 87.5 | 68.5 | 94.7 | 76.6 |
| Area under ROC curve (рvalue) | 0.865(0.002) | 0.977 (<0.001) | 0.945 (<0.001) | 0.991 (<0.001) | 0.948 (<0.001) |
| Overall agreement (%) | 84.0 | 94.2 | 88.2 | 90.5 | 92.8 |
| Cohen’s κ(95% CI) | 0.702 (0.566to 0.839) | 0.916 (0.871to 0.961) | 0.888 (0.781to 0.996) | 0.934 (0.843to 1.000) | 0.915 (0.799to 1.000) |
| Duration of inpatient stay | |||||
| Sensitivity (%) | 88.4 | 96.3 | 96.6 | 97.2 | 95.3 |
| Specificity (%) | 85.9 | 87.5 | 75.0 | 94.4 | 84.7 |
| Area under ROC curve (рvalue) | 0.870(0.009) | 0.920 (<0.001) | 0.860(0.007) | 0.960 (<0.001) | 0.900(0.001) |
| Overall agreement (%) | 86.7 | 91.9 | 90.1 | 94.3 | 91.2 |
| Cohen’s κ(95% CI) | 0.737 (0.604to 0.870) | 0.838 (0.684to 0.992) | 0.772 (0.639to 0.905) | 0.902 (0.794to 1.000) | 0.812 (0.749to 0.875) |
ROC, receiver operating characteristic.