Case severity: domain and problem intra-assessor and interassessor reliability (n=4) using 134 healthcare claim letters
| HCAT problem categories | Intrareliability | Inter-reliability | ||||
| Agreement | Gwet’s AC1 | 95% CI | Agreement | Gwet’s AC | 95% CI | |
| Clinical problems | 0.94 | 0.86 | 0.80 to 0.92 | 0.87 | 0.75 | 0.68 to 0.82 |
| Quality | 0.78 | 0.38 | 0.21 to 0.55 | 0.74 | 0.48 | 0.37 to 0.59 |
| Safety | 0.92 | 0.83 | 0.77 to 0.90 | 0.86 | 0.71 | 0.63 to 0.78 |
| Management problems | 0.99 | 0.99 | 0.99 to 1.00 | 0.98 | 0.97 | 0.96 to 0.98 |
| Environment | 1.00 | 1.00 | 1.00 to 1.00 | 0.96 | 0.96 | 0.93 to 0.98 |
| Institutional processes | 0.96 | 0.96 | 0.93 to 0.99 | 0.87 | 0.82 | 0.77 to 0.88 |
| Relationship problems | 0.99 | 0.99 | 0.98 to 1.00 | 0.98 | 0.97 | 0.96 to 0.98 |
| Listening | 0.97 | 0.97 | 0.95 to 0.99 | 0.92 | 0.89 | 0.85 to 0.93 |
| Communication | 0.99 | 0.99 | 0.98 to 1.00 | 0.97 | 0.96 | 0.94 to 0.98 |
| Respect and patients’ rights | 1.00 | 1.00 | 0.99 to 1.00 | 0.99 | 0.99 | 0.98 to 1.00 |
HCAT, Healthcare Complaints Analysis Tool.