Definitions and statistical measures of consensus, agreement and stability
| Definition | Statistics | Round 2 | Round 3 | |
| Consensus | The extent to which the group of experts share the same opinion | Median IQR Per cent agreement | ≥3.5 ≤1.5 ≥60% | ≥3.5 ≤1 ≥70% |
| Agreement | A measure of inter-rater agreement where the rating of one expert can be predicted by the rating of another | Kendall’s coefficient of concordance | Significant agreement (p<0.05) | Significant agreement (p<0.05) |
| Stability | The consistency of responses between successive rounds | Wilcoxon rank-sum test | NA | Significance level p<0.05 |
NA, not applicable.