Inter-rater proportion of agreement in assessment between only ‘early’, ‘active’ and ‘late’ scleroderma patterns
| ‘No SSc-specific’* | ‘Early’ | ‘Active’ | ‘Late’ | Total | |
|---|---|---|---|---|---|
| Rater 2, episode A† | |||||
| Rater 1 | |||||
| 'No SSc-specific'* | 16 | 0 | 9 | 11 | 36 |
| 'Early' | 0 | 1 | 0 | 0 | 1 |
| 'Active' | 0 | 0 | 14 | 1 | 15 |
| 'Late' | 2 | 0 | 3 | 12 | 17 |
| Total | 18 | 1 | 26 | 24 | 69‡ |
| Rater 2, episode B§ | |||||
| Rater 2, episode A | |||||
| 'No SSc-specific'* | 11 | 0 | 2 | 5 | 18 |
| 'Early' | 0 | 1 | 0 | 0 | 1 |
| 'Active' | 0 | 0 | 22 | 4 | 26 |
| 'Late' | 0 | 0 | 2 | 22 | 24 |
| Total | 11 | 1 | 26 | 31 | 69‡ |
↵† Category ‘No SSc-specific’ = ‘normal’ and ‘scleroderma-like’ (to be able to investigate the reliability between ‘only’ the ‘early’, ‘active’ and ‘late’ scleroderma patterns, the ‘scleroderma-like’ pattern had to be categorised together with the ‘normal’ category).
↵† Proportion of overall agreement: (16+1+14+12)/69=43/69=62%.
↵‡ Images of two patients were evaluated by rater 2, episode A as both ‘active’ and ‘late’ pattern. Consequently, these two pictures were left out the calculation.
↵§ Proportion of overall agreement: (11+1+22+22)/69=56/69=81%.
SSc, systemic sclerosis.