Table 2 Cohen’s kappa coefficient for middle-level labeling
From: Semantic relation identification for consecutive predicative constituents in Chinese
Annotator 2 | Annotator 3 | Annotator 4 | Annotator 5 (reference standard) | |
|---|---|---|---|---|
Annotator 1 | 0.59 | 0.60 | 0.64 | 0.67 |
Annotator 2 | 0.53 | 0.57 | 0.64 | |
Annotator 3 | 0.63 | 0.73 | ||
Annotator 4 | 0.76 |