USMLE purpose: Distinguish Cohen’s kappa, Kendall’s tau, and Pearson correlation coefficient when interpreting agreement and correlation questions.
Use Cohen’s kappa for agreement between raters, Kendall’s tau for ordinal/ranked association, and Pearson r for linear correlation between continuous variables.
| Statistic | Best use | Board-style clue |
|---|---|---|
| Cohen’s kappa | Inter-rater agreement beyond chance | Two clinicians/radiologists agree on diagnosis |
| Kendall’s tau | Ordinal/ranked association | Rank order, nonparametric ordinal data |
| Pearson correlation coefficient | Linear correlation between continuous variables | Scatterplot, r value, straight-line relationship |
| r value | Meaning |
|---|---|
| +1 | Perfect positive linear correlation |
| 0 | No linear correlation |
| -1 | Perfect negative linear correlation |
Two radiologists independently classify chest x-rays as pneumonia present or absent. Which statistic is most appropriate to measure agreement?