Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/sage/comparison-of-the-null-distributions-of-weighted-kappa-and-the-c-on290iX0um
References (8)
-
Jacob Cohen (1968)
Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 70
-
J. Fleiss, Jacob Cohen, B. Everitt (1969)
Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 72
-
(1972)
Assessing observer agreement with dichotomous-ordinalized data -
J. Fleiss, Jacob Cohen (1973)
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of ReliabilityEducational and Psychological Measurement, 33
-
K. Krippendorff (1970)
Bivariate Agreement Coefficients for Reliability of DataSociological Methodology, 2
-
The authors wish to acknowledge the major role played by Joseph Vitale, at Yale University -
D. Cicchetti (1972)
A new measure of agreement between rank ordered variables. -
for his expert counsel, critical review, and encouragement, during the earty phases of this research
- Publisher
- SAGE
- Copyright
- Copyright © by SAGE Publications
- ISSN
- 0146-6216
- eISSN
- 1552-3497
- DOI
- 10.1177/014662167700100206
- Publisher site
- See Article on Publisher Site
Abstract
It frequently occurs in psychological research that an investigator is interested in assessing the ex tent of interrater agreement when the data are measured on an ordinal scale. This monte carlo study demonstrates that the appropriate statistic to apply is weighted kappa with its revised standard error. The study also demonstrates that the mini mal number of cases required for the valid applica tion of weighted kappa varies between 20 and 100, depending upon the size of the ordinal scale. This contrasts with a previously cited large sample esti mate of 200. Given the difficulty of obtaining sam ple sizes this large, the latter finding should be of some comfort to investigators who use weighted kappa to measure interrater consensus.
Journal
Applied Psychological Measurement – SAGE
Published: Mar 1, 1977