FleissKappa_csvFile compute Fleiss Kappa (and Cohens Kappa)

Code collection to compute Fleiss' Kappa annotator agreemenet given an easy csv spreadsheet file. Note that Fleiss Kappa is used for more than two annotators (for 2 you can use Cohens Kappa). This Repository contains code for two different implementation that require the same input format, a java implementation and a 'R implementation. Only the R implementation supports as well Cohens Kappa.

Input Format

See for example example_input.csv (random created file = low kappa), each column contains the annotation from one annotator. The first line contains the names of the annotator (can be anything). Every other line can contain numeric or categorical values. The seperator is comma.

Usage

1. for the java code see/modify the src/KappaCSV.java code or simply run the executable java -jar fleisskappa.jar <inpputfile.csv>
2. for the R code replace the path in the read.csv function in src/fleiss_Kappa.R and execute the script within R (e.g by runningsource('fleiss_kappa.R')). If you want to run Cohens Kappa instead, see use the kappa2 function (in comments)

Code Reference

The java implementation is based on Fleiss Kappa Java The R implementation is based on Fleiss Kappa R