Repository navigation
Add support for Krippendorff's alpha reliability coefficient #13
Description
(First of all, thanks so much for this package!
While it took me some time to get used to it, it's super handy even for simple statistics in business applications.)
I might lack the knowledge to combine the pieces of this framework, but I'm missing explicit support for measuring reliability between raters, e.g. Krippendorff's alpha.
R provides a nice interface for this here.
Thanks again for your efforts and time in supporting this project!
Activity
clbustos commentedon Mar 16, 2013
Can you provide me a reference? A journal or book reference will be cool :)
ludwigschubert commentedon Mar 17, 2013
Yes.
The Original paper by Prof. Krippendorf is available here.
Together with a colleague he also provided a (to me unreadable) implementation in SAS here.
Instead, I'd recommend working of Matlab code and the wikipedia article on the subject.
I'm currently using R's package "irr"'s implementation, which can be found here - I extracted the specific file for you in this GIST.
Let me know if there's anything else I can help with - unfortunately I had about one introductory class in statistics, so the finer points of Krippendorf's alpha are entirely lost on me.