Inter-Rater Reliability Calculator
Calculate Cohen's kappa coefficient to measure agreement between two raters beyond what would be expected by chance. Get an interpretation of your reliability score.
Inputs
Results
Cohen's Kappa
0.6
How to Use This Calculator
- Enter the number of raters and the number of items rated.
- Input the rating scale type (nominal, ordinal, interval).
- Enter the percentage of agreements observed across all rater pairs.
- Review the Cohen's Kappa or ICC coefficient along with its interpretation.
- If Kappa is below 0.60, schedule a rater calibration session and re-rate a subset of items.
Related Calculators
Likert Scale Analyzer
Analyze 5-point Likert scale survey responses to get mean, median, standard deviation, and top/bottom-box percentages with a distribution chart.
Net Promoter Score Calculator
Calculate your Net Promoter Score (NPS) from survey responses. Enter the count of promoters, passives, and detractors to see your score and classification.
Margin of Error Calculator
Calculate the margin of error for your survey results based on sample size, confidence level, population size, and expected proportion.
Conjoint Analysis Calculator
Calculate the relative importance of product or service attributes from conjoint analysis utility ranges. Determine which features matter most to your respondents.