Although there are statistical methods to evaluate whether agreement among raters is greater than chance ( Binomial test, Friedman test, or Kendall s coefficient of concordance ), these methods do not provide a best estimate of the true answers nor do they estimate competence of the raters.
परिभाषा
a coefficient of agreement (concordance) between different sets of rank orderings of the same set of things