Choosing the best index for the average score intraclass correlation coefficient

Gwowen Shieh*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

17 Scopus citations

Abstract

The intraclass correlation coefficient (ICC)(2) index from a one-way random effects model is widely used to describe the reliability of mean ratings in behavioral, educational, and psychological research. Despite its apparent utility, the essential property of ICC(2) as a point estimator of the average score intraclass correlation coefficient is seldom mentioned. This article considers several potential measures and compares their performance with ICC(2). Analytical derivations and numerical examinations are presented to assess the bias and mean square error of the alternative estimators. The results suggest that more advantageous indices can be recommended over ICC(2) for their theoretical implication and computational ease.

Original languageEnglish
Pages (from-to)994-1003
Number of pages10
JournalBehavior Research Methods
Volume48
Issue number3
DOIs
StatePublished - 1 Sep 2016

Keywords

  • Multilevel modeling
  • Random effect
  • Reliability

Fingerprint Dive into the research topics of 'Choosing the best index for the average score intraclass correlation coefficient'. Together they form a unique fingerprint.

Cite this