International Journal of Internet Science

A peer reviewed open access journal for empirical findings, methodology, and theory of social and behavioral science concerning the Internet and its implications for individuals, social groups, organizations, and society.

Volume 8, Issue 1 (2013)

ReCal OIR: Ordinal, Interval, and Ratio Intercoder Reliability as a Web Service
Deen Freelon
American University School of Communication, Washington, DC, USA

Abstract: This article introduces ReCal OIR, an extension to the existing ReCal suite of online intercoder reliability modules that accommodates ordinal, interval, and ratio levels of measurement. It includes a discussion of the currently available options for calculating reliability for the ordinal, interval, and ratio levels; explains what ReCal OIR does; validates its calculations; and discusses its usage data. The process of validating its output reveals ReCal OIR to be slightly more accurate than one of its major competitors.

Keywords: Intercoder reliability, interrater reliability, ReCal, web service, content analysis

pdf Download full paper