This study determined interrater and interjudge reliability
for transcription of communication of veterans with amyotrophic lateral sclerosis (ALS) using a P300based BCI as an augmentative and alternative communication (AAC) system.
74, respectively, and the interjudge reliability
coefficients were .
refers to the consistency in which independent coders categorize content and is usually reported as a percentage.
Three expert judges scored videotaped pre and posttests with interjudge reliability
ranging from .
SR authors should provide interjudge reliability
data for (a) the identification of the initial set of potential sources and (b) the evaluation of the level of evidence and the quality of methods of the primary sources.
For all independent variables, we estimated the interjudge reliability
coefficient using Rust and Cooil's (1994) proportional reduction in loss (PRL) reliability measure, which can be evaluated using the same criteria as evaluating Cronbach's alpha--i.
To assess interjudge reliability
, all three judges read and assessed an identical set of 20 reports.
was obtained by a split half product moment correlation.
Kassarjian (8) recommends that interjudge reliability
values be greater than 80 percent.
Investigations of the reliability of these various methods generally have centered around test-retest reliability, alternative form reliability, and interjudge reliability
of scoring; for all these types of reliability, results have indicated that most correlation coefficients surpassed the minimal criterion of .
was calculated among the three experts using a Pearson product-moment correlation matrix; reliabilities ranged from .
in classifying the special education resource teachers' interventions into the four categories was .