interrater agreement

(int′ĕr-rāt′ĕr)

The extent to which two or more individuals come to the same conclusions when they examine a single set of data.

References in periodicals archive ?

The authors report adequate levels of interrater agreement for the CPRSR (r = .

MEASURING ACQUIRED CAPABILITY FOR SUICIDE: INCREMENTAL VALIDITY OF THE DEATH INUREMENT SCALE

The first author compared 20% of each scorer's writing samples with her own and calculated interrater agreement (number of agreements divided by agreements plus disagreements and multiplied by 100).

Effects of early writing intervention delivered within a data-based Instruction Framework

The initial interrater agreement was 90%; after discussion, 100% agreement was reached.

Intersubjectivity and discussion characteristics in online courses

The analysis of interrater agreement is available in the "Occupational Requirements Survey job observation report" at http://www.

Occupational Requirements Survey: results from a job observation pilot test

Interrater agreement and internal consistency are high ([kappa] = 0.

A comparative study of Glasgow Coma Scale and full outline of unresponsiveness scores for predicting long-term outcome after brain injury

Therefore, it is possible to have human judgement bias during interrater agreement if specific procedures to characterize and classify the scanpaths are not developed.

Characterization of visual scanning patterns in air traffic control

Ratings of interrater agreement over the study period were consistent, ranging from 0.

Stepped care model for pain management and quality of pain care in long-term opioid therapy

Cronbach's alpha, inter-item and inter-total correlations, and interrater agreement were used to evaluate reliability of the tool.

Psychometric testing of a simulation rubric for measuring interprofessional communication

According to Whitehurst (1984), "There are many reasons to be concerned with interrater agreement in peer review, not the least of which is a prevalent impression that the fate of a manuscript .

Peer review in agricultural education: interrater reliability of manuscript reviews for the 2014 National Agricultural Education Research Conference

Interrater agreement: Interrater Reliability (IRR) and Interrater Agreement (IRA) indices are often used to justify aggregating data used in composition models (LeBreton & Senter, 2008).

Ability mediation effects in the relationships between Human Resource Practices and service quality

Interrater agreement between biopsy based diagnoses and EMR based diagnoses was determined by using the kappa statistic.

Diagnostic accuracy of mucosal biopsy versus endoscopic mucosal resection in Barrett's esophagus and related superficial lesions

Assessing risk of bias in prevalence studies: modification of an existing tool and evidence of interrater agreement.

Some notes on critical appraisal of prevalence studies: comment on: "the development of a critical appraisal tool for use in systematic reviews addressing questions of prevalence"