| Test Field | Number of Tests Taken | Open-Response Items | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Item 1 | Item 2 | ||||||||
| Scorer Agreement | Inter-rater Reliability | Scorer Agreement | Inter-rater Reliability | ||||||
| Percent Agreement | Percent Exact | Percent Adjacent | Percent Agreement | Percent Exact | Percent Adjacent | ||||
| 1,272 | 98.7 | 67.4 | 31.3 | 0.80 | 99.4 | 73.1 | 26.4 | 0.85 | |
| 487 | 99.4 | 77.2 | 22.2 | 0.86 | 98.6 | 75.2 | 23.4 | 0.75 | |
Test Field. The test field code and name.
Number of Tests Taken. The number of tests taken during the reporting period, including those tests retaken by the same candidate.
For Item 1 and Item 2:
- Scorer Agreement. The following information is provided indicating rates of scorer agreement on the individual raw scores given to each open-response item: the percent of cases in which the first two scorers were in agreement (i.e., assigned identical or adjacent scores), the percent of exact scores, and the percent of adjacent scores.
- Inter-rater Reliability. The inter-rater reliability indicates the correlation between the first and second score assigned to each response, corrected using the Spearman-Brown formula. This information is provided for each open-response item.