custom-config accuracy · 984 rubric evals · last 14 days
Q2 guide · manual evals: 85.00% overall
90.84%
982 rubric evals · custom · 14d
Q2 guide · 86.77%
100.00%
2 rubric evals · custom · 14d · low volume
Q2 guide · 86.39%
—
No custom-config volume in the last 14 days
Q2 guide · 85.15%
—
No custom-config volume in the last 14 days
Q2 guide · 66.04%
99.71%
63,182 answers · 14d
Objective · answer-level · all items
90.43%
11,205 answers · 14d
Objective · answer-level · all items
92.04%
754 answers · 14d
Objective · answer-level · all items
91.90%
210 answers · 14d
Objective · answer-level · all items
Share of teacher-reviewed AI rubric grading that was not corrected, on items using strictness configs (reviewed = result viewed by the teacher, or answer explicitly corrected). Custom (teacher-made) configs are the primary series; system configs are shown for comparison. Dashed lines show the Q2 guide. Days with fewer than 30 rubric evaluations are hidden.
Last computed Jul 10, 3:06 AM
Cron-computed strictness accuracy per day. Cells under 30 rubric evaluations are muted (low volume). Most recent day is highlighted.
| Day | Problem Solvingavg 90.83% | Essayavg 100.00% | Visuals— | Code on Paper— |
|---|---|---|---|---|
| 2026-07-03 | 89.80% 765 evals | — | — | — |
| 2026-07-02 | 100.00% 16 evals | — | — | — |
| 2026-07-01 | — | 100.00% 2 evals | — | — |
| 2026-06-30 | 94.03% 201 evals | — | — | — |
Manual Evaluation Runs
Curated eval-run results. Currently showing the Q2 guide — values below are reference only until a Q3 eval run is added.
Combined accuracy across all item types
Math, science & logical reasoning
34,610 evaluations
Written response evaluation quality
16,757 evaluations
Diagram & image-based questions
653 evaluations
Handwritten code interpretation
4,455 evaluations
Record a new evaluation run. Enter the eval count and accuracy % for each item type.
Changes compared to the previous snapshot (+ = improved, − = declined). Most recent row is highlighted.
| Date | Evals | Overall | Prob. Solving | Essay | Visuals | Code on Paper |
|---|---|---|---|---|---|---|
2026-06-29original | 56,475 | 85.00% — | 86.77% — | 86.39% — | 85.15% — | 66.04% — |