
Scoring Reliability
Inter-rater agreement tracking (Cohen’s κ), criterion-level variance, periodic calibration rounds

RAG Grounding
Required citation density (rubric rows + course sources), ungrounded claim detector, retrieval coverage metrics

Academic Integrity
Similarity & code-clone checks, metadata heuristics, optional proctoring signal ingestion

Privacy & Security
FERPA / GDPR alignment, encryption at rest / in transit, role-based access, scoped retention

Monitoring & Benchmarks
Latency, abandonment, rubric drift, LMS posting success, A/B on regrade rates and student CSAT

Human QA & Appeals
Confidence thresholds, queue views for TAs, one-click regrade with full provenance