Exam Scoring and Proctoring
This page covers AI used to score assessments, detect cheating, or influence pass/fail and progression outcomes.
Why this is usually high-riskโ
Education and certification decisions can affect long-term academic and career opportunities. AI errors in this domain can create large and hard-to-reverse harm, so these uses are usually treated as high-risk candidates.
Proctoring that infers emotional state in an education context is prohibited (Art 5(1)(f)). Biometric categorisation inferring sensitive traits โ race, political opinions, religion, sexual orientation, etc. โ is also prohibited (Art 5(1)(g)). If your proctoring does either, stop and escalate; do not treat it as merely high-risk.
Required obligationsโ
WHENโ
- AI contributes to exam scoring, integrity flags, or progression decisions.
- A model change can alter scoring or suspicious-behavior outcomes.
MUSTโ
- Classify as high-risk candidate and escalate for formal determination.
- Prevent release until required high-risk controls and evidence are approved.
- Check the Art 6(3) derogation: it may be lower-risk if it only performs a narrow procedural or preparatory task โ but profiling of students makes it always high-risk. Self-classifying as not-high-risk still requires a documented assessment (Art 6(4)) and EU-database registration (Art 49(2)).
- Support the affected student's right to explanation for scoring/progression decisions (Art 86).
- Implement transparency notices where the feature also triggers user disclosure duties.
OUTPUT artifactsโ
- High-risk classification record and role assignment.
- Release gate evidence showing required controls were completed.
- Disclosure evidence (if applicable), such as UI copy and localization checks.
Pre-dates the AI Act and was resolved outside it (a policy reversal, not a court ruling), but illustrative of education-scoring harm (Annex III area 3):
- Ofqual A-level algorithm (UK, 2020): an automated grading model downgraded roughly 40% of results and was withdrawn after public backlash. (overview)