← Back to Dashboard
1. Policy Mapping and Control Evidence2. Human Oversight and Escalation Governance
Human Oversight and Escalation Governance
📚 Compliance and Governance⏱ 10 min⭐ 105 XP
Keep Humans in the Right Loop
Define explicit oversight triggers for sensitive decisions, legal risk, and high-impact automation. Human oversight is not a fallback of failure only; it is a design requirement for regulated workflows - and "a human reviews it" only counts if that human has time, context, and authority to actually intervene.
Choose the Loop Deliberately
| Pattern | How it works | Right for |
|---|---|---|
| Human-in-the-loop | AI proposes, human approves before execution | Irreversible/high-impact actions: payments, terminations, legal notices |
| Human-on-the-loop | AI acts autonomously; humans monitor dashboards and can halt | Medium-risk, high-volume: ticket routing, draft replies |
| Human-out-of-the-loop | Fully autonomous within tight bounds | Low-risk, reversible: tagging, summarisation, caching |
Trigger Criteria That Actually Fire
escalate_to_human if:
action.impact == "irreversible" # deletes, payments, external comms
or confidence < workflow.threshold # model uncertainty
or guardrail.intervened # safety signal
or request.matches(legal_risk_patterns) # regulatory surface
or tenant.tier == "regulated" # contractual requirement
Design Against Rubber-Stamping
- Give reviewers evidence, not homework - the approval screen shows the proposed action, the reasoning trace, and the top evidence links; not a raw transcript.
- Meter reviewer load - an approver handling 400 requests/day is a click-through machine, and your "oversight" is fictional. Track approval latency and override rate as health metrics.
- Log the human decision - approvals and overrides are audit events with named principals; override patterns feed back into routing thresholds.
- Authority must be real - the reviewer can block, modify, or escalate without a VP sign-off chain that everyone bypasses under deadline.
Metric that exposes theatre: if override rate is ~0% for months, either the AI is perfect (unlikely) or oversight has decayed into rubber-stamping. Sample-audit approved items to find out which.
🧪 Knowledge Check
Press 1-4 to select1 of 2
Human oversight should be:
Ad-hoc and undocumented
Explicitly designed with trigger criteria
Removed for speed
Only for demos