← Back to Dashboard
1. Policy Mapping and Control Evidence2. Human Oversight and Escalation Governance

Human Oversight and Escalation Governance

📚 Compliance and Governance10 min105 XP

Keep Humans in the Right Loop

Define explicit oversight triggers for sensitive decisions, legal risk, and high-impact automation. Human oversight is not a fallback of failure only; it is a design requirement for regulated workflows - and "a human reviews it" only counts if that human has time, context, and authority to actually intervene.

Choose the Loop Deliberately

PatternHow it worksRight for
Human-in-the-loopAI proposes, human approves before executionIrreversible/high-impact actions: payments, terminations, legal notices
Human-on-the-loopAI acts autonomously; humans monitor dashboards and can haltMedium-risk, high-volume: ticket routing, draft replies
Human-out-of-the-loopFully autonomous within tight boundsLow-risk, reversible: tagging, summarisation, caching

Trigger Criteria That Actually Fire

escalate_to_human if:
  action.impact == "irreversible"          # deletes, payments, external comms
  or confidence < workflow.threshold        # model uncertainty
  or guardrail.intervened                   # safety signal
  or request.matches(legal_risk_patterns)   # regulatory surface
  or tenant.tier == "regulated"             # contractual requirement

Design Against Rubber-Stamping

  • Give reviewers evidence, not homework - the approval screen shows the proposed action, the reasoning trace, and the top evidence links; not a raw transcript.
  • Meter reviewer load - an approver handling 400 requests/day is a click-through machine, and your "oversight" is fictional. Track approval latency and override rate as health metrics.
  • Log the human decision - approvals and overrides are audit events with named principals; override patterns feed back into routing thresholds.
  • Authority must be real - the reviewer can block, modify, or escalate without a VP sign-off chain that everyone bypasses under deadline.
Metric that exposes theatre: if override rate is ~0% for months, either the AI is perfect (unlikely) or oversight has decayed into rubber-stamping. Sample-audit approved items to find out which.
🧪 Knowledge Check
Press 1-4 to select1 of 2
Human oversight should be:
Ad-hoc and undocumented
Explicitly designed with trigger criteria
Removed for speed
Only for demos