Module 1 · The Policy Problem

Lecture 1.4

Why AI Creates Urgency

Interpretation has always been unrecorded, and institutions absorbed the resulting variance because human throughput was low. Autonomous systems remove that slack. This lecture examines why the authority layer becomes load-bearing precisely when execution becomes machine-speed.

Supports Law 5Intelligence Executes Systems — It Does Not Repair Them.

Learning objectives

After this lesson, the reader should understand:

  • 01Explain why unrecorded interpretation scales into systemic risk.
  • 02Distinguish model alignment from authority binding.
  • 03State what an institution must be able to prove after an automated decision.

Concept framework

From tolerable variance to systemic risk

  1. 01Low volume, human pace — variance absorbed
  2. 02Automation of routine steps — variance replicated
  3. 03Autonomous execution — variance compounded
  4. 04No replay path — accountability lost
  5. 05Authority artifact — variance bounded and recorded

Case study

An agent acting under delegated authority

An AI agent approves ten thousand cases in a week. What must the institution be able to show a regulator?

Not the model, and not the prompt. The institution must show which authority governed each approval, which version of it applied, which facts were evaluated, and that the same evaluation reproduces the same outcome today. A model can be aligned to a policy and still leave nothing to inspect afterwards. Authority binding is a separate requirement from model behaviour, and only the former is verifiable by a party that did not run the system.

Discussion questions

  • Is prompting a policy into a model a form of policy compilation?
  • Who is accountable when an agent misapplies an artifact correctly compiled?
  • What is the minimum record an automated decision must leave?

Exercise

Draft the evidence pack for one automated decision.

  1. 01Name the authority and its version.
  2. 02List the facts evaluated and their source.
  3. 03State the outcome and the path that produced it.
  4. 04Identify who could verify this without access to your systems.

Research notes

  • AI governance — auditability and the right to explanation.
  • Safety engineering — the role of the operating envelope.
  • Provenance research — verifiable records of computation.