Chapter 13 — The Autonomy Ladder
4729 words
An autonomy level enforced by instruction is not an autonomy level. It is a hope with a number attached.
- The five levels, defined as sets of revoked capabilities rather than sets of permissions
- The two inputs that set the ceiling — harnessability and blast radius — and a scoring instrument you can run on your own repositories this week
- Why the top of the ladder is currently closed for most work, and why the field's marketing suggests otherwise
- The one class of work where A4 is available today, which turns out to be the outer loop's own maintenance
- Taleb's barbell applied to autonomy, and the honest account of where the analogy fails
autonomy level is a function of harnessability × blast radius and never of enthusiasm — but the ladder is only real if each level is implemented as capabilities the agent does not hold. And because Chapter 8's behaviour harness remains unsolved, the honest ceiling for most work today is a re-founded A2 rather than the A3/A4 the market is selling.
13.1 Why a ladder
Three arguments from earlier chapters converge on the need for something like this, and it is worth seeing that they are independent.
From Ashby. Chapter 8 established that variety reduction is forced: a bounded regulator cannot govern an unbounded generator, so the space of what may be produced must be narrowed. An autonomy level is variety reduction by scope of authority — the crudest and cheapest form available, because it does not require you to understand the work, only to bound it.
From governance. Chapter 11 §11.9 showed that accountability once travelled with authorship, that authorship is now machine, and that responsibility therefore defaults to approval — precisely the gate Chapter 5 demonstrated had collapsed. We have attached responsibility to the weakest remaining signal. The way out is to move accountability onto the decision that actually determines outcomes: this class of change may run at this level of authority. That is a decision someone made, can be asked about, and can revise after an incident. "The reviewer approved it" is not.
From economics. Chapter 3 established that verification capacity is the constraint. Autonomy level is the dial that sets how much verification each unit of work consumes. Setting it uniformly across all work — which is what almost every organisation does implicitly — means spending the same scarce resource on a documentation fix and a payments change.
So the ladder is not a maturity poster. It is a governance instrument, and Chapter 12's fifth prohibition is its operating rule: do not raise an autonomy level without evidence of harnessability and blast radius.
13.2 The five levels
| Level | Agent authority | Human role | Typical use | |
|---|---|---|---|---|
| A0 | Assisted | Suggests inline; the human types | Author | Sensitive or regulated code where human authorship is itself the requirement |
| A1 | Supervised | Edits, with approval at each step | Pair | Unfamiliar domain; high-consequence change; a new agent or model being calibrated |
| A2 | Delegated | Completes a scoped task; the human reviews the resulting diff | Reviewer | The workhorse level today, and the one whose foundation §13.6 questions |
| A3 | Bounded-autonomous | Multi-task within a defined topology, gated by sensors | Approver at merge | Well-harnessed services with a working acceptance set |
| A4 | Continuous | Runs unprompted; opens pull requests without being asked | Policy-setter | Drift work, migrations, janitorial maintenance — see §13.7 |
Two clarifications that prevent the most common misreadings.
A level applies to a class of work, not to an agent, a team, or a person. The same agent may operate at A4 on dependency bumps and A0 on the payment path, in the same repository, in the same hour. Any organisation with a single answer to "what autonomy level are we at?" has misunderstood the instrument.
Higher is not better. The ladder is not a maturity progression to be climbed. A0 is the correct level for some work permanently. Chapter 8's variety-reduction framing makes this obvious: the level that reduces the most variety is the safest, and the only reason to grant more authority is that the work does not warrant the cost of withholding it.
13.3 A level is a set of revoked capabilities
This is the section that decides whether the ladder is an instrument or a poster, and it follows directly from Chapter 11.
That chapter's central finding: injection defeats every control operating on what an agent believes and cannot defeat one bounding what an agent can do. A poisoned context can make an agent want to merge without review; it cannot give the agent merge permission it does not hold.
Apply that here and a common practice collapses.
"The agent is operating at A2, so it should ask before merging" is a belief-based control. It is Chapter 10's tier four — an assertion, defeated by any injection, and defeated equally by an ordinary misunderstanding. An autonomy level implemented as an instruction in a context file is not a level. It is a hope with a number attached.
A level is real when it is implemented as capabilities the agent does not hold:
Notice what this is, structurally. It is via negativa again — defining a level by what is removed rather than what is granted. That makes four appearances now: Chapter 2's shrinking harness, Chapter 8's variety reduction, Chapter 10's unrepresentable states, and now this. The repetition is not stylistic. In a system whose failure modes are unbounded, removal is the only intervention whose effect you can be certain about, so every durable control in this book ends up being subtractive. It is worth naming the pattern rather than letting it look accidental.
Two consequences worth acting on.
The last row of Figure 13.1 is load-bearing. An agent permitted to modify the harness that governs it, or to change its own permissions, has no autonomy level — it has whatever level it can talk itself into. Chapter 8's advice to point the agent at the harness is correct and requires this separation: the agent improving the harness must be a different invocation, at a different level, with its changes reviewed as changes to a control.
Capability revocation must be scoped by effect, not by name. Chapter 11's refinement applies in full. "A2 agents may not run dangerous commands" scopes a name; a sealed sandbox with no network egress and no credentials in the environment scopes an effect. Cursor's allowlist bypass (CVE-2026-22708) is what the first looks like when it fails.
13.4 The two inputs
The rule, stated once: autonomy ceiling = f(harnessability, blast radius). Never enthusiasm, never seniority of the requester, never how well the last task went.
Harnessability is Chapter 8's definition: variety reduction already banked. How much of the work of constraining this codebase has already been done? It is an inherited asset with a balance, and it determines how much of the verification you can mechanise.
Blast radius is the scope of harm reachable from a change. Chapter 11 sharpened it: what an attacker can reach through the agent is what the agent can reach, so blast radius is a security quantity and a reliability quantity simultaneously.
The asymmetry between them matters, and it explains why the rule multiplies rather than adds. Harnessability determines how likely you are to catch a bad change. Blast radius determines what it costs if you do not. Risk is the product, and Taleb's objection to reasoning about probability alone applies with force here: in the presence of a large enough blast radius, a small failure probability is not reassuring, because the expected loss is dominated by a term you cannot estimate. Chapter 11 §11.7 made the same argument about benchmarks — you cannot sample your way to tail safety.
Hence the practical rule that follows: blast radius vetoes. A high-blast-radius change does not become eligible for high autonomy because your harness is excellent. It becomes eligible for high autonomy when the blast radius has been reduced — by feature flags, by reversibility, by removing the credential, by splitting the change.
13.5 The instrument
An honest word first. What follows is an instrument for structuring a decision, not a measurement. The dimensions are real and the weights are judgment. Its value is that it forces a team to say out loud what it currently assumes silently, and it produces an artefact someone can be accountable for — which is the whole point of §13.1.
Harnessability: score each 0, 1, or 2.
| Question | 0 | 1 | 2 | |
|---|---|---|---|---|
| H1 | Types. Does the compiler reject a wrong-shaped change? | Dynamic, or types unused | Partial or advisory | Statically typed and enforced |
| H2 | Acceptance. Is there a human-authored acceptance set the agent cannot see? | No tests, or generated only | Tests, all agent-visible | Held-out acceptance set exists (Ch 8 §8.8) |
| H3 | Boundaries. Does a forbidden import or layer violation fail the build? | No boundaries | Documented, unenforced | Mechanically enforced (fitness functions) |
| H4 | Blocking sensors. Do checks run inside the agent's edit cycle and refuse bad edits? | None | Advisory in-loop | Blocking on edit (Ch 7 §7.4) |
| H5 | References. Can every caller of a symbol be enumerated reliably? | grep only | Partial tooling | Graph-backed, CI-refreshed (Ch 9) |
| H6 | Drills. Has any control been shown to fire by deliberately producing its failure? | Never tested | Ad hoc | Scheduled drills with records (Ch 8 §8.9) |
Score 0–12. Bands: 0–4 low · 5–8 medium · 9–12 high.
Two things about this table are deliberate. H2 and H4 are the two questions most organisations will score 0 on, and they are the two that matter most — H2 because it is the only defence against Chapter 8's consistency-not-correctness problem, and H4 because Chapter 7's evidence puts hook adoption at 0.9%–3.2%, meaning most teams have no blocking sensors at all. And H6 exists because a control nobody has drilled is Böckeler's silent sensor: indistinguishable from an absent one.
Blast radius: score each 0, 1, or 2, then take the maximum, not the sum.
| Question | 0 | 1 | 2 | |
|---|---|---|---|---|
| B1 | Secrets. Can the change path reach credentials or tokens? | No | Scoped, short-lived | Yes, long-lived |
| B2 | Data. Can it mutate production data irreversibly? | No | Reversible mutation | Irreversible |
| B3 | Reversibility. How fast can this be rolled back? | Minutes, automated | Hours | Not cleanly |
| B4 | Fan-in. How many call sites depend on what is changing? | Few, enumerable | Moderate | Large or unknown (Ch 10 §10.5) |
| B5 | Regulatory. Is this in scope for an audit or compliance regime? | No | Adjacent | Directly in scope |
| B6 | Contexts. Does the change span more than one bounded context? | Single context | Two, well-defined | Many, or unclear (Ch 10 §10.4) |
Take the maximum, because blast radius does not average. A change that is perfectly reversible and touches nothing except that it can reach a long-lived production credential is a high-blast-radius change. Averaging would hide exactly the term that dominates the loss.
The ceiling:
That last observation is the instrument's main payoff, and it is not the one people expect. Running a uniform A2 policy is both too permissive and too conservative at once — over-exposed on the payments path and needlessly expensive on the documentation fix. The gain from scoring is not "we can go faster"; it is reallocation of a scarce resource, which is Chapter 3's constraint managed deliberately.
13.6 The ceiling is currently closed
Chapter 8 left this chapter a constraint I am obliged to honour rather than write around.
The behaviour harness — the apparatus that verifies the software does what was actually wanted — is unsolved. Böckeler's assessment: current practice pairs functional specifications with AI-generated test suites, which "puts a lot of faith into the AI-generated tests, that's not good enough yet", and "we still have a lot to do to figure out good harnesses for functional behaviour that increase our confidence enough to reduce supervision and manual testing" [D].
Read the last clause again. To reduce supervision. Reducing supervision is exactly what climbing this ladder means. So:
What follows is uncomfortable and I think correct: A3 and A4 are, today, reachable only by two routes, and neither is "our harness is good."
Route one: blast radius near zero. If being wrong costs almost nothing and is trivially reversible, you do not need to verify behaviour before the fact. You can discover the error afterwards, cheaply. This is the left-hand column of Figure 13.2, and it is legitimate.
Route two: mechanically complete acceptance. For a narrow class of work, behaviour can be verified deterministically — a pure refactor checked against a strong existing test suite, a mechanical migration with an equivalence check, a dependency bump verified by the build. Here the acceptance criteria are complete because the requirement is "behave exactly as before", which is machine-checkable in a way that "handle refunds correctly" is not.
Everything else — the ordinary business of building features against under-specified intent — has an honest ceiling of A2. Not because agents are incapable; Chapter 3's enterprise case doubled throughput at essentially A2. Because the control that would license A3 does not exist yet.
And this is where the market and the evidence diverge sharply. Tooling is sold on the promise of autonomous agents that complete work while you sleep. For near-zero-blast-radius and mechanically-verifiable work, that promise is real today. For feature work against stated intent, it is a promise about a control nobody has built. Chapter 21 will name the organisational version of believing it anyway.
13.7 What A4 is available for today
The good news, and it is better than it first appears.
Route one and route two above are not marginal. Sort the work in a typical repository by blast radius and mechanical verifiability, and a substantial band qualifies:
- Dependency updates verified by the build and test suite
- Dead-code removal, verified by reference analysis (Chapter 9's graph makes this safe)
- Formatting, linting, and mechanical style conformance
- Test-coverage backfill for existing behaviour
- Documentation regenerated from code
- Mechanical migrations with equivalence checks
- Drift detection and reporting — and this is the interesting one
Look at that list against Chapter 4 and Chapter 12 and something clicks.
Chapter 4 argued that delegation removed a homeostat — the feeling-driven correction that kept complexity bounded — and that the remedy is a sensor with a standing mandate, which nothing triggers and which therefore belongs to nobody's task list. Chapter 12 §12.7 then argued that the outer loop's sensing half must run at machine speed, because a monthly retrospective cannot regulate a machine-paced inner loop.
Both of those requirements describe an agent running unprompted on near-zero-blast-radius work with mechanically checkable success criteria. Which is to say:
A4 is available today for precisely the work the outer loop needs done. The janitorial band that qualifies for full autonomy is the same band that Chapter 12 said must be mechanised. OpenAI's reported "garbage collection" scans and Thoughtworks' "janitor army" are A4 deployments, and they are the highest-value use of the top of this ladder currently available [D].
This is not a consolation prize. It resolves a genuine organisational problem: the outer loop's work has no owner because nothing triggers it and it never competes successfully for human attention against feature delivery. Staffing it with A4 agents is the only realistic answer, and the blast radius is low enough that the ladder permits it.
13.8 The barbell, and where it fails
Taleb's barbell strategy is the recommendation to avoid medium risk entirely: hold most of your position in maximum safety and a small remainder in maximally convex bets, rather than spreading everything across a middle whose downside you cannot estimate. In fat-tailed domains it dominates naive diversification.
The temptation is to transfer it directly — put the critical decile at A0/A1, the throwaway band at A4, and avoid the mushy A2 middle. I flagged this early in the book's development as an original contribution, and testing it properly shows the transfer is partial. It is worth being precise about which half survives.
What transfers. The objection to uniformity. A single organisational autonomy level is exactly the naive-diversification error: it spreads the same medium exposure across work whose blast radii differ by orders of magnitude. And both extremes are correct where they apply — the critical decile belongs at maximum protection regardless of convenience, and the throwaway band belongs at maximum autonomy because its downside is capped by construction and its upside includes both throughput and the outer-loop work of §13.7.
What does not transfer. The claim that the middle is worthless. In Taleb's setting, medium-risk positions carry unbounded downside without proportional upside, so avoiding them is free. That is not true here: A2 is where the work is, and Chapter 3's enterprise case measured 2.09× per-capita throughput at essentially A2 [B]. The middle has real, large, measured upside.
So the honest diagnosis of A2 is different from the barbell's, and sharper:
A2 is not the riskiest level. It is the level whose risk is most misestimated, because its safety rests entirely on the gate Chapter 5 showed had collapsed. A2 says "the human reviews the diff." Chapter 5 showed that a diff's existence no longer evidences care, and Chapter 3 measured reviewers absorbing double the load while batch sizes grew by roughly a third. Everyone believes review is happening.
Which yields a prescription the barbell would not have produced: do not avoid A2 — re-found it. A2's safety must rest on controls rather than on the assumption of genuine review. Concretely, a re-founded A2 has H2 and H4 from §13.5 scored at 2: a held-out acceptance set the agent cannot see, and blocking sensors inside the edit cycle. Then "the human reviews the diff" becomes review by exception on the judgment residue, which is Chapter 12's Verify phase as written and a thing a human can actually do at volume.
13.9 Autonomy creep, and the artefact that stops it
Chapter 21 catalogues Autonomy Creep — permission scope expanding by convenience rather than by decision. The mechanism is worth stating here because the remedy belongs to this chapter.
Creep does not happen in one step. It happens because each individual expansion is small, plausible, and made under delivery pressure by whoever is blocked. This one time, let it merge without the integration suite — the pipeline is slow and the change is trivial. Nobody decides to move from A2 to A3. The boundary is simply never enforced, and after enough exceptions the exception is the configuration.
Two defences, both consequences of earlier chapters.
Enforce by capability (§13.3). An expansion that requires granting a permission is an event with a record. An expansion that requires only ignoring an instruction leaves no trace. This is the whole argument for Figure 13.1's revocation column, and it converts creep from a cultural drift into an auditable change.
Make the level a policy artefact with an owner and a review date. Chapter 11 §11.9 argued accountability follows the autonomy decision; that requires the decision to exist as a document. Appendix C provides the template; the minimum content is: the class of work, the level, the harnessability and blast-radius scores that justified it, the named owner, the review date, and the conditions that would force a downgrade.
That last field is the one everyone omits and the one that matters. A level granted with no stated conditions for revocation will never be revoked, because after an incident the conversation is about the incident rather than about whether the grant was sound. Write the downgrade trigger while you are calm.
And drills apply here too, exactly as Chapter 8 prescribed. The question "is this agent actually operating at the level we think?" is answerable only by attempting to exceed it. Ask an A2 agent to merge. If it can, it is not at A2, whatever the policy says.
13.10 What this hands to Chapter 14
The ladder produces three quantities that a lifecycle needs and that nobody currently measures.
Autonomy mix — the distribution of merged work across A0–A4. Chapter 14 makes this a first-class metric, because it is the only number that shows whether delegation is actually happening or whether an organisation has bought agents and kept its old process.
Harnessability scores over time — §13.5's instrument, re-run. Rising harnessability is the leading indicator that the ceiling is lifting; it moves before throughput does.
Ceiling violations — work that ran above its ceiling. This is Chapter 12's fifth prohibition made countable, and it is the closest thing to a safety metric this book offers.
Chapter 14 also inherits the harder problem this chapter has exposed. Everything above depends on knowing the blast radius of a change before it is made, which is a classification problem nobody has automated. Today the scoring is a conversation. It should be a query against Chapter 9's graph — does this change path reach a credential, mutate production data, or cross a bounded context? — and that is a buildable thing that does not exist.
Autonomy is a ceiling set by harnessability × blast radius, implemented as capabilities the agent does not hold — and because the behaviour harness remains unsolved, the honest ceiling for ordinary feature work is a re-founded A2, while the top of the ladder is available today only for the near-zero-blast-radius work that the outer loop needs done anyway.
- Can blast radius be computed? §13.10's query is the highest-value missing tool in Part III: reachability of secrets, production data mutation, fan-in, and context-crossing are all graph questions, and answering them automatically would turn a conversation into a gate.
- Are the weights in §13.5 right? They are judgment. H2 and H4 are weighted equally with H1 and H3, and I suspect the acceptance set and blocking sensors matter more than the rest combined. Somebody with incident data could fit this properly.
- Does the ceiling matrix survive contact with incidents? Figure 13.2 is derived from argument, not from outcome data. The test is whether organisations that operated above their computed ceiling had more incidents — checkable retrospectively by anyone with both a policy and an incident log.
- What is the right size of the convex end? §13.8 suggests 20–30% of work qualifies for A4 today. That figure is an estimate from the categories in §13.7, not a measurement, and it will vary enormously by codebase.
- Does a re-founded A2 actually restore review? The claim is that a held-out acceptance set plus blocking sensors turns full review into review-by-exception. Whether reviewers' effective scrutiny recovers, or whether they simply trust the sensors and skim anyway, is an empirical question about human behaviour that Chapter 19 is better placed to worry about.
- Böckeler, Birgitta. Harness engineering for coding agent users [D] ✅ — harnessability; the behaviour harness as "the elephant in the room"; "puts a lot of faith into the AI-generated tests, that's not good enough yet"; and the criterion this chapter turns on — good behavioural harnesses are what would "increase our confidence enough to reduce supervision and manual testing" (§13.6)
- Galster, Mohsenimofidi, Lulla, Abubakar, Treude, Baltes. arXiv 2602.14690, AIware '26 [A] ✅ — Hooks adopted in 0.9%–3.2% of repositories, the basis for expecting most teams to score 0 on H4 (§13.5)
- He, Agarwal, Denisov-Blanch, Azaletskiy, Koyejo, Vasilescu. arXiv 2607.01904 [B] ✅ — 2.09× per-capita throughput at essentially A2; per-reviewer load doubling; PR size +37% (§13.8)
- OWASP, Top 10 for Agentic Applications (2026) [C] ✅ and CVE-2026-22708 [C] ✅ — the belief-versus-capability distinction and the name-versus-effect refinement applied to level enforcement (§13.3)
- Farrag, Sabry E. arXiv 2605.01160v1 [B] ✅ — the orthogonal specification-strength axis established in Ch 12 §12.11; a level is only safe to the extent specification strength has kept pace
- Parnas (1972) ✅ canonical; Evans, Domain-Driven Design ✅ canonical — bounded contexts as the basis for B6 (§13.5)
- Ashby ✅ canonical — autonomy as variety reduction by scope of authority (§13.1)
- OpenAI's published harness account [D] 🔴 and Thoughtworks' "janitor army" [D] 🟡 — read here as A4 deployments (§13.7). Retrieve the OpenAI primary for Ch 25
- Ford, Parsons, Kua ✅ canonical — fitness functions as the enforcement mechanism behind H3
- Taleb — the barbell strategy (§13.8, with the failure of the analogy stated), Extremistan and the dominance of the unestimable tail term (§13.4), via negativa (§13.3)
Full entries and verification status: references/sources.md.