Search my portfolio

Search cases, decisions, results and experience.

Agentic Delivery Notes

Too Many Agents, Too Little Delivery

Why an AI organization chart is not an operating model.

Agent count can increase faster than accepted output. This field note explains how to recognize the failure and redesign the workflow around the smallest accountable team.

Published 4 min read763 words
  • Agentic delivery
  • Product operations
  • Program management
  • AI governance
OBSERVED

My initial mistake was treating AI agents like a digital organization chart.

A reflection from my delivery work.

Central thesis

More agents do not automatically create more delivery capacity. They also create coordination, context, handoff, review, authority, and verification costs.

PROPOSAL

The argument in one view

A clearer path from role-first structure to accepted output.

The operating model I now use to keep agent-assisted work accountable to delivery.

  1. 01Define the deliverable

    Start with the result a person or downstream system must be able to inspect and use.

  2. 02Add defensible boundaries

    Separate work only for a distinct capability, context, permission or evaluation need.

  3. 03Keep synthesis accountable

    Give one owner responsibility for resolving conflicts and assembling the result.

  4. 04Test accepted output

    Measure whether the final artifact passes its acceptance test, not how many roles were active.

What must get stronger as the team growsAdditional agent boundaries are useful when they strengthen the path from distinct input to an accepted result.
  1. Distinct inputCapability or constraint

    A specialist adds something the orchestrator cannot reliably supply alone.

  2. Accountable synthesisOne integrated deliverable

    An owner resolves conflicts and assembles the work into a coherent result.

  3. Explicit acceptanceTested and owned

    The result passes a defined check and reaches a named decision owner.

More roles are not the outcome. A stronger acceptance chain is.

INFERENCE

Failure signals

Diagnose the delivery system, not the agent count

An agent count alone cannot diagnose a workflow. A four-agent system with clean boundaries may outperform one overloaded orchestrator; a two-agent system can still loop indefinitely. The useful evidence is behavioral. Look for the relationship between coordination work and accepted output.

  • 01More plans exist than completed artifacts.
  • 02The same context is repeatedly restated or rediscovered.
  • 03Reviews begin before a reviewable artifact exists.
  • 04Recommendations conflict without one accountable synthesizer.
INFERENCE

Root cause

The operating model was defined in the wrong order

  1. 01

    Outcome defined after roles

    The roster was designed before the accepted result and intended user were explicit.

  2. 02

    Handoffs defined before contracts

    Responsibilities sounded distinct, but required inputs, outputs, and formats were not.

  3. 03

    Reviews defined before acceptance

    Reviewers were added before the system defined what passing, revising, blocking, or abstaining meant.

PROPOSAL

From a role-first hierarchy to an outcome-first delivery path

The before model adds layers between the owner and acceptance. The after model gives one orchestrator the synthesis path, adds specialists only at a defensible boundary, and ends with an explicit verification decision.

Before · role-first topology

More coordination layers, no accountable path to acceptance.

OwnerExecutive agents
  • Specialist agents
  • Reviewers
  • Governance reviews
More statusUnresolved acceptance

After · outcome-first topology

One accountable route from constraints to a terminal decision.

  1. Human outcome + constraints
  2. Accountable orchestrator
  3. Bounded specialist when justified
  4. Artifact
  5. Verifier
  6. Accept · revise · block · abstain
PROPOSAL

Decision tree

Do you need another agent?

Follow the “yes” path downward. A “no” answer identifies the work to do before adding another agent.

No new agent without a distinct boundary, an output contract, an acceptance test, and an accountable synthesizer.
  1. 01Is there a concrete deliverable and acceptance test?
    YesContinue to the next question
    No

    Define the result and how it will be accepted before designing roles.

  2. 02Does the work cross a distinct capability, context, permission, execution, or evaluation boundary?
    YesContinue to the next question
    No

    Keep the work with the accountable orchestrator.

  3. 03Can the boundary have an explicit input, output, authority, and verification contract?
    YesContinue to the next question
    No

    Clarify the contract before adding another worker.

  4. 04Will the boundary improve accepted delivery enough to justify coordination and verification cost?
    YesContinue to the bounded-agent decision
    No

    Prototype or measure the bottleneck before making the role permanent.

YesAdd a bounded specialist. Give it a clear contract, one accountable synthesizer, an explicit verifier, and a named decision owner to accept the result.

PROPOSAL

Measurement

Measure delivery outcomes, not agent activity

Agent count, run count, token volume, generated documents, reviews, and status updates can describe system activity. Used alone, they cannot tell you whether the requested result became usable. A workflow can generate ten documents and still leave the owner without one decision-ready artifact.

Context only

Weak when used alone

  • Number of agents
  • Number of runs
  • Token volume

Outcome oriented

Measure the path to acceptance

Accepted deliverables per week
Counts results that passed the defined acceptance test and are usable.
Median request-to-acceptance time
Measures the full delivery path, including handoffs and rework.
First-pass acceptance rate
Shows whether framing, execution, and validation align before revision.
Methods, limitations and evidence boundary

I wrote this note from my delivery experience. It offers a diagnosis to test: compare accepted output and coordination cost before changing the team’s structure.

Methods, limitations and evidence boundary

I wrote this note from my delivery experience. It offers a diagnosis to test: compare accepted output and coordination cost before changing the team’s structure.

Start with the deliverable, the accountable owner, and the acceptance test. Add another agent only after the work proves that a real boundary exists.

Before creating another agent, remove every role name from the workflow diagram. Label each box only with its required input, output, authority, and acceptance test. Any box that cannot be described that way is not yet a justified agent.
EXTERNAL EVIDENCE

Primary sources used

Continue the story

Choosing the roles leads to the capacity question.

Once each role has a useful contribution, I still need to decide where the next unit of effort belongs. The companion essay examines how that constraint moves between building, review and decision-making.

Read The Bottleneck Moves See the roles in the delivery model Discuss a role
Sources and measurement

Decision test

PROPOSAL Decision tree Do you need another agent? Follow the “yes” path downward. A “no” answer identifies the work to do before adding another agent. No new agent without a distinct boundary, an output contract, an acceptance test, and an accountable synthesizer. 01 Is there a concrete deliverable and acceptance test? Yes Continue to the next question ↓ No Define the result and how it will be accepted before designing roles. 02 Does the work cross a distinct capability, context, permission, execution, or evaluation boundary? Yes Continue to the next question ↓ No Keep the work with the accountable orchestrator. 03 Can the boundary have an explicit input, output, authority, and verification contract? Yes Continue to the next question ↓ No Clarify the contract before adding another worker. 04 Will the boundary improve accepted delivery enough to justify coordination and verification cost? Yes Continue to the bounded-agent decision ↓ No Prototype or measure the bottleneck before making the role permanent. Yes Add a bounded specialist. Give it a clear contract, one accountable synthesizer, an explicit verifier, and a named decision owner to accept the result.

PROPOSAL

No new agent without a distinct boundary, an output contract, an acceptance test, and an accountable synthesizer.

Is there a concrete deliverable and acceptance test?

Does the work cross a distinct capability, context, permission, execution, or evaluation boundary?

Evidence boundary

Methods, limitations and evidence boundary This field note starts with an author-reported learning, not independently reproduced delivery evidence or proof of a universal ideal agent count. No run logs, incident-level observations, or measured before-and-after outcomes are presented here. The diagnostic pattern and proposed correction remain hypotheses to evaluate; they do not establish that a small topology will outperform every multi-agent system.

Measurement

Accepted deliverables per week Counts results that passed the defined acceptance test and are usable. Median request-to-acceptance time Measures the full delivery path, including handoffs and rework. First-pass acceptance rate Shows whether framing, execution, and validation align before revision.

Failure signal

INFERENCE

An agent count alone cannot diagnose a workflow.

01 More plans exist than completed artifacts. 02 The same context is repeatedly restated or rediscovered. 03 Reviews begin before a reviewable artifact exists. 04 Recommendations conflict without one accountable synthesizer.