Workflows first, agents when you must
Most jobs that sound like they need an agent are a fixed sequence of model calls with a few branches. Run 20 support tickets through a workflow, an agent and a mix of the two, and compare what each one handles, costs and keeps you waiting for.
“Agent” is the exciting word, so it gets used for everything. Anthropic’s guide to building them draws a useful line between two kinds of system:
- Workflows are “systems where LLMs and tools are orchestrated through predefined code paths”. You decide the steps; the model fills each one in.
- Agents are “systems where LLMs dynamically direct their own processes and tool usage”. The model decides the steps.
Its advice is to start with “the simplest solution possible, and only increasing complexity when needed”, because “agentic systems often trade latency and cost for better task performance”. An agent can handle the unexpected. A workflow is cheaper, faster and does the same thing every time - which is what you want when the job is the same every time.
The common workflow shapes
The same guide names five patterns. In plain terms:
- Prompt chaining - step one’s output becomes step two’s input: draft, then check, then translate.
- Routing - one call sorts the input, and each kind goes to its own handler: refunds here, password resets there.
- Parallelisation - several calls at once: check a reply for tone, facts and policy separately, then combine.
- Orchestrator-workers - one call splits a job into pieces it can’t predict in advance and hands them out.
- Evaluator-optimiser - one call writes, another grades, and they go round until the grade passes.
Only the last two let the model decide much. The first three are ordinary code with model calls in the slots.
- One cheap call reads the ticket and labels it. That is the only judgement the workflow asks the model for.
- Each known kind has its own handler: a fixed prompt and fixed tools. Same steps every time, so cost and time are predictable.
- Whatever the classifier cannot place goes to an agent, which can take as many steps as the odd case needs. Only those tickets pay agent prices.
Try all three
Twenty tickets: order questions, refunds, password resets, and three odd ones that fit none of those. Each design runs over all twenty. Costs use Claude Sonnet 5.5’s list price on 2026-10-30 ($2 per million input tokens, $10 per million output). The token counts per call are illustrative, but their shape is real: a fixed handler costs the same every time, and an agent’s turns get dearer because each one re-reads everything before it.
What the numbers say:
- The fixed workflow handled 17 of 20 for about $0.13, with no ticket taking more than 2 calls. The three odd tickets went to the nearest handler and got confidently wrong answers - the worst kind of failure, because nothing errors.
- The agent handled all 20, but cost about $0.58, over four times as much, and its slowest ticket took 8 calls. Most of that money went on tickets the workflow had already handled correctly.
- The mix handled all 20 for about $0.31. Note what it didn’t fix: its slowest ticket still took 9 calls, the classifier plus the agent. The odd cases are still slow. They’re just the only slow ones.
When an agent is worth it
Before reaching for an agent, ask:
- Can you write the steps down? If yes, write them as code. The model fills in the hard parts of each step.
- What does a wrong step cost? An agent chooses its own actions, so its mistakes are harder to predict. Anthropic recommends “extensive testing in sandboxed environments, along with the appropriate guardrails” - that’s the next lesson.
- How many will you run? The cost difference above is small on 20 tickets. At 50,000 a month it decides whether the project pays for itself.
In Anthropic's definitions, what makes something an agent rather than a workflow?
Workflows can use tools and big models too. The difference is who decides the sequence: your code (workflow) or the model (agent).
Your router has no 'other' category. What happens to a ticket that fits none of the routes?
A classifier with a fixed set of labels always picks one of them. Without a route for 'none of these', odd inputs are silently forced into the wrong box. Add an 'other' route and send it somewhere that can cope - a person or an agent.
Why does an agent's cost grow faster than the number of its steps?
Every model call is sent the full transcript. Step ten reads everything steps one to nine produced. A workflow's fixed handlers each read only what they need.
Sources
Missions and quizzes above earn their own XP. This marks the lesson done.