WRITING
Blog
Caching for AI Agents: What Prompt, Semantic and Plan Caching Actually Save, and Where They Stop.
Prompt caching, semantic caching, and plan caching each save a slice of an agent run. A Compiled Agent Model reuses the repeat, and falls back to your current model when the task is new.
Why Do AI Agents Cost So Much on Repeat Tasks?
Repeat tasks stay expensive because the agent re-thinks the plan on every run. A Compiled Agent Model learns the task once and reuses it.
Decision Models vs Compiled Agent Models: Which Cuts Agent Run Costs?
Decision models for AI agents make the small typed calls inside a step. A Compiled Agent Model reuses a whole solved task on repeat runs.
Don't Forget What Worked: Why I'm Building Compiled Agent Models
Compiled Agent Models: your agent's repeat work, up to 100x cheaper and up to 10x faster.