All modules
MODULE 11 · LLM FEATURES THAT AREN'T A TOY
AI features
Only if it's core. Never as decoration.
An LLM feature is a real module: typed prompts kept in the repo, structured outputs, a cost ceiling, and a fallback for when the model is down or wrong. If the product works without it, ship without it first.
WHEN YOU NEED IT
Any tier — but only when the AI feature is the product, not a garnish.
THE CHOICE, PER TIER
- T1One endpoint, one prompt file, hard monthly budget
- T3+ evals, caching, and per-user limits
SAY THIS TO YOUR AGENT
"Add one AI endpoint. Prompts live in the repo as files, outputs are validated against a schema, cost per request is logged, and there's a monthly spend cap."
DONE WHEN
- Prompts are versioned files, not inline strings
- Bad model output degrades gracefully
- You know exactly what it costs per user