Latest issue
Your Dashboards Are Green. Your AI Is Producing Garbage.
4/28/2026
There's a specific kind of production incident that doesn't look like an incident. No pages fire. No error budgets burn. The status page stays green. But somewhere in the last six weeks, your AI feature quietly got worse — and you're finding out because a user complained, or beca…
Recent posts
Here's the uncomfortable starting point: most teams shipping RAG systems have no idea what their retrieval quality actually is. They ship, collect vague user feedback, and assume t…
Your demo worked. The retrieval looked clean, the answers were coherent, and you shipped it. Then real users showed up with real questions, and the support tickets started. Wrong a…
Most teams discover they have a prompt regression problem the same way: a model provider quietly ships an update, outputs start drifting, and someone notices in a support ticket th…
Most teams budget for LLM costs by pulling up a pricing page and multiplying tokens by rate. That math isn't wrong — it's just incomplete by a factor of three or four, depending on…
There's a moment every team hits, usually around week three of a new model rollout, when someone pulls up the eval dashboard and says some version of: "But it scored higher on the…
A team ships a customer support bot with 94% accuracy on their internal test suite. Two weeks into production, escalations are up 40%. The model is fluent, latency is fine, HTTP 20…