Monitoring AI Agents in Production: What to Watch
Agent observability has to start at the task layer. Latency, uptime, error rate, CPU, memory, request count. I watch those too, but they don't tell me whether an agent completed useful work.
An agent can return 200s all day and still fail the job. A content agent like Quill can write a draft, call the right tools, and mark the task completed. Then the tool trace shows bloated context, the human reviewer rejects an invented customer example, and the task stays review-blocked instead of released. The run succeeded. The work did not.