Browsing: Production

Across 157 enterprises, organizations are granting AI agents more autonomy while trusting the evaluations meant to gate that autonomy less. Half have already shipped an agent…

then you’ve already been through this situation when it looks like your RAG system is working fine but it is still wrong. The retrieval fetches some…

III of Enterprise Document Intelligence, a series that builds an enterprise RAG system from four bricks: document parsing, question parsing, retrieval, and generation. It is the…

I of this series with Angela Shi. This pitfalls article lists the failure modes we both kept seeing on production RAG systems, and that pushed us…

agent system seriously fail in production, it wasn’t dramatic. There was no crash. No error message. The system just kept running and producing outputs that looked…

TL;DR debugging the same crash, I stopped blaming the model. It was always the same three problems:broken structured outputs, silent validation failures, and pipelines that looked…

any time in enterprise AI over the last two years, you know the pattern. A small team builds a proof-of-concept using a state-of-the-art Large Language Model…

Running AI agents in a local script is straightforward. Running them reliably in production across teams, across restarts, with isolated environments per context is a different…

AI deployment, our client’s compliance officer asked us a question we couldn’t answer. “How do you know your agent isn’t hallucinating patient symptoms?” We had unit…

, we got a complaint from one of our platform engineers of the infrastructure team that our internal knowledge assistant is confidently giving the wrong answers…