LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. But if you have a log line that emits both the request_path and the error_code , and a tool that lets you break down and group by arbitrary dimensions, this would be extremely easy to answer.
Let's personalize your content