LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Many software engineers are encountering LLMs for the very first time, while many ML engineers are being exposed directly to production systems for the very first time. Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. Latency is often unpredictable.
Let's personalize your content