LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Namely, that LLMs are black boxes that produce nondeterministic outputs and cannot be debugged or tested using traditional software engineering techniques. Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. It’s important to understand this, and why.
Let's personalize your content