LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. LLMs are their own beast Unit testing involves asserting predictable outputs for defined inputs, but this obviously cannot be done with LLMs. With LLMs, you might not. Sound at all familiar?
Let's personalize your content