LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. LLMs are their own beast Unit testing involves asserting predictable outputs for defined inputs, but this obviously cannot be done with LLMs. You can’t really write unit tests for this (nor practice TDD).
Let's personalize your content