LLMs Demand Observability-Driven Development
Honeycomb
SEPTEMBER 20, 2023
Some of these things are related to cost/benefit tradeoffs, but most are about weak telemetry, instrumentation, and tooling. Neural nets are also inherently stochastic, because GPU calculations around floating point operations are inherently nondeterministic. You can’t really write unit tests for this (nor practice TDD).
Let's personalize your content