Machine learning model serving architectures
Xebia
APRIL 2, 2024
Selecting the right architectural serving pattern is paramount in creating the most business value from your model. In this blog we will discuss the most common serving architectures 1 ; batch predicting, on-demand synchronous serving and streaming serving. Glossary Throughout this post some definitions will recur.
Let's personalize your content