Data pipeline components are just normal applications
Xebia
JANUARY 3, 2022
A data pipeline component is nothing more than a normal application. Fig1. Example data pipeline: ELT. It goes through the same lifecycle as any other application: the component is developed and tested, an artifact is built and finally it gets deployed. The artifact is then run as part of your data pipeline. During this the application uses normal application development processes like: CI/CD.
Let's personalize your content