article thumbnail

Data Engineers of Netflix?—?Interview with Pallavi Phadnis

Netflix Tech

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix.

article thumbnail

Unlocking the Power of AI with a Real-Time Data Strategy

CIO

Cloud-native apps, microservices and mobile apps drive revenue with their real-time customer interactions. It’s clear how these real-time data sources generate data streams that need new data and ML models for accurate decisions. report they have established a data culture 26.5%

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Supporting Diverse ML Systems at Netflix

Netflix Tech

Since then, open-source Metaflow has gained support for Argo Workflows , a Kubernetes-native orchestrator, as well as support for Airflow which is still widely used by data engineering teams. Internally, we use a production workflow orchestrator called Maestro. Metaflow Hosting caches the response, so Amber can fetch it after a while.

System 90
article thumbnail

Microservices Adoption in 2020

O'Reilly Media - Ideas

Microservices seem to be everywhere. Scratch that: talk about microservices seems to be everywhere. So we wanted to determine to what extent, and how, O’Reilly subscribers are empirically using microservices. Here’s a summary of our key findings: Most adopters are successful with microservices. It’s the culture.

article thumbnail

From OOP to FP by Joaquin Azcarate – backend developer at Apiumhub in Software Crafters Barcelona

Apiumhub

Data Engineering: Building your BI infrastructure from scratch by Estefania Rabadan Martinez – Data Engineer Lead at Hotjar. Most of us have heard of Trunk Based Development, Continuous Deployment and Microservices. Maybe even convinced our stakeholders it was time to put them into practice.

article thumbnail

AI Chihuahua! Part I: Why Machine Learning is Dogged by Failure and Delays

d2iq

Components that are unique to data engineering and machine learning (red) surround the model, with more common elements (gray) in support of the entire infrastructure on the periphery. Before you can build a model, you need to ingest and verify data, after which you can extract features that power the model.

article thumbnail

Article: InfoQ 2020 Recap, Editor Recommendations, and Best Content of the Year

InfoQ Culture Methods

As 2020 is coming to an end, we created this article listing some of the best posts published this year. This collection was hand-picked by nine InfoQ Editors recommending the greatest posts in their domain. It's a great piece to make sure you don't miss out on some of the InfoQ's best content.