article thumbnail

Supporting Diverse ML Systems at Netflix

Netflix Tech

In addition to Spark, we want to support last-mile data processing in Python, addressing use cases such as feature transformations, batch inference, and training. Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance. Internally, we use a production workflow orchestrator called Maestro.

System 90
article thumbnail

Building a Scalable Search Architecture

Confluent

Software projects of all sizes and complexities have a common challenge: building a scalable solution for search. For this reason and others as well, many projects start using their database for everything, and over time they might move to a search engine like Elasticsearch or Solr. You might be wondering, is this a good solution?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Netflix at AWS re:Invent 2019

Netflix Tech

1pm-2pm NFX 207 Benchmarking stateful services in the cloud Vinay Chella , Data Platform Engineering Manager Abstract : AWS cloud services make it possible to achieve millions of operations per second in a scalable fashion across multiple regions.

AWS 40
article thumbnail

Netflix at AWS re:Invent 2019

Netflix Tech

1pm-2pm NFX 207 Benchmarking stateful services in the cloud Vinay Chella , Data Platform Engineering Manager Abstract : AWS cloud services make it possible to achieve millions of operations per second in a scalable fashion across multiple regions.

AWS 40
article thumbnail

How Retailers Use Artificial Intelligence to Innovate Customer Experience and Enhance Operations

Altexsoft

Experts from such companies as Lucidworks, Advantech, KAPUA, MindsDB, Fellow Robots, KaizenTek, Aware Corporation, XR Web, and fashion brands Hockerty and Sumissura joined the discussion. X-Mart visitors can choose from a wide range of items, including beauty products and fast-moving consumer goods, as well as fashion and apparel.

article thumbnail

Netflix at AWS re:Invent 2019

Netflix Tech

1pm-2pm NFX 207 Benchmarking stateful services in the cloud Vinay Chella , Data Platform Engineering Manager Abstract : AWS cloud services make it possible to achieve millions of operations per second in a scalable fashion across multiple regions.

AWS 15
article thumbnail

Data Product Strategies: How Cloudera Helps Realize and Accelerate Successful Data Product Strategies

Cloudera

The Cloudera Data Platform comprises a number of ‘data experiences’ each delivering a distinct analytical capability using one or more purposely-built Apache open source projects such as Apache Spark for Data Engineering and Apache HBase for Operational Database workloads.