Remove Architecture Remove Blog Remove Data Engineering Remove Fashion
article thumbnail

Modernizing Data Pipelines using Cloudera Data Platform – Part 1

Cloudera

To keep up, data pipelines are being vigorously reshaped with modern tools and techniques. At Cloudera, we recently introduced several cutting-edge innovations in our Cloudera Data Engineering experience (CDE) as part of our Enterprise Data Cloud product — Cloudera Data Platform (CDP) — to serve the growing demands.

Data 93
article thumbnail

Building a Scalable Search Architecture

Confluent

As soon as the number of data points involved in your search feature increases, typically we’ll introduce a broker in between all the involved components. This architectural pattern provides several benefits: Better scalability by allowing multiple data producers and consumers to run in parallel.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Apache Ozone and Dense Data Nodes

Cloudera

Apache Ozone is one of the major innovations introduced in CDP, which provides the next generation storage architecture for Big Data applications, where data blocks are organized in storage containers for larger scale and to handle small objects. Cloudera will publish separate blog posts with results of performance benchmarks.

Data 101
article thumbnail

The Year Ahead for BPM -- 2019 Predictions from Top Influencers

BPM

Now we’re seeing AI dominating the conversations (without a lot of actual adoption in the early majority), and RPA creating a lot of buzz, though companies adopting it are starting to realize that scaling an RPA based automation architecture is flawed by design. This requires a new architecture capable of true scale and speed.

article thumbnail

Data Product Strategies: How Cloudera Helps Realize and Accelerate Successful Data Product Strategies

Cloudera

The Cloudera Data Platform comprises a number of ‘data experiences’ each delivering a distinct analytical capability using one or more purposely-built Apache open source projects such as Apache Spark for Data Engineering and Apache HBase for Operational Database workloads.

article thumbnail

Building an effective data approach in a hybrid cloud world – part 2

Cloudera

In the last blog with Deloitte’s Marc Beierschoder, we talked about what the hybrid cloud is, why it can benefit a business and what the key blockers often are in implementation. As mentioned in the first blog with my colleague Marc, these teams will need to be upskilled in the latest trends to deliver innovative solutions to the business.

Cloud 81
article thumbnail

Incremental Processing using Netflix Maestro and Apache Iceberg

Netflix Tech

It also improves the engineering productivity by simplifying the existing pipelines and unlocking the new patterns. In this blog post, we talk about the landscape and the challenges in workflows at Netflix. Users configure the workflow to read the data in a window (e.g. data arrives too late to be useful).

Windows 84