article thumbnail

Delivering Modern Enterprise Data Engineering with Cloudera Data Engineering on Azure

Cloudera

After the launch of CDP Data Engineering (CDE) on AWS a few months ago, we are thrilled to announce that CDE, the only cloud-native service purpose built for enterprise data engineers, is now available on Microsoft Azure. . Prerequisites for deploying CDP Data Engineering on Azure can be found here.

article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. A new capability called Ranger Authorization Service (RAZ) provides fine grained authorization on cloud storage.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

GoDataFest 2022: Google Cloud Data Platform Workshop

Xebia

This blog explores the various sessions throughout those 3 days but specifically focuses on the Cloud Data Platform workshop on Friday the 28th. . GoDataFest features a multitude of sessions focused on various data technologies and platforms. What is the Google Cloud Data Platform Workshop?

article thumbnail

Snowflake Best Practices for Data Engineering

Perficient

Introduction: We often end up creating a problem while working on data. So, here are few best practices for data engineering using snowflake: 1.Transform Use it, but don’t use it for normal large data loads. This reduces the effort of scanning large numbers of data files in cloud storage.

article thumbnail

Optimizing Cloudera Data Engineering Autoscaling Performance

Cloudera

The shift to cloud has been accelerating, and with it, a push to modernize data pipelines that fuel key applications. That is why cloud native solutions which take advantage of the capabilities such as disaggregated storage & compute, elasticity, and containerization are more paramount than ever. fixed sized clusters).

article thumbnail

Hire Big Data Engineer: Salaries, Stack and Roles

Mobilunity

Technologies that have expanded Big Data possibilities even further are cloud computing and graph databases. The cloud offers excellent scalability, while graph databases offer the ability to display incredible amounts of data in a way that makes analytics efficient and effective. Who is Big Data Engineer?

article thumbnail

Managing Python dependencies for Spark workloads in Cloudera Data Engineering

Cloudera

Cloudera Data Engineering (CDE) is a cloud-native service purpose-built for enterprise data engineering teams. CDE is already available in CDP Public Cloud (AWS & Azure) and will soon be available in CDP Private Cloud Experiences. Try out Cloudera Data Engineering today!