article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

What is a data architect? Skills, salaries, and how to become a data framework master

CIO

Data architect role Data architects are senior visionaries who translate business requirements into technology requirements and define data standards and principles, often in support of data or digital transformations. Data architect vs. data engineer The data architect and data engineer roles are closely related.

Data 324
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Make the leap to Hybrid with Cloudera Data Engineering

Cloudera

When we introduced Cloudera Data Engineering (CDE) in the Public Cloud in 2020 it was a culmination of many years of working alongside companies as they deployed Apache Spark based ETL workloads at scale. We are paving the path for our enterprise customers that are adapting to the critical shifts in technology and expectations.

article thumbnail

Healthcare organizations must create a strong data foundation to fully benefit from generative AI

CIO

However, the effort to build, train, and evaluate this modeling is only a small fraction of what is needed to reap the vast benefits of generative AI technology. Key elements of this foundation are data strategy, data governance, and data engineering. Consider the iceberg analogy.

article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. The post Cloudera Data Engineering 2021 Year End Review appeared first on Cloudera Blog.

article thumbnail

Technology Trends for 2024

O'Reilly Media - Ideas

While we like to talk about how fast technology moves, internet time, and all that, in reality the last major new idea in software architecture was microservices, which dates to roughly 2015. We’re skeptical about things like job displacement, at least in technology. This has been a strange year. What will those changes be?

Trends 114
article thumbnail

Accelerate Your Data Mesh in the Cloud with Cloudera Data Engineering and Modak NabuTM

Cloudera

Modak, a leading provider of modern data engineering solutions, is now a certified solution partner with Cloudera. Customers can now seamlessly automate migration to Cloudera’s Hybrid Data Platform — Cloudera Data Platform (CDP) to dynamically auto-scale cloud services with Cloudera Data Engineering (CDE) integration with Modak Nabu.