article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

A Talented Team, Innovative Technology, and The Opportunity to Grow. There Is No Place Like Cloudera

Cloudera

Coupled with amazing technology was an amazing team that only grew and improved with the merger with Cloudera. The grass isn’t always greener While the opportunity was exciting, I realized that I missed the old team, the open-source environment, innovative projects, and Cloudera overall. I found Apache NiFi especially interesting.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

IT leaders rethink talent strategies to cope with AI skills crunch

CIO

For example, Napoli needs conventional data wrangling, data engineering, and data governance skills, as well as IT pros versed in newer tools and techniques such as vector databases, large language models (LLMs), and prompt engineering. Meanwhile, 54% of respondents said skills shortages hamper change.

article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. The post Cloudera Data Engineering 2021 Year End Review appeared first on Cloudera Blog.

article thumbnail

Data Engineers of Netflix?—?Interview with Pallavi Phadnis

Netflix Tech

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer at Netflix.

article thumbnail

What is a data architect? Skills, salaries, and how to become a data framework master

CIO

Data architect role Data architects are senior visionaries who translate business requirements into technology requirements and define data standards and principles, often in support of data or digital transformations. Data architect vs. data engineer The data architect and data engineer roles are closely related.

Data 328
article thumbnail

Enhancing the Business Strategy with Data Engineering Solutions

Trigent

To do this, they are constantly looking to partner with experts who can guide them on what to do with that data. This is where data engineering services providers come into play. Data engineering consulting is an inclusive term that encompasses multiple processes and business functions.