Remove Compliance Remove Data Engineering Remove Storage Remove Technology
article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

Cloudera Data Engineering 2021 Year End Review

Cloudera

Since the release of Cloudera Data Engineering (CDE) more than a year ago , our number one goal was operationalizing Spark pipelines at scale with first class tooling designed to streamline automation and observability. Securing and scaling storage.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Technology Trends for 2024

O'Reilly Media - Ideas

While we like to talk about how fast technology moves, internet time, and all that, in reality the last major new idea in software architecture was microservices, which dates to roughly 2015. We’re skeptical about things like job displacement, at least in technology. This has been a strange year. What will those changes be?

Trends 116
article thumbnail

Accelerate Your Data Mesh in the Cloud with Cloudera Data Engineering and Modak NabuTM

Cloudera

Modak, a leading provider of modern data engineering solutions, is now a certified solution partner with Cloudera. Customers can now seamlessly automate migration to Cloudera’s Hybrid Data Platform — Cloudera Data Platform (CDP) to dynamically auto-scale cloud services with Cloudera Data Engineering (CDE) integration with Modak Nabu.

article thumbnail

2018: A Year in Review for Storage Systems.

Hu's Place - HitachiVantara

This new company will unify the operations of these three companies into a single integrated business as Hitachi Vantara to capitalize on Hitachi’s social innovation capability in both operational technologies (OT) and information technologies (IT). A REST API is built directly into our VSP storage controllers.

article thumbnail

Simplifying machine learning lifecycle management

O'Reilly Media - Data

Today’s data science and data engineering teams work with a variety of machine learning libraries, data ingestion, and data storage technologies. Risk and compliance considerations mean that the ability to reproduce machine learning workflows is essential to meet audits in certain application domains.

article thumbnail

Technology Trends for 2022

O'Reilly Media - Ideas

Last year we cautioned against a “horse race” view of technology. While new technologies may appear on the scene suddenly, the long, slow process of making things that work rarely attracts as much attention. Important signals often appear in technologies that have been fairly stable. This report is about those transitions.

Trends 110