article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

NJ Transit creates ‘data engine’ to fuel transformation

CIO

Collectively, the agencies also have pilots up and running to test electric buses and IoT sensors scattered throughout the transportation system. Data engine on wheels’. To mine more data out of a dated infrastructure, Fazal first had to modernize NJ Transit’s stack from the ground up to be geared for business benefit.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Porsche Carrera Cup Brasil gets real-time data boost

CIO

In the past, to get at the data, engineers had to plug a USB stick into the car after a race, download the data, and upload it to Dropbox where the core engineering team could then access and analyze it. If I don’t do predictive maintenance, if I have to do corrective maintenance at events, a lot of money is wasted.”

Data 313
article thumbnail

The 10 highest-paying industries for IT talent

CIO

There’s a demand for skills such as cybersecurity, cloud, IT project management, UX/UI design, change management, and business analysis. There’s a high demand for software engineers, data engineers, business analysts and data scientists, as finance companies move to build in-house tools and services for customers.

Industry 306
article thumbnail

7 data trends on our radar

O'Reilly Media - Ideas

The demand for data skills (“the sexiest job of the 21st century”) hasn’t dissipated. LinkedIn recently found that demand for data scientists in the US is “off the charts,” and our survey indicated that the demand for data scientists and data engineers is strong not just in the US but globally.

Trends 89
article thumbnail

DataOps and Hitachi Vantara

Hu's Place - HitachiVantara

Few if any data management frameworks are business focused, to not only promote efficient use of data and allocation of resources, but also to curate the data to understand the meaning of the data as well as the technologies that are applied to the data so that data engineers can move and transform the essential data that data consumers need.

article thumbnail

Machine Learning with Python, Jupyter, KSQL and TensorFlow

Confluent

This blog post focuses on how the Kafka ecosystem can help solve the impedance mismatch between data scientists, data engineers and production engineers. Impedance mismatch between data scientists, data engineers and production engineers. For now, we’ll focus on Kafka.