article thumbnail

Fundamentals of Data Engineering

Xebia

The following is a review of the book Fundamentals of Data Engineering by Joe Reis and Matt Housley, published by O’Reilly in June of 2022, and some takeaway lessons. This book is as good for a project manager or any other non-technical role as it is for a computer science student or a data engineer.

article thumbnail

ChatGPT: le nuove sfide della strategia sui dati nell’era dell’IA generativa

CIO

“Le azioni successive per il miglioramento della data quality possono essere sia di processo che applicative e includono la definizione di un modello organizzativo intorno alla data governance , assegnando ruoli e compiti chiari alle varie figure coinvolte (data scientist, data engineering, data owner, data steward, eccetera)”.

ChatGPT 130
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Assessing progress in automation technologies

O'Reilly Media - Ideas

In 2015, LinkedIn ran a study and found that the U.S. had a national surplus of people with data science skills. These startups are using tools like cryptography, blockchains, and secure communication to build data networks that enable organizations to share data securely. is extremely high.

article thumbnail

Rethinking the IT talent pipeline

CIO

Amanda Merola had zero technical background when she came to The Hartford in 2015, despite a natural interest in computers and a proclivity for problem-solving. There is a persona-based training curriculum to upskill staffers in modern engineering-oriented IT practices and a mandate for all managers become cloud certified.

article thumbnail

Doing Business in a Big Data World

Strategy Driven

Whatever method your organization chooses, it will place a significant strain on your – probably already overwhelmed – central IT department, because they will need to construct a complimentary architecture with these two very different platforms. Copyright 2007-2015 by StrategyDriven Enterprises, LLC. Consider leaving a comment!

article thumbnail

The Good and the Bad of Apache Airflow Pipeline Orchestration

Altexsoft

You can hardly compare data engineering toil with something as easy as breathing or as fast as the wind. The platform went live in 2015 at Airbnb, the biggest home-sharing and vacation rental site, as an orchestrator for increasingly complex data pipelines. How data engineering works. Airflow architecture.

article thumbnail

Technology Trends for 2024

O'Reilly Media - Ideas

While we like to talk about how fast technology moves, internet time, and all that, in reality the last major new idea in software architecture was microservices, which dates to roughly 2015. Who wants to learn about design patterns or software architecture when some AI application may eventually do your high-level design?

Trends 115