Abhishek Tiwari

JULY 12, 2018

In this post, we will discuss why you should avoid building data pipelines in first place. Depending on the use cases, it is quite possible that you can achieve similar outcomes by using techniques such as data virtualisation or simply building microservices. It can be used to power new analytics, insight, and product features.

Data 63

Data Software Review Technical Review Microservices 63

O'Reilly Media - Ideas

MARCH 1, 2023

Our data shows us what O’Reilly’s 2.8 That’s a better measure of technology trends than anything that happens among the Twitterati. Companies are still “moving into the cloud”—that trend hasn’t changed—but as some move forward, others are pulling back (“repatriation”) or postponing projects. What’s real, and what isn’t?

Trends 134

Trends Technical Review Technology Software Review 134

O'Reilly Media - Ideas

FEBRUARY 18, 2020

O’Reilly online learning contains information about the trends, topics, and issues tech leaders need to watch and explore. It’s also the data source for our annual usage study, which examines the most-used topics and the top search terms. [1]. Software architecture, infrastructure, and operations are each changing rapidly.

Technical Review 139

Technical Review Microservices Data Engineering Architecture 139

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next.

Big Data 63

Big Data Data Storage Microservices 63

O'Reilly Media - Ideas

JULY 15, 2020

Microservices seem to be everywhere. Scratch that: talk about microservices seems to be everywhere. So we wanted to determine to what extent, and how, O’Reilly subscribers are empirically using microservices. Here’s a summary of our key findings: Most adopters are successful with microservices. And that’s the problem.

Microservices 140

Microservices Weak Development Team Survey Architecture 140

Altexsoft

JULY 19, 2022

In the last few decades, we’ve seen a lot of architectural approaches to building data pipelines , changing one another and promising better and easier ways of deriving insights from information. There have been relational databases, data warehouses, data lakes, and even a combination of the latter two. What data mesh IS.

Architecture 52

Architecture Data Analytics Data Engineering 52

Apiumhub

SEPTEMBER 20, 2023

October is around the corner, and it’s a prime time for tech enthusiasts, industry leaders, and innovators to come together and explore the latest trends, breakthroughs, and ideas. In this article, we´ll be your guide to the must-attend tech conferences set to unfold in October. For more information, visit the event site here.

Conference 97

Conference Artificial Inteligence UI/UX Machine Learning 97

O'Reilly Media - Ideas

MARCH 6, 2019

Spotlight on Innovation: AI Trends with Roger Chen , March 13. Data science and data tools. Practical Linux Command Line for Data Engineers and Analysts , March 13. Data Modelling with Qlik Sense , March 19-20. Foundational Data Science with R , March 26-27. Microservice Fundamentals , April 15.

Course 10

Course Artificial Inteligence Training Microservices 10

Altexsoft

JUNE 6, 2019

data is analyzed. “We We help retailers with a variety of their challenges, including better inventory prediction using their point-of-sale data combined with external factors such as weather, local events, and economic uncertainty. And this trend is slowly expanding to cover phone and email support as well,” continues James.

Artificial Inteligence 89

Artificial Inteligence Artificial Intelligence Retail Innovation 89

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. A common theme across all these trends is to remove the complexity by simplifying data management as a whole. Unified data management architecture. Event-driven data flow architecture.

Trends 49

Trends Artificial Inteligence Data Big Data 49

BPM

JANUARY 18, 2019

Now we’re seeing AI dominating the conversations (without a lot of actual adoption in the early majority), and RPA creating a lot of buzz, though companies adopting it are starting to realize that scaling an RPA based automation architecture is flawed by design. The microservice movement will reignite the need for orchestration.

Artificial Inteligence 111

Artificial Inteligence Artificial Intelligence Machine Learning Weak Development Team 111

Altexsoft

FEBRUARY 10, 2021

Similar to how DevOps once reshaped the software development landscape, another evolving methodology, DataOps, is currently changing Big Data analytics — and for the better. DataOps is a relatively new methodology that knits together data engineering, data analytics, and DevOps to deliver high-quality data products as fast as possible.

Analytics 75

Analytics DevOps Development Software Review 75

Daniel Bryant

SEPTEMBER 13, 2019

INDUSTRY TRENDS The importance workflows, SaaS, dev/ops, and community Earlier in the week the Datawire Ambassador team and I visited the fifth HashiConf US conference, delivered a presentation about implementing end-to-end security using Ambassador and Consul , attended many of the talks, and chatted to lots of our fellow attendees.

Infrastructure 8

Infrastructure Azure Software Engineering Cloud 8

O'Reilly Media - Ideas

SEPTEMBER 11, 2019

Machine learning, artificial intelligence, data engineering, and architecture are driving the data space. The Strata Data Conferences helped chronicle the birth of big data, as well as the emergence of data science, streaming, and machine learning (ML) as disruptive phenomena. The term “ML” is No.

Conference 8

Conference Data Data Engineering Artificial Inteligence 8

O'Reilly Media - Ideas

MARCH 18, 2020

One-sixth of respondents identify as data scientists, but executives—i.e., The survey does have a data-laden tilt, however: almost 30% of respondents identify as data scientists, data engineers, AIOps engineers, or as people who manage them. All told, more than 70% of respondents work in technology roles.

Enterprise 131

Enterprise Survey Technical Review Weak Development Team 131

O'Reilly Media - Ideas

JANUARY 25, 2022

What are the bigger changes shaping the future of software development and software architecture? Users certainly can search for content that doesn’t exist, so searches can be a good leading indicator of technology trends. It includes almost everything, from programming languages to cloud to architecture and more.

Trends 109

Trends Technical Review Technology Artificial Inteligence 109

O'Reilly Media - Ideas

JANUARY 25, 2021

In this report, we look at the data generated by the O’Reilly online learning platform to discern trends in the technology industry—trends technology leaders need to follow. But what are “trends”? All too often, trends degenerate into horse races over languages and platforms. Enough preliminaries.

Programming 145

Programming Cloud Artificial Inteligence Machine Learning 145