InfoQ Culture Methods

MAY 24, 2023

GDPR compliance should be a default feature in every application that handles PII (Personally Identifiable Information). Most organizations have an impression that GDPR is a luxury feature that needs special tools to implement.

Programming 131

Programming Compliance Applications Tools 131

InfoQ Culture Methods

JANUARY 23, 2024

Generative AI will profoundly transform communication and information sharing over the next decade, but the change will be uneven across industries and roles. Organizations should empower workers to use AI augmentation thoughtfully, while building literacy on capabilities and limits.

Generative AI 61

Generative AI Industry Organization Data Engineering 61

CIO

APRIL 12, 2023

After walking his executive team through the data hops, flows, integrations, and processing across different ingestion software, databases, and analytical platforms, they were shocked by the complexity of their current data architecture and technology stack. It isn’t easy.

Artificial Inteligence 363

Artificial Inteligence Artificial Intelligence Machine Learning Agile 363

Perficient

MARCH 23, 2023

Databricks Streaming and Apache Flink are two popular stream processing frameworks that enable developers to build real-time data pipelines, applications and services at scale. Comparison Databricks is an integrated platform for data engineering, machine learning, data science and analytics built on top of Apache Spark.

Data 83

Data Machine Learning Artificial Inteligence Data Engineering 83

TechCrunch

FEBRUARY 2, 2022

But, as RudderStack CEO Soumyadeb Mitra argued when I talked to him ahead of today’s announcement, most of the existing customer data pipeline solutions were built for selling to marketing teams, using architectures that make it harder to build the advanced applications that businesses are now looking for.

Data 204

Data Machine Learning Artificial Inteligence Architecture 204

InfoQ Culture Methods

DECEMBER 28, 2020

As 2020 is coming to an end, we created this article listing some of the best posts published this year. This collection was hand-picked by nine InfoQ Editors recommending the greatest posts in their domain. It's a great piece to make sure you don't miss out on some of the InfoQ's best content.

Continuous Delivery 102

Continuous Delivery Google Cloud Data Engineering Microservices 102

Altexsoft

FEBRUARY 11, 2023

This suggests that today, there are many companies that face the need to make their data easily accessible, cleaned up, and regularly updated. Hiring a well-skilled data architect can be very helpful for that purpose. What is a data architect? What is the main difference between a data architect and a data engineer?

Data 87

Data Data Engineering Big Data Architecture 87

CIO

JULY 18, 2023

The CIO’s biggest hiring challenge is clear: “There is simply not enough talent to go around,” says Scott duFour, global CIO of business payments company Fleetcor, for whom positions in areas such as AI, cloud architecture, and data science remain the toughest to fill. Merchants Fleet also gets creative in marketing its tech roles. “We

Technical Advisors 246

Technical Advisors Artificial Inteligence Generative AI How To 246

CIO

FEBRUARY 14, 2023

Organizations have balanced competing needs to make more efficient data-driven decisions and to build the technical infrastructure to support that goal. Many companies today struggle with legacy software applications and complex environments, which leads to difficulty in integrating new data elements or services.

Artificial Inteligence 290

Artificial Inteligence Strategy Data Machine Learning 290

InfoQ Culture Methods

JANUARY 19, 2022

In this podcast summary Thomas Betts, Wes Reisz, Shane Hastie, Charles Humble, Srini Penchikala, and Daniel Bryant discuss what they have seen in 2021 and speculate a little on what they hope to see in 2022. Topics explored included: hybrid working and the importance of ethics and sustainability within technology.

Technical Review 101

Technical Review Sustainability Artificial Inteligence Technology 101

InfoQ Culture Methods

DECEMBER 6, 2019

As part of the 2019 end-of-year-summary content, this article collects together a list of recommended presentation recordings from the InfoQ editorial team. By Charles Humble, Ben Linders, Arthur Casals, Manuel Pais, Erik Costlow, Shane Hastie, Shaaron A Alvares, Srini Penchikala, Michael Redlich, Steef-Jan Wiggers, Daniel Bryant.

Data Engineering 52

Data Engineering Architecture Programming System 52

Altexsoft

MAY 27, 2020

But, in any case, the pipeline would provide data engineers with means of managing data for training, orchestrating models, and managing them on production. Machine learning production pipeline architecture. Here we’ll look at the common architecture and the flow of such a system.

Machine Learning 89

Machine Learning Artificial Inteligence Architecture Training 89

Altexsoft

JUNE 29, 2021

This article will focus on the role of a machine learning engineer, their skills and responsibilities, and how they contribute to an AI project’s success. The role of a machine learning engineer in the data science team. Who does what in a data science team. Machine learning engineer vs. data scientist.

Artificial Inteligence 105

Artificial Inteligence Machine Learning Engineering Data Engineering 105

Lacework

NOVEMBER 1, 2023

Their data is precious, absolutely essential for their functioning, and the consequences of data loss or leakage can severely threaten the health of the company. This article addresses privacy in the context of hosting data and considers how privacy by design can be incorporated into the data architecture.

System Design 52

System Design Systems Review System Data 52

Dzone - DevOps

FEBRUARY 16, 2023

However, in today's era, what's more, important than the data itself is the ability to locate your wanted information among all the overflowing data quickly. So in this article, I will talk about how I improved overall data processing efficiency by optimizing the choice and usage of data warehouses.

Data 71

Data ChatGPT Storage Architecture 71

InfoQ Culture Methods

APRIL 18, 2020

At the end of 2019, InfoQ ran a survey of our readers to find out what tools, techniques, and languages they were using. This is a summary of the results. By Charles Humble.

Survey 58

Survey Tools Data Engineering Programming 58

Capgemini

JANUARY 17, 2023

Here are four resolutions to make your data strategy pay off this year. Reassess your data architecture. Most executives (72 percent) say that data, both fragmented and with poor quality, is likely to be the biggest issue when aspiring to achieve AI goals. REASSESS YOUR DATA ARCHITECTURE.

Strategy 52

Strategy Technical Review Data Artificial Inteligence 52

TechCrunch

JANUARY 26, 2022

However, over time, as the data produced in organizations continues to expand and grow ever more complex, it has put a huge strain on organizations, both in terms of the costs of managing that data, and the investment needed to parse it in useful ways.

Analytics 218

Analytics Data Big Data Business Intelligence 218

InfoQ Culture Methods

DECEMBER 6, 2019

We take a look back at what we saw on InfoQ in 2019, and think about what the next year might bring. By Charles Humble, Erik Costlow, Arthur Casals, Daniel Bryant, Bruno Couriol, Ben Linders, Shane Hastie.

Software 52

Software Data Engineering .Net Architecture 52

Confluent

FEBRUARY 6, 2019

This blog post focuses on how the Kafka ecosystem can help solve the impedance mismatch between data scientists, data engineers and production engineers. Impedance mismatch between data scientists, data engineers and production engineers. For now, we’ll focus on Kafka.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

O'Reilly Media - Data

APRIL 3, 2018

This year’s sessions on Data Engineering and Architecture showcases streaming and real-time applications, along with the data platforms used at several leading companies. Data Platforms sessions. Machine learning: From data preparation and integration, to model deployment and management.

Machine Learning 157

Machine Learning Artificial Inteligence Company Case Study 157

Altexsoft

OCTOBER 30, 2021

If you’re an executive who has a hard time understanding the underlying processes of data science and get confused with terminology, keep reading. We will try to answer your questions and explain how two critical data jobs are different and where they overlap. Data science vs data engineering.

Data Engineering 98

Data Engineering Engineering Data Machine Learning 98

Altexsoft

APRIL 22, 2020

So, along with data scientists who create algorithms, there are data engineers, the architects of data platforms. In this article we’ll explain what a data engineer is, the field of their responsibilities, skill sets, and general role description. What is a data engineer?

Data Engineering 69

Data Engineering Engineering Artificial Inteligence Data 69

Altexsoft

AUGUST 25, 2020

That’s why a data specialist with big data skills is one of the most sought-after IT candidates. Data Engineering positions have grown by half and they typically require big data skills. Data engineering vs big data engineering. Big data processing. maintaining data pipeline.

Big Data 75

Big Data Data Engineering Engineering Data 75

Progress

DECEMBER 30, 2019

Based on my interactions with thousands of developers in the Progress / Telerik developer tools ecosystem, I wrote a separate article contrasting Kinvey with Firebase. AWS Amplify is a good choice as a development platform when: Your team is proficient with building applications on AWS with DevOps, Cloud Services and Data Engineers.

AWS 52

AWS DevOps Disaster Recovery Serverless 52

Progress

DECEMBER 30, 2019

Based on my interactions with thousands of developers in the Progress / Telerik developer tools ecosystem, I wrote a separate article contrasting Kinvey with Firebase. AWS Amplify is a good choice as a development platform when: Your team is proficient with building applications on AWS with DevOps, Cloud Services and Data Engineers.

AWS 52

AWS DevOps Disaster Recovery Serverless 52

Erik Bernhardsson

DECEMBER 15, 2020

I had my first job as a software engineer in 1999, and in the last two decades I've seen software engineering changing in ways that have made us orders of magnitude more productive. Note 1: This isn't a perfect analogy since steam power wasn't just the precious resource, it was also hard to build small steam engines.).

Software Engineering 304

Software Engineering Engineering Tools Software 304

KitelyTech

FEBRUARY 3, 2021

How companies handle big data and data science is changing so they are beginning to rely on the services of specialized companies. In this article, we discussed the most popular big data and data science development services that your company can take advantage of. User Data Collection.

Big Data 52

Big Data Data Development Business Intelligence 52

Apiumhub

NOVEMBER 20, 2023

As the organizers of the Global Software Architecture Summit , we recognized the significance of introducing this subject in the forthcoming edition. With 16 years of professional experience in software engineering, including roles as CTO and CEO, he has become a prominent speaker at Green Software events in Germany.

Fractional CTO 81

Fractional CTO Software CTO Sustainability 81

O'Reilly Media - Ideas

JULY 28, 2020

In this article, we turn our attention to the process itself: how do you bring a product to market? The development phases for an AI project map nearly 1:1 to the AI Product Pipeline we described in the second article of this series. Nonetheless, building a superior feature pipeline or model architecture will always be worthwhile.

Marketing 145

Marketing Weak Development Team Metrics UI/UX 145

Cloudera

AUGUST 30, 2022

But while state and local governments seek to improve policies, decision making, and the services constituents rely upon, data silos create accessibility and sharing challenges that hinder public sector agencies from transforming their data into a strategic asset and leveraging it for the common good. . Modern data architectures.

Architecture 75

Architecture Data Artificial Inteligence Artificial Intelligence 75

Altexsoft

JULY 19, 2022

In the last few decades, we’ve seen a lot of architectural approaches to building data pipelines , changing one another and promising better and easier ways of deriving insights from information. There have been relational databases, data warehouses, data lakes, and even a combination of the latter two. What data mesh IS.

Architecture 52

Architecture Data Analytics Data Engineering 52

Altexsoft

APRIL 13, 2023

Supply chain control tower architecture: main components, integrations, and data sources As we mentioned, an SCCT is typically comprised of multiple components that handle various aspects of supply chain management. Let’s look closer at what’s there under the hood and list the main components, integrations, and data sources.

Technical Review 59

Technical Review Software Review Analytics Systems Review 59

Existek

SEPTEMBER 28, 2023

In this article, we’ve focused on the AI developer job and some efficient approaches to engage with the best specialists on the market. Responsibilities of AI engineers Requirements to hire AI developers Where to find AI developers? Therefore, it’s required to obtain good skills in data science.

Artificial Inteligence 52

Artificial Inteligence Development How To Artificial Intelligence 52

Hu's Place - HitachiVantara

JANUARY 3, 2019

” Deployments of large data hubs have only resulted in more data silos that are not easily understood, related, or shared. In order to utilize the wealth of data that they already have, companies will be looking for solutions that will give comprehensive access to data from many sources.

Trends 86

Trends Artificial Inteligence Data Center Machine Learning 86

O'Reilly Media - Ideas

MARCH 19, 2020

Aggregating artificial intelligence and machine learning topics accounts for nearly 5% of all usage activity on the platform, a touch less than, and growing 50% faster than, the well-established “data science” topic (see Figure 2). It has implications for software architecture, infrastructure, and operations—for virtually all domains.

Artificial Inteligence 113

Artificial Inteligence Trends Artificial Intelligence Machine Learning 113

Kentik

APRIL 3, 2018

Networking teams no longer need to be limited by unresponsive tools, aggregated stats, and data deadends. This allows non-technical stakeholders from product, marketing, sales, management, and executives to understand the data and gain insight in terms that are relevant to their roles. The Big Picture.

Network 40

Network WAN LAN Policies 40