Remove articles how-to-deploy-apache-kafka-with-kubernetes
article thumbnail

Let’s Flink on EKS: Data Lake Primer

OpenCredo

Here at OpenCredo we love projects that are based around Kafka and/or Data/Platform Engineering; in one of our recent projects, we created an open data lake using Kafka, Flink, Nessie and Iceberg. Apache Flink is designed for distributed streams and batch processing, handling real-time and historical data.

Data 59
article thumbnail

3 emerging trends tech leaders should watch

O'Reilly Media - Ideas

The signals from the O’Reilly online learning platform reveal: Strong growth in cloud topics and Kubernetes, as well as interest in containers and decomposition (microservices), points toward the rise of a “Next Architecture.”. Keeping up with technology can be a daunting task for tech leaders. The signs of a Next Architecture.

Trends 82
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Spring for Apache Kafka Deep Dive – Part 3: Apache Kafka and Spring Cloud Data Flow

Confluent

Following part 1 and part 2 of the Spring for Apache Kafka Deep Dive blog series, here in part 3 we will discuss another project from the Spring team: Spring Cloud Data Flow , which focuses on enabling developers to easily develop, deploy, and orchestrate event streaming pipelines based on Apache Kafka ®.

Cloud 93
article thumbnail

Microservices, Apache Kafka, and Domain-Driven Design

Confluent

I see this pattern coming up more and more in the field in conjunction with Apache Kafka ®. In these projects, microservice architectures use Kafka as an event streaming platform. In these projects, microservice architectures use Kafka as an event streaming platform. How should microservices communicate with each other?

article thumbnail

The Good and the Bad of Kubernetes Container Orchestration

Altexsoft

Over the past few years, Kubernetes has become an integral part of cloud-native computing and the gold standard for container orchestration at scale. Read this article to learn how top organizations benefit from Kubernetes, what it can do, and when its magic fails to work properly. What is Kubernetes?

article thumbnail

The Good and the Bad of Apache Airflow Pipeline Orchestration

Altexsoft

But apparently, things were much more difficult before Apache Airflow appeared. This article covers Airflow’s pros and gives a clue why, despite all its virtues, it’s not a silver bullet. How data engineering works. What is Apache Airflow? Source: Apache Airflow. Source: Apache Airflow.

article thumbnail

The Good and the Bad of Apache Spark Big Data Processing

Altexsoft

To some, the word Apache may bring images of Native American tribes celebrated for their tenacity and adaptability. These seemingly unrelated terms unite within the sphere of big data, representing a processing engine that is both enduring and powerfully effective — Apache Spark. What is Apache Spark? Apache Spark components.