Remove configuring-apache-kafka-consumer-group-ids
article thumbnail

What’s New in CDP Private Cloud Base 7.1.7?

Cloudera

Apache Ozone enhancements deliver full High Availability providing customers with enterprise-grade object storage and compatibility with Hadoop Compatible File System and S3 API. . We expand on this feature later in this blog. In the example below we have granted SELECT to members of a number of sales groups. x, and 6.3.x,

Cloud 97
article thumbnail

Migrating Apache NiFi Flows from HDF to CFM with Zero Downtime

Cloudera

Use Case 1: NiFi pulling data from Kafka and pushing it to a file system (like HDFS). With the flow running in HDF, you can set up the same flow in the CFM cluster, making sure to use the same “Group ID” in each ConsumeKafka processor configuration. . Start the flow in the CFM cluster. Start the flow in the CFM cluster.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Kafka Connect and Elasticsearch vs. PostgreSQL Pipelines: Initial Performance Results (Pipeline Series Part 8)

Instaclustr

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect , and what does it look like in Superset. Scaling Kafka Connect, Elasticsearch, and PostgreSQL Pipelines.

article thumbnail

Deploying Kafka Streams and KSQL with Gradle – Part 3: KSQL User-Defined Functions and Kafka Streams

Confluent

As discussed in part 2, I created a GitHub repository with Docker Compose functionality for starting a Kafka and Confluent Platform environment, as well as the code samples mentioned below. As before, we first apply a few Gradle plugins using the plugins{} closure: plugins { id 'groovy'. id 'com.adarshr.test-logger' version '1.7.0'. }.

Lambda 86
article thumbnail

Spring for Apache Kafka Deep Dive – Part 2: Apache Kafka and Spring Cloud Stream

Confluent

On the heels of part one in this blog series, Spring for Apache Kafka – Part 1: Error Handling, Message Conversion and Transaction Support , here in part two we’ll focus on another project that enhances the developer experience when building streaming applications on Kafka: Spring Cloud Stream.

Cloud 111
article thumbnail

The Good and the Bad of Apache Kafka Streaming Platform

Altexsoft

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. What is Kafka?

article thumbnail

Building a Scalable Search Architecture

Confluent

Distributed transactions are very hard to implement successfully, which is why we’ll introduce a log-inspired system such as Apache Kafka ®. Building an indexing pipeline at scale with Kafka Connect. Later, another agent or group of agents will collect the data from the brokers and store them in our search engine.