Remove operating-apache-kafka-with-cruise-control
article thumbnail

Scaling Kafka Brokers in Cloudera Data Hub

Cloudera

This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka brokers contained within host groups enable the administrators to more easily add and remove nodes.

Data 77
article thumbnail

Operating Apache Kafka with Cruise Control

Cloudera

About Cruise Control. There are two big gaps in the Apache Kafka project when we think of operating a cluster. There are no solutions for these inside the Kafka project but there are many good 3rd party tools for both problems. Cruise Control is integrated with Kafka through metrics reporting.

Metrics 69
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Upgrade Journey: The Path from CDH to CDP Private Cloud

Cloudera

The customer also wanted to utilize the new features in CDP PvC Base like Apache Ranger for dynamic policies, Apache Atlas for lineage, comprehensive Kafka streaming services and Hive 3 features that are not available in legacy CDH versions. Attribute-based access control and SparkSQL fine-grained access control.

Cloud 130
article thumbnail

Cloudera DataFlow’s key milestones and wins in 2020

Cloudera

Spin up clusters of NiFi, Kafka, or Flink very quickly onto your public cloud environments on AWS or Azure. Extending the Kafka ecosystem to CDP – Cloudera (and Hortonworks) has always prided itself on its investment and innovations around Apache Kafka.

article thumbnail

New Features in Cloudera Streams Messaging for CDP Public Cloud 7.2.14

Cloudera

In this release , the Streams Messaging templates in Data Hub will come with Apache Kafka 2.8 and Cruise Control 2.5 KConnect has been added and gains additional capabilities with new connectors and Stateless Apache NiFi capabilities which can run NiFi Flows as connectors. Kafka & Cruise Control Updates.

Cloud 102
article thumbnail

Scaling Kafka at Honeycomb

Honeycomb

For the entirety of Honeycomb’s existence, we have used Apache Kafka to perform this buffering function in our observability pipeline. A brief overview of Kafka at Honeycomb. How does Kafka help us achieve these results? Adapting Kafka for our use case. Let’s dive in.

AWS 145
article thumbnail

Top 4 Reasons Why You Should Upgrade Your Stream Processing Workloads To CDP

Cloudera

With Cloudera DataFlow as part of CDP, businesses can operate and manage streaming workloads from edge data collection to streaming analytics in the Cloud. Apache NiFi empowers data engineers to orchestrate data collection, distribution, and transformation of streaming data with capacities of over 1 billion events per second. .