Confluent

DECEMBER 15, 2020

Consuming messages in parallel is what Apache Kafka® is all about, so you may well wonder, why would we want anything else? It turns out that, in practice, there are […].

144

144

TechCrunch

FEBRUARY 23, 2022

Portland, Oregon-based startup thatDot , which focuses on streaming event processing, today announced the launch of Quine , a new MIT-licensed open source project for data engineers that combines event streaming with graph data to create what the company calls a “streaming graph.”

Engineering 190

Engineering Open Source Big Data Fintech 190

Cloudera

MARCH 5, 2024

Cloudera is now the only provider to offer an open data lakehouse with Apache Iceberg for cloud and on-premises. Apache Ozone As AI and other advanced analytics continue to grow in scale, performance and scalable data storage will need to expand right along with them. But even with its rise, AI is still a struggle for some enterprises.

Data 87

Data Data Center Analytics Artificial Intelligence 87

Dzone - DevOps

MARCH 26, 2023

After successfully starting a Redpanda or Apache Kafka® cluster, you want to stream data into it right away. No matter what tool and language you chose, you will immediately be asked for a list of bootstrap servers for your client to connect to it. Let’s start with the basics. The diagram below will give you a better idea.

Advertising 93

Advertising Tools Data 93

Cloudera

JULY 18, 2022

In part 1 of this blog we discussed how Cloudera DataFlow for the Public Cloud (CDF-PC), the universal data distribution service powered by Apache NiFi, can make it easy to acquire data from wherever it originates and move it efficiently to make it available to other applications in a streaming fashion.

Analytics 86

Analytics Data Applications System 86

TechCrunch

APRIL 5, 2022

But what do you do with it now? When it comes to data ingestion, Tinybird has connectors for various popular data sources, such as databases (PostgreSQL, MySQL…), CSV files hosted in a storage bucket on a public cloud, data warehouses and data streams, from Amazon Redshift to Google BigQuery, Snowflake and Apache Kafka.

Analytics 228

Analytics Hotels Travel Retail 228

Perficient

MARCH 6, 2023

Introduction: Apache Kafka is a distributed streaming platform that enables businesses to build real-time streaming applications. Kafka can process and transmit massive amounts of data in real-time, and its design ensures fault tolerance, scalability, and high availability. Kafka utilizes a pull-based model for consumers.

Scalability 64

Scalability Big Data Analytics Applications 64

Cloudera

SEPTEMBER 13, 2023

I started my current career path with Hortonworks in 2016, back when we still had to tell people what Hadoop was. Once I got to work with all the amazing open-source Apache tools I was hooked. I found Apache NiFi especially interesting. Soon after, I became a huge fan of Apache Kafka.

Innovation 82

Innovation Open Source Technology Data Engineering 82

Cloudera

MARCH 2, 2023

Recently, we announced enhanced multi-function analytics support in Cloudera Data Platform (CDP) with Apache Iceberg. The CSP engine is powered by Apache Flink, which is the best-in-class processing engine for stateful streaming pipelines. Iceberg is a high-performance open table format for huge analytic data sets.

Analytics 113

Analytics Travel Engineering Windows 113

Cloudera

JUNE 7, 2021

It enabled users to easily write, run and manage real-time SQL queries on streams from Apache Kafka with an exceptionally smooth user experience. . Improved Kafka and Schema Registry integration. Improved Kafka and Schema Registry integration. We have further streamlined the integration with Kafka and Schema Registry.

Analytics 101

Analytics Games Data System 101

Mobilunity

APRIL 29, 2023

From this article, you’ll learn which solutions use Netflix and Disney and watch the AWS Kinesis vs Kafka “battle.“ However, the list of top data streaming solutions is much shorter: Kafka and Kinesis. For instance, Netflix uses Apache Kafka , and Disney+ uses Kinesis. Let’s check.

AWS 52

AWS Technical Review Systems Review Software Review 52

Cloudera

FEBRUARY 21, 2023

SQL Stream Builder (SSB) is a versatile platform for data analytics using SQL as a part of Cloudera Streaming Analytics, built on top of Apache Flink. What is a data transformation? This transformation can be performed on incoming records of a Kafka topic before SSB sees the data. If the messages are inconsistent.

Data 108

Data Technical Review Analytics Construction 108

Instaclustr

SEPTEMBER 28, 2021

In the last installment of the pipeline blog series , we explored writing streaming JSON data into PostgreSQL using Kafka Connect. What Is Apache Superset? What is Apache Superset? But what if you aren’t an SQL guru? In this blog, I wanted to get Apache Superset working with PostgreSQL.

Data 97

Data Virtualization Metrics Open Source 97

TechCrunch

FEBRUARY 2, 2022

“If you wanted fast data, you used the stream processing stack [like Kafka and Confluent], right? What open source-based startups can learn from Confluent’s success story. He created a tool to do this called Hudi , which Uber donated to the Apache Software Foundation as an open source project the following year.

Open Source 233

Open Source Data Technical Review Software Review 233

Confluent

MAY 13, 2019

In the last year, we’ve experienced enormous growth on Confluent Cloud, our fully managed Apache Kafka ® service. As Confluent Cloud has grown, we’ve noticed two gaps that very clearly remain to be filled in managed Apache Kafka services. Five seconds to Kafka (or, never make another cluster again!).

Cloud 100

Cloud Load Balancer Infrastructure Scalability 100

Confluent

MARCH 26, 2019

Apache-Kafka ® -based applications stand out for their ability to decouple producers and consumers using an event log as an intermediate layer. This article describes how to instrument Kafka-based applications with distributed tracing capabilities in order to make dataflows between event-based components more visible.

Applications 111

Applications Transportation Architecture Open Source 111

Cloudera

JUNE 28, 2022

We discussed how Cloudera Stream Processing (CSP) with Apache Kafka and Apache Flink could be used to process this data in real time and at scale. This is what we call the first-mile problem. The scored transactions are written to the Kafka topic that will feed the real-time analytics process that runs on Apache Flink.

Analytics 81

Analytics Machine Learning Artificial Inteligence Cloud 81

Instaclustr

AUGUST 6, 2021

Why Use the Kafka REST Proxy. Apache Kafka is known best as a powerful, open source message streaming and queueing solution. Used across more than 80% of the Fortune 500, Kafka is ubiquitous in supporting event-driven architectures. Read Now: Apache Kafka Architecture – The complete guide.

Architecture 65

Architecture Software Review Open Source Performance 65

Confluent

MAY 23, 2019

Let us cut to the chase: Kafka Summit London session videos are available! If you were there, you know what a great time it was, and you know that you had to make sometimes-agonizing decisions about which sessions to attend and which to miss. World-class Kafka keynotes. And if you weren’t there? Well, dig in and start learning!

Video 109

Video Engineering Culture Conference Culture 109

Confluent

FEBRUARY 6, 2019

The blog posts How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka and Using Apache Kafka to Drive Cutting-Edge Machine Learning describe the benefits of leveraging the Apache Kafka ® ecosystem as a central, scalable and mission-critical nervous system.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

CIO

SEPTEMBER 22, 2022

We manage database services for our customers, database services in the cloud, open source technologies such as Postgres, MySQL, Apache, Kafka,” says Sellers. “We We help customers adopt those services so they can focus on what they do best, which is building technology for their customers.”.

Innovation 130

Innovation Google Cloud Data Open Source 130

Cloudera

OCTOBER 4, 2022

This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka brokers contained within host groups enable the administrators to more easily add and remove nodes.

Data 77

Data Groups Cloud Big Data 77

Cloudera

JANUARY 31, 2024

Streams Replication Manager (SRM) is an enterprise-grade replication solution that enables fault tolerant, scalable, and robust cross-cluster Kafka topic replication. Introduction Kafka as an event streaming component can be applied to a wide variety of use cases. Replication can be dynamically enabled for topics and consumer groups.

Policies 69

Policies Metrics Load Balancer Software Review 69

Confluent

FEBRUARY 28, 2019

Only a little more than one month after the first release, we are happy to announce another milestone for our Kafka integration. Today, you can grab the Kafka Connect Neo4j Sink from Confluent Hub. . Neo4j extension – Kafka sink refresher. Then it is really up to you what you want to with the event data.

Open Source 87

Open Source Testing Data System 87

OpenCredo

NOVEMBER 22, 2023

Here at OpenCredo we love projects that are based around Kafka and/or Data/Platform Engineering; in one of our recent projects, we created an open data lake using Kafka, Flink, Nessie and Iceberg. Apache Flink is designed for distributed streams and batch processing, handling real-time and historical data.

Data 59

Data AWS Policies Compliance 59

Instaclustr

SEPTEMBER 28, 2021

In the last installment of the pipeline blog series , we explored writing streaming JSON data into PostgreSQL using Kafka Connect. What Is Apache Superset? What is Apache Superset? But what if you aren’t an SQL guru? In this blog, I wanted to get Apache Superset working with PostgreSQL.

Data 68

Data Virtualization Metrics Open Source 68

Confluent

MAY 14, 2019

Without people writing code, writing tutorials, welcoming newcomers, giving presentations, and answering questions, what we have is not a community, but just a set of Git repositories. What does it take to be a Confluent Community Catalyst? What does it take to be a Confluent Community Catalyst? What does a Catalyst get?

Programming 83

Programming Conference Energy Education 83

Cloudera

AUGUST 24, 2021

As a Software Engineer at Cloudera, Barnabas gets to experience rewarding work with emerging technologies like Apache Kafka. As he sees it, “Kafka is a famous and widely used project. The team is not just about Kafka, but other components that are built around Kafka too, so we can work on different projects, full of challenges.

Software Engineering 96

Software Engineering Engineering Software Open Source 96

Instaclustr

OCTOBER 18, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. Here’s what the Elasticsearch results look like.

Performance 84

Performance Comparison Systems Review Metrics 84

TechCrunch

NOVEMBER 30, 2020

Fundamentally what that means is that you’re going to have to go to businesses using the technologies and tools that they understand, which is standard SQL,” Narayan explained. . The startup is working on a SaaS version of the product, which it expects to release some time next year. Cockroach Labs scores $86.6M

Open Source 180

Open Source Scalability Metrics Data 180

Cloudera

JUNE 7, 2021

We are excited to be recognized in this wave at, what we consider to be, such a strong position. The report states that richness of analytics, development tool options and near-effortless scalability are what streaming analytics customers should look for in a provider. . It’s too late. Stay tuned for cool product announcements.

Analytics 101

Analytics Performance IoT Report 101

Confluent

JUNE 12, 2019

Confluent Cloud, a fully managed event cloud-native streaming service that extends the value of Apache Kafka ® , is simple, resilient, secure, and performant, allowing you to focus on what is important—building contextual event-driven applications, not infrastructure. and Helm/Tiller 2.8.2+ KSQL, Schema Registry).

Cloud 93

Cloud How To Examples Infrastructure 93

TechCrunch

AUGUST 23, 2021

TechCrunch sits down with three leading investors to discuss how they are fighting for allocation in hot deals, what they’ve changed in their own processes, and what today’s best founders are demanding. We’re going to talk to CEO Ali Ghodsi about why his startup is so hot, and what comes next. TechCrunch Sessions is back!

Open Source 242

Open Source Mobile Cloud Trends 242

Confluent

JULY 11, 2019

Reading, writing, and transforming data in Apache Kafka ® using KSQL is an effective way to rapidly deliver event streaming applications for clients (e.g., For a KSQL newbie the practical exercises show you how to process data in Apache Kafka using an interactive SQL interface. streaming insurance events ).

Training 83

Training Course Exercises IoT 83

Confluent

FEBRUARY 20, 2019

How many Kafka Summits should there be in a year? Others say you should live every day like it’s Kafka Summit. Anyway, let me remind you of the dates and places: Kafka Summit New York – April 2, 2019. Kafka Summit London – May 13-14, 2019. Kafka Summit San Francisco – Sept. Kafka Summit London agenda is open.

Course 66

Course Conference Training Groups 66

Cloudera

DECEMBER 10, 2020

In the previous post, we talked about Kerberos authentication and explained how to configure a Kafka client to authenticate using Kerberos credentials. In this post we will look into how to configure a Kafka client to authenticate using LDAP, instead of Kerberos. We use the Kafka-console-consumer for all the examples below.

Authentication 52

Authentication How To Examples Network 52

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Data 105

Data Artificial Inteligence Analytics Machine Learning 105