Cloudera

JUNE 28, 2022

In a previous blog of this series, Turning Streams Into Data Products , we talked about the increased need for reducing the latency between data generation/ingestion and producing analytical results and insights from this data. This is what we call the first-mile problem. This blog will be published in two parts. The use case.

Analytics 82

Analytics Machine Learning Artificial Inteligence Cloud 82

Confluent

JUNE 12, 2019

Confluent Cloud, a fully managed event cloud-native streaming service that extends the value of Apache Kafka ® , is simple, resilient, secure, and performant, allowing you to focus on what is important—building contextual event-driven applications, not infrastructure. Next, click on the cluster name whose configuration you want.

Cloud 92

Cloud How To Examples Infrastructure 92

Instaclustr

SEPTEMBER 28, 2021

In the last installment of the pipeline blog series , we explored writing streaming JSON data into PostgreSQL using Kafka Connect. In this blog, it’s time to find out if our fears of encountering mutant monsters in the gloom of an abandoned uranium mine were warranted or not. What Is Apache Superset?

Data 97

Data Virtualization Metrics Open Source 97

Cloudera

AUGUST 24, 2021

As a Software Engineer at Cloudera, Barnabas gets to experience rewarding work with emerging technologies like Apache Kafka. As he sees it, “Kafka is a famous and widely used project. The team is not just about Kafka, but other components that are built around Kafka too, so we can work on different projects, full of challenges.

Software Engineering 97

Software Engineering Engineering Software Open Source 97

Mobilunity

APRIL 29, 2023

From this article, you’ll learn which solutions use Netflix and Disney and watch the AWS Kinesis vs Kafka “battle.“ However, the list of top data streaming solutions is much shorter: Kafka and Kinesis. For instance, Netflix uses Apache Kafka , and Disney+ uses Kinesis. Let’s check.

AWS 52

AWS Technical Review Systems Review Software Review 52

Instaclustr

OCTOBER 18, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. Here’s what the Elasticsearch results look like.

Performance 84

Performance Comparison Systems Review Metrics 84

Cloudera

DECEMBER 10, 2020

In the previous post, we talked about Kerberos authentication and explained how to configure a Kafka client to authenticate using Kerberos credentials. In this post we will look into how to configure a Kafka client to authenticate using LDAP, instead of Kerberos. We use the Kafka-console-consumer for all the examples below.

Authentication 52

Authentication How To Examples Network 52

Confluent

FEBRUARY 6, 2019

The blog posts How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka and Using Apache Kafka to Drive Cutting-Edge Machine Learning describe the benefits of leveraging the Apache Kafka ® ecosystem as a central, scalable and mission-critical nervous system.

Machine Learning 106

Machine Learning Artificial Inteligence Scalability Data Engineering 106

Confluent

JULY 11, 2019

Reading, writing, and transforming data in Apache Kafka ® using KSQL is an effective way to rapidly deliver event streaming applications for clients (e.g., For a KSQL newbie the practical exercises show you how to process data in Apache Kafka using an interactive SQL interface. streaming insurance events ).

Training 83

Training Course Exercises IoT 83

Cloudera

AUGUST 10, 2021

With Apache Ozone on the Cloudera Data Platform (CDP) , they can implement a scale-out model and build out their next generation storage architecture without sacrificing security, governance and lineage. In this article, we’ll focus on generating and viewing lineage that includes Ozone assets from Apache Atlas. With CDP 7.1.4

Storage 104

Storage Policies Architecture Data 104

Instaclustr

SEPTEMBER 28, 2021

In the last installment of the pipeline blog series , we explored writing streaming JSON data into PostgreSQL using Kafka Connect. In this blog, it’s time to find out if our fears of encountering mutant monsters in the gloom of an abandoned uranium mine were warranted or not. What Is Apache Superset?

Data 68

Data Virtualization Metrics Open Source 68

Cloudera

APRIL 20, 2021

What is Streaming Analytics? What are the business challenges with today’s data? IT teams tried solving the problem by adding more clusters but noticed the rising cost for infrastructure and struggled to hire the right talent to manage them. What are the advantages of Streaming Analytics?

Analytics 93

Analytics Retail Architecture Government 93

Cloudera

FEBRUARY 17, 2021

Everyone was looking for real-time insights by analyzing what is going on currently within their businesses and taking corrective action pro-actively. Here is a recap of what we had delivered successfully with CDF in 2020, overcoming all obstacles the year threw at us. Overall, I think we had a great year from a product perspective.

Part-Time VPE 60

Part-Time VPE Analytics eBook Leadership 60

Cloudera

SEPTEMBER 15, 2020

introduces fine-grained authorization for access to Azure Data Lake Storage using Apache Ranger policies. Apache Ranger provides a centralized console to manage authorization and view audits of access to resources in a large number of services including Apache Hadoop’s HDFS, Apache Hive, Apache HBase, Apache Kafka, Apache Solr.

Storage 75

Storage Azure Cloud Policies 75

Instaclustr

SEPTEMBER 15, 2021

With the release of AWS’s Graviton2 (ARM) instances and gp3 disks, we at Instaclustr saw an opportunity to further improve the quality of our Managed Apache Kafka offering. All of our previous offerings have used Java 11 (OpenJDK) to run the Kafka service on x86 instances. Graviton2/gp3 vs. x86/gp2 Benchmarking.

AWS 41

AWS Performance Architecture Network 41

Cloudera

SEPTEMBER 9, 2020

This blog post will present a simple “hello world” kind of example on how to get data that is stored in S3 indexed and served by an Apache Solr service hosted in a Data Discovery and Exploration cluster in CDP. We will only cover AWS and S3 environments in this blog. You have a DDE cluster running.

Data 82

Data How To AWS Resources 82

Cloudera

OCTOBER 28, 2020

Cloudera services logs offer a breadth of information to assist in cluster maintenance; from assisting in security checks, auditing tasks, and validation for performance tuning and testing tasks – to name a few. . x cluster that has both Kerberos and TLS enabled. What does this Workflow Look Like? Benefits: Easy to implement.

Examples 65

Examples Groups Performance Applications 65

Linux Academy

JUNE 28, 2019

Apache Kafka Deep Dive. Course Description: Apache Kafka is a publish/subscribe messaging system with many advanced configurations. You’ll be able to build your own Kafka cluster using Linux Academy servers, which will help your understanding and provide you with real-world examples. Database Essentials.

Course 60

Course DevOps Training Linux 60

Instaclustr

MARCH 12, 2019

In the previous blog , we deployed the Anomalia Machina application in a production-like Kubernetes environment. In this blog, we test it out and see many anomalies it can detect at scale on small Kafka and Cassandra Instaclustr production clusters. Can we ride out the storm and scale the application?

Scalability 31

Scalability Metrics Resources AWS 31

Linux Academy

APRIL 30, 2019

We support others in their mission to learn and grow and are adding new ways for our students to learn what they need to succeed. Stay tuned to the Linux Academy blog for further details. What do you do next? Linux Study Group in May. This course covers objectives for the LPI Essentials exam version 1.5.

Linux 113

Linux AWS Big Data Course 113

Linux Academy

MAY 28, 2019

We support others in their mission to learn and grow and are adding new ways for our students to learn what they need to succeed. Stay tuned to the Linux Academy blog for further details. By adding free cloud training to our Community Membership, students have the opportunity to develop their Linux and Cloud skills further.

Linux 104

Linux AWS Azure Technical Review 104

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers. Getting started.

eCommerce 21

eCommerce Architecture System Microservices 21

Linux Academy

JUNE 25, 2019

Stay tuned to the Linux Academy blog for details! In this free course, we start with the basics of what a database is, then explore the different types of databases from flat file to relational. What is the cloud or Google Cloud? Members of the Linux Academy community come together and share their insights and questions.

Linux 60

Linux Course Cloud Google Cloud 60

Confluent

SEPTEMBER 26, 2019

In the early days, many companies simply used Apache Kafka ® for data ingestion into Hadoop or another data lake. However, Apache Kafka is more than just messaging. Rockset supports JDBC and integrates with other SQL dashboards like Tableau, Grafana, and Apache Superset.

Analytics 20

Analytics Serverless Blockchain Microservices 20

Linux Academy

FEBRUARY 26, 2019

We support others in their mission to learn and grow and are adding new ways for our students to learn what they need to succeed. Stay tuned to the Linux Academy blog for further details. Are you a non-technical person just wanting to know what this “Linux” thing is? Then this course is for you.

Linux 80

Linux AWS Big Data Course 80

Confluent

AUGUST 27, 2019

We are excited to announce the release of Confluent Cloud Schema Registry in general availability (GA), available in Confluent Cloud , our fully managed event streaming service based on Apache Kafka ®. Before we dive into Confluent Cloud Schema Registry, let’s recap what Confluent Schema Registry is and does.

Cloud 18

Cloud Product Management AWS Storage 18

Linux Academy

APRIL 29, 2019

We support others in their mission to learn and grow and are adding new ways for our students to learn what they need to succeed. Stay tuned to the Linux Academy blog for further details. What do you do next? Linux Study Group in May. This course covers objectives for the LPI Essentials exam version 1.5.

Linux 60

Linux AWS Big Data Course 60

Linux Academy

OCTOBER 29, 2019

Kafka streams seem like a daunting subject to many learners, but they don’t have to be. In fact, when I put together information for this blog post, I joked that getting all this data would be like drinking from a waterfall. This will help to explain it: Understanding Kafka Streams. Guess what? Netflix uses Kafka.

Big Data 17

Big Data Linux Course Training 17

Instaclustr

OCTOBER 13, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect , and what does it look like in Superset. But how big is big enough?

Performance 83

Performance Metrics Systems Review Testing 83

Cloudera

FEBRUARY 28, 2024

For example, if there are separate clusters, and there are topics with the same purpose in the different clusters, then it is useful to aggregate the content into one topic. This blog post walks you through how you can use prefixless replication with Streams Replication Manager (SRM) to aggregate Kafka topics from multiple sources.

Testing 69

Testing Big Data Tools Data 69

Confluent

JUNE 26, 2019

I see this pattern coming up more and more in the field in conjunction with Apache Kafka ®. In these projects, microservice architectures use Kafka as an event streaming platform. Apache Kafka – An event streaming platform for microservices. What technology should you use to build microservice architectures?

Microservices 109

Microservices Software Review Technical Review Architecture 109

Altexsoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it.

Weak Development Team 93

Weak Development Team Technical Review Systems Review Software Review 93

Instaclustr

JULY 22, 2021

Having explored one fork in the path (Elasticsearch and Kibana) in the previous pipeline blog series ( here is part 5 ), in this blog we backtrack to the junction to explore the alternative path ( PostgreSQL and Apache Superset). Fork in an abandoned uranium mine (Source: Shutterstock). Step 1: PostgreSQL database.

Open Source 92

Open Source Data AWS Software Review 92

Confluent

OCTOBER 1, 2019

If you looked at the Kafka Summits I’ve been a part of as a sequence of immutable events (and they are, unless you know something about time I don’t), it would look like this: New York City 2017, San Francisco 2017, London 2018, San Francisco 2018, New York City 2019, London 2019, San Francisco 2019. Everybody uses Kafka all day every day.

Serverless 14

Serverless Conference Video Software 14

Cloudera

OCTOBER 17, 2023

Recently, Confluent hosted Current 2023 (formerly Kafka summit) in San Jose on Sept 26th and 27th. With few conferences curating content specific to streaming developers, Current has historically been an important event for anyone trying to keep a pulse on what’s happening in the streaming space. Expecting a product to be GA’d.

Technical Review 76

Technical Review Generative AI Conference Open Source 76

Cloudera

FEBRUARY 10, 2022

CDF-PC provides a central monitoring dashboard for flow deployments and offers custom KPI tracking and alerting allowing customers to stay on top of what matters to them. The need for a cloud-native Apache NiFi service on Microsoft Azure. Solving Common Data Integration Use Cases with CDF-PC on Azure. SIEM Optimization.

Azure 115

Azure Cloud Infrastructure Virtualization 115

Cloudera

SEPTEMBER 13, 2021

There are two big gaps in the Apache Kafka project when we think of operating a cluster. The first is monitoring the cluster efficiently and the second is managing failures and changes in the cluster. Cruise Control is integrated with Kafka through metrics reporting. Architecture. Metrics Reporting.

Metrics 70

Metrics Windows Leadership Testing 70