Cloudera

JULY 21, 2022

Cloudera has partnered with Rill Data, an expert in metrics at any scale, as Cloudera’s preferred ISV partner to provide technical expertise and support services for Apache Druid customers. We want Cloudera customers that rely on Apache Druid to know that their clusters are secure and supported by the Cloudera partner ecosystem.

Metrics 84

Metrics Data Technical Review Analytics 84

Cloudera

JUNE 28, 2022

In a previous blog of this series, Turning Streams Into Data Products , we talked about the increased need for reducing the latency between data generation/ingestion and producing analytical results and insights from this data. This blog will be published in two parts. The use case. This is what we call the first-mile problem.

Analytics 81

Analytics Machine Learning Artificial Inteligence Cloud 81

Instaclustr

AUGUST 6, 2021

Why Use the Kafka REST Proxy. Apache Kafka is known best as a powerful, open source message streaming and queueing solution. Used across more than 80% of the Fortune 500, Kafka is ubiquitous in supporting event-driven architectures. That’s where the Kafka REST Proxy comes in.

Architecture 65

Architecture Software Review Open Source Performance 65

OpenCredo

NOVEMBER 22, 2023

Here at OpenCredo we love projects that are based around Kafka and/or Data/Platform Engineering; in one of our recent projects, we created an open data lake using Kafka, Flink, Nessie and Iceberg. The first part of this blog is related to the Flink and S3 infra design. We provisioned it using Terraform.

Data 59

Data AWS Policies Compliance 59

Confluent

FEBRUARY 6, 2019

After all, machine learning with Python requires the use of algorithms that allow computer programs to constantly learn, but building that infrastructure is several levels higher in complexity. This is important to note since machine learning is clearly gainin g steam, though many who use the term do so by misusing the term.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

Cloudera

NOVEMBER 16, 2021

With the general availability of Cloudera DataFlow for the Public Cloud (CDF-PC) , our customers can now self-serve deployments of Apache NiFi data flows on Kubernetes clusters in a cost effective way providing auto scaling, resource isolation and monitoring with KPI-based alerting. Event driven use cases.

Serverless 105

Serverless Lambda Microservices KPI 105

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Data 105

Data Artificial Inteligence Analytics Machine Learning 105

Bernd Rucker

JUNE 30, 2021

This article was first published in the Confluent blog at [link] The transition from a passive event stream to an active component like a workflow engine is very interesting. This is a pretty common pattern with event streaming: You get a huge amount of raw data, generate insights from it, and then you have to act.

Technical Review 55

Technical Review Windows Software Review Weak Development Team 55

Cloudera

APRIL 20, 2021

It continuously processes data from multiple streams and performs simple calculations to complex event processing for delivering sophisticated use cases. The primary purpose is to present the most up-to-date operational events for the user to stay on top of the business needs and take action as changes happen in real-time.

Analytics 93

Analytics Retail Architecture Government 93

Cloudera

OCTOBER 4, 2022

This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka as an event stream can be applied to a wide variety of use cases.

Data 77

Data Groups Cloud Big Data 77

Cloudera

DECEMBER 9, 2022

Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Developers need to onboard new data sources, chain multiple data transformation steps together, and explore data as it travels through the flow.

Testing 96

Testing Azure Cloud AWS 96

Datavail

JANUARY 5, 2023

We have the highlights from the event in this handy summary. Real-time streaming ingestion for Amazon Kinesis Data Streams and Amazon Managed Streaming for Apache Kafka is now generally available for Redshift. AWS Glue for Apache Spark has added support for several open-source data lake storage frameworks.

AWS 52

AWS Analytics Disaster Recovery Serverless 52

Perficient

MAY 30, 2023

In this technical blog post, we will explore the limitations of Databricks regarding synchronous updates, introduce the pattern of “Simulating Synchronous Operations with Asynchronous Code,” and compare it with the widely adopted event-driven architecture. The events are then published to a message broker or event bus.

Software Review 59

Software Review Systems Review System Lambda 59

Cloudera

MAY 13, 2021

Are you using the right stream processing engine for the job at hand? Specifically, the whitepaper analyzes the technical and operational differences between modern processing engines from the Apache open source community. Can the stream processing engine you’re considering distinguish between event time from processing time?

Engineering 101

Engineering Comparison Open Source Scalability 101

Cloudera

AUGUST 26, 2020

In Part II of our Q&A, Dinesh will be looking at how businesses can leverage technology like Apache Flink and Apache NiFi to promote low latency processing of high-volume, high-velocity data. Hello Dinesh, thank you for joining us for Part II of our Q&A on streaming data.

Data 81

Data Banking Architecture Fashion 81

Netflix Tech

OCTOBER 28, 2021

I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay. Over the years, I followed the big data open-source community and Netflix tech blogs closely, and learned a lot about Netflix’s innovative engineering solutions and active contributions to the open-source ecosystem.

Data Engineering 69

Data Engineering Engineering Data Software Engineering 69

Instaclustr

JUNE 4, 2019

At Instaclustr, we constantly push ourselves to test the limits of the performance and scalability of the open source technologies our Managed Platform offers. If you are looking for a business metric, from the business application standpoint, here it is – The system processed a massive 19 Billion events per day (19 x 10^9).

Scalability 29

Scalability Open Source AWS Applications 29

Bernd Rucker

JUNE 23, 2020

How to understand your choreography using process events monitoring Enterprises that use event-driven microservices often suffer from a lack of visibility into processes that cross the boundary of one individual microservice. In this blog post I will introduce process events monitoring as possible remedy.

Microservices 52

Microservices Architecture Retail Examples 52

Netflix Tech

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Data 77

Data Microservices Transportation Systems Review 77

Confluent

AUGUST 29, 2019

We know that Apache Kafka ® is great when you’re dealing with streams, allowing you to conveniently look at streams as tables. Kafka already allows you to look at data as streams or tables; graphs are a third option, a more natural representation with a lot of grounding in theory for some use cases. 8, and so on.

Social 55

Social Network Applications Cloud 55

Datavail

JULY 14, 2022

It is constantly feeding corporate databanks with up-to-the-minute information, yet because its flow is transitory, the intelligence it offers isn’t available for use until after it’s been captured, cleaned, and integrated into standard data analysis programs. Streaming data is one such asset. Understand the Status of your Data.

Data 52

Data AWS Analytics Programming 52

Altexsoft

FEBRUARY 11, 2020

You’ll also be introduced to nine open-source tools you can use to automate and streamline your incident response processes. Ideally, you can use incident response processes and tools to prevent incidents from occurring. You can use Wazuh in a Docker container or on Linux, Windows, and macOS systems. GRR Rapid Response.

Tools 109

Tools Linux Analysis Open Source 109

TIBCO - Connected Intelligence

MAY 12, 2021

This month’s TIBCO tips blog is all about data, data, data. May Analytics Event Streaming Directly to You. This month, the TIBCO Analytics team is excited to bring you an event aimed at helping you along your analytics journey. This event will be very informative, and we hope to see you there. Reading Time: 2 minutes.

Data 26

Data Software Review Analytics Transportation 26

Cloudera

OCTOBER 28, 2020

From this, a question arises: how do we facilitate this need to filter logs to only that which a particular team or user would find useful? Converting flows to records and filtering using SQL. Extracting variables and filtering using NiFi expression language. The workflow that will be discussed assumes the use of a CDP 7.1.x

Examples 64

Examples Groups Performance Applications 64

Honeycomb

JUNE 22, 2022

Debugging application performance in Azure AppService is something that’s quite difficult using Azure’s built-in services (like Application Insights). This is supplemental to the awesome post by Brian Langbecker on using Honeycomb to investigate the Application Load Balancers (ALB) Status Codes in AWS. What are HTTP Access Logs?

Azure 62

Azure Load Balancer Linux Software Review 62

Confluent

JULY 17, 2019

Together, MongoDB and Apache Kafka ® make up the heart of many modern data architectures today. Integrating Kafka with external systems like MongoDB is best done though the use of Kafka Connect. The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers.

eCommerce 21

eCommerce Architecture System Guidelines 21

Confluent

SEPTEMBER 26, 2019

In the early days, many companies simply used Apache Kafka ® for data ingestion into Hadoop or another data lake. However, Apache Kafka is more than just messaging. In the most critical use cases, every seconds counts. Apache Kafka as an event streaming platform for real-time analytics.

Analytics 21

Analytics Serverless Blockchain Microservices 21

Confluent

AUGUST 13, 2019

Yes, the other definition of event sourcing. At Kafka Summit SF, you’ll get to hear incredible keynotes from leading technologists, including Jay Kreps and Neha Narkhede , original co-creators of Apache Kafka ®. Nowhere else in the world will you find a larger concentration of Kafka community genius than here.

Conference 19

Conference Training Recruiting Meeting 19

TIBCO - Connected Intelligence

SEPTEMBER 7, 2020

This year’s event is about sustainable innovation and using data to find the next breakthrough for your most pressing business challenges. Choose from several registration options, including a no-cost package, for an event that works best for you. But how do you know which tool will be right for your business?

Data 26

Data Technical Review Systems Review Culture 26

Confluent

JUNE 26, 2019

I see this pattern coming up more and more in the field in conjunction with Apache Kafka ®. In these projects, microservice architectures use Kafka as an event streaming platform. Apache Kafka – An event streaming platform for microservices. This works well for many use cases.

Microservices 109

Microservices Software Review Technical Review Architecture 109

Confluent

MAY 30, 2019

Following part 1 and part 2 of the Spring for Apache Kafka Deep Dive blog series, here in part 3 we will discuss another project from the Spring team: Spring Cloud Data Flow , which focuses on enabling developers to easily develop, deploy, and orchestrate event streaming pipelines based on Apache Kafka ®.

Cloud 94

Cloud Data Applications Windows 94

Instaclustr

OCTOBER 13, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect , and what does it look like in Superset. Scaling Kafka Connect, Elasticsearch, and PostgreSQL Pipelines.

Performance 83

Performance Metrics Systems Review Testing 83

Cloudera

OCTOBER 17, 2023

Recently, Confluent hosted Current 2023 (formerly Kafka summit) in San Jose on Sept 26th and 27th. With few conferences curating content specific to streaming developers, Current has historically been an important event for anyone trying to keep a pulse on what’s happening in the streaming space. Expecting a product to be GA’d.

Technical Review 75

Technical Review Generative AI Conference Open Source 75

Bernd Rucker

NOVEMBER 18, 2019

How and why to bring workflow to Apache Kafka In the last year I had a lot of contact with the community around Kafka and Confluent (the company behind Apache Kafka)?—?a Some have Kafka in production already, at the heart of their company. I will briefly introduce the products and explain joint use cases.

Microservices 8

Microservices Architecture Scalability Course 8

Cloudera

AUGUST 10, 2022

Cloudera Stream Processing (CSP), powered by Apache Flink and Apache Kafka, provides a complete stream management and stateful processing solution. In CSP, Kafka serves as the storage streaming substrate, and Flink as the core in-stream processing engine that supports SQL and REST interfaces. Apache Kafka and SMM.

Applications 86

Applications Scalability Examples Data 86

Cloudera

JUNE 17, 2022

In the second blog of the Universal Data Distribution blog series , we explored how Cloudera DataFlow for the Public Cloud (CDF-PC) can help you implement use cases like data lakehouse and data warehouse ingest, cybersecurity, and log optimization, as well as IoT and streaming data collection.

Load Balancer 89

Load Balancer Data Scalability Data Center 89

Altexsoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it.

Weak Development Team 93

Weak Development Team Technical Review Systems Review Software Review 93