Confluent

MAY 30, 2019

Following part 1 and part 2 of the Spring for Apache Kafka Deep Dive blog series, here in part 3 we will discuss another project from the Spring team: Spring Cloud Data Flow , which focuses on enabling developers to easily develop, deploy, and orchestrate event streaming pipelines based on Apache Kafka ®.

Cloud 93

Cloud Data Applications Windows 93

Honeycomb

NOVEMBER 30, 2021

When you send telemetry into Honeycomb, our infrastructure needs to buffer your data before processing it in our “retriever” columnar storage database. For the entirety of Honeycomb’s existence, we have used Apache Kafka to perform this buffering function in our observability pipeline. Adapting Kafka for our use case.

AWS 145

AWS Storage Technical Review Hardware 145

Bernd Rucker

NOVEMBER 18, 2019

How and why to bring workflow to Apache Kafka In the last year I had a lot of contact with the community around Kafka and Confluent (the company behind Apache Kafka)?—?a For example, at Kafka Summit New York City earlier this year, I was impressed how many big banks attended, that currently modernize their architecture.

Microservices 8

Microservices Architecture Scalability Course 8

Confluent

JUNE 26, 2019

I see this pattern coming up more and more in the field in conjunction with Apache Kafka ®. In these projects, microservice architectures use Kafka as an event streaming platform. Apache Kafka – An event streaming platform for microservices. Store streams of events in a fault-tolerant way. Microservices.

Microservices 109

Microservices Software Review Technical Review Architecture 109

Altexsoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. Similar to Google in web browsing and Photoshop in image processing, it became a gold standard in data streaming, preferred by 70 percent of Fortune 500 companies. What is Kafka? What Kafka is used for.

Weak Development Team 93

Weak Development Team Technical Review Systems Review Software Review 93

Confluent

JUNE 11, 2019

For event streaming application developers, it is important to continuously update the streaming pipeline based on the need for changes in the individual applications in the pipeline. It is also important to understand some of the common streaming topologies that streaming developers use to build an event streaming pipeline.

Continuous Delivery 84

Continuous Delivery Applications Cloud Construction 84

O'Reilly Media - Ideas

JANUARY 25, 2024

Before that, cloud computing itself took off in roughly 2010 (AWS was founded in 2006); and Agile goes back to 2000 (the Agile Manifesto dates back to 2001, Extreme Programming to 1999). The data used in this report covers January through November in 2022 and 2023. This change is apparently not an error in the data.

Trends 116

Trends Technical Review Technology Artificial Inteligence 116

Bernd Rucker

APRIL 6, 2020

I want to answer all open questions in this blog post. Q: Does the Camunda Process Engine in its open-source version supports the entire and complete BPMN 2.0 In the orchestration scenario I used the Camunda engine within the order fulfillment microservice. The workflow engine can wait, e.g. until a response or event happens?—?potentially

Microservices 52

Microservices Architecture Technical Review Engineering 52

Perficient

MARCH 7, 2024

Kafka , of course, but also Samza and Voldemoort and a bunch of Hadoop tools like DataFu and Gobblin. Lots of companies offer data lakehouses. It seemed like LinkedIn was using Cloudera ‘s terminology with ‘open’ data lakehouse. Data Plane LinkedIn uses blob storage and HDFS for their data storage.

Open Source 52

Open Source Storage Comparison Policies 52

Confluent

MAY 22, 2019

In light of this, we’ll share an emerging machine-to-machine (M2M) architecture pattern in which MQTT, Apache Kafka ® , and Scylla all work together to provide an end-to-end IoT solution. The explosive number of devices generating, tracking and sharing data across a variety of networks is overwhelming to most data management solutions.

IoT 96

IoT Google Cloud Scalability Microservices 96

Altexsoft

NOVEMBER 7, 2022

You can hardly compare data engineering toil with something as easy as breathing or as fast as the wind. The platform went live in 2015 at Airbnb, the biggest home-sharing and vacation rental site, as an orchestrator for increasingly complex data pipelines. How data engineering works. What is Apache Airflow?

Weak Development Team 52

Weak Development Team Technical Review Software Review Systems Review 52

Cloudera

AUGUST 20, 2021

How CDP Enables and Accelerates Data Product Ecosystems. A multi-purpose platform focused on diverse value propositions for data products. As a result, CDP-enabled data products can meet multiple and varying functional and non-functional requirements that correspond to product attributes, each fulfilling specific customer needs.

Strategy 94

Strategy Data Technical Review Weak Development Team 94

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. The conference spreads over 4 days next week with a great choice of presentations in multiple tracks including: Cassandra, IoT, Geospatial, Streaming, Machine Learning, and Observability! Source: Paul Brebner).

Technical Review 36

Technical Review Technology Report Open Source 36

Confluent

SEPTEMBER 20, 2019

As a distributed system for collecting, storing, and processing data at scale, Apache Kafka ® comes with its own deployment complexities. To simplify all of this, different providers have emerged to offer Apache Kafka as a managed service. Before Confluent Cloud was announced , a managed service for Apache Kafka did not exist.

Software Review 21

Software Review Technical Review Storage Cloud 21

TIBCO - Connected Intelligence

JUNE 11, 2020

Apache Kafka seems to be the standard solution in event-driven architecture nowadays, but we should focus on whether it is the right choice for our needs. This blog summarizes my original post on Medium.com. However, Apache Kafka has some challenges in today’s cloud-native world because it doesn’t follow all of its rules.

Open Source 26

Open Source Microservices Architecture Storage 26

TIBCO - Connected Intelligence

MARCH 18, 2020

TIBCO Data Science was just named a Leader in the 2020 Gartner Magic Quadrant for Data Science and Machine Learning Platforms. Among the leaders, TIBCO Data Science stood out particularly on the dimension labeled Completeness of Vision in this MQ. As an example, see our blog on how TIBCO is leading in data management.

Artificial Inteligence 34

Artificial Inteligence Machine Learning Analytics Big Data 34

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. . The conference spreads over 4 days next week with a great choice of presentations in multiple tracks including: Cassandra, IoT, Geospatial, Streaming, Machine Learning, and Observability!

Technical Review 28

Technical Review Technology Report Open Source 28

Confluent

JULY 31, 2019

Delivers the new Confluent Operator for cloud-native automation on Kubernetes, a redesigned Confluent Control Center user interface to simplify how you manage event streams, and a preview of Role-Based Access Control for enterprise-grade security. Automate Kafka operations for production environments.

Open Source 19

Open Source Authentication Cloud Resources 19

Confluent

OCTOBER 10, 2019

A key challenge, however, is integrating devices and machines to process the data in real time and at scale. Apache Kafka ® and its surrounding ecosystem, which includes Kafka Connect, Kafka Streams, and KSQL, have become the technology of choice for integrating and processing these kinds of datasets.

IoT 20

IoT Internet Weak Development Team Scalability 20

Bernd Rucker

JULY 18, 2019

Say hello to cloud-native workflow automation?—?part a horizontally scalable distributed workflow engine I explained that Zebee is a super performant, highly scalable and resilient cloud-native workflow engine (yeah?—?buzzwords I revealed that Zeebe plays in the same league as e.g. Apache Kafka.

Scalability 42

Scalability Data Center Data Engineering 42

Confluent

JULY 3, 2019

From a data perspective, the World Cup represents an interesting source of information. The idea in this blog post is to mix information coming from two distinct channels: the RSS feeds of sport-related newspapers and Twitter feeds of the FIFA Women’s World Cup. Data sources. Ingesting Twitter data. connector.state].

Analysis 21

Analysis Data Sport Windows 21

Confluent

AUGUST 19, 2019

It points to best practices for anyone writing Kafka Connect connectors. In a nutshell, the document states that sources and sinks are verified as Gold if they’re functionally equivalent to Kafka Connect connectors. Over the years, we’ve since seen wide adoption of Kafka Connect.

Programming 15

Programming Software Review Technical Review Systems Review 15

TIBCO - Connected Intelligence

SEPTEMBER 30, 2021

The six capabilities delineated by Lehtipalo over the course of the presentation were: Democratized analytics accessible to all Continuous, real-time analytics ModelOps Data Science Hyperconverged analytics Cloud-native deployment technologies. But also a real transformation in #DataCulture. Michael O’Connell.

Analytics 49

Analytics Innovation Machine Learning Artificial Inteligence 49