Confluent

MAY 29, 2019

In part 1 , we discussed an event streaming architecture that we implemented for a customer using Apache Kafka ® , KSQL from Confluent, and Kafka Streams. In part 3, we’ll explore using Gradle to build and deploy KSQL user-defined functions (UDFs) and Kafka Streams microservices. Introduction. KSQL primer.

Groups 95

Groups Windows Testing Microservices 95

Instaclustr

AUGUST 11, 2021

In Part 1 of this two-part blog series we discovered that Debezium is not a new metallic element (but the name was inspired by the periodic table), but a distributed open source CDC technology, and that CDC (in this context) stands for Change Data Capture (not Centers for Disease Control or the Control Data Corporation).

Data 68

Data Systems Review Scalability Off-The-Shelf 68

Confluent

MAY 9, 2019

Storing events in a stream and connecting streams via stream processors provide a generic, data-centric, distributed application runtime that you can use to build ETL, event streaming applications, applications for recording metrics and anything else that has a real-time data requirement. Four pillars of event streaming.

Microservices 93

Microservices Metrics Systems Review Architecture 93

Cloudera

JULY 26, 2021

The irreversible shift towards digital-native / digital-first consumption , working and learning paradigms has introduced new remote or hybrid working. The proliferation of real-time processing by deploying event-driven architectures (e.g., hybrid or public, multi-cloud) and advanced analytical frameworks (e.g.,

Strategy 114

Strategy Development Data Analytics 114

Bernd Rucker

APRIL 6, 2020

I want to answer all open questions in this blog post. There is not a simple answer to that. you can find one example in Create Readable Process Models. Q: Does the Camunda Process Engine in its open-source version supports the entire and complete BPMN 2.0 Some of them were answered, but a lot of them were not.

Microservices 52

Microservices Architecture Technical Review Engineering 52

Henrik Warne

JULY 27, 2019

I really like the mix of references – some are to computer science papers from the 1970s and onwards, and many are to various blog posts. Kleppmann starts by creating a simple database in 2 lines of bash code. The B-tree structure was introduced in 1970 by Rudolf Bayer and Edward McCreight at Boeing.

Systems Review 214

Systems Review Software Review Applications Data 214

Altexsoft

NOVEMBER 7, 2022

The tool represents processes in the form of directed acyclic graphs which visualize casual relationships between tasks and the order of their execution. Airflow is not a data processing tool by itself but rather an instrument to manage multiple components of data processing. What is Apache Airflow? Airflow webserver.

Weak Development Team 52

Weak Development Team Technical Review Software Review Systems Review 52

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. The conference spreads over 4 days next week with a great choice of presentations in multiple tracks including: Cassandra, IoT, Geospatial, Streaming, Machine Learning, and Observability! Source: Paul Brebner).

Technical Review 36

Technical Review Technology Report Open Source 36

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. . The conference spreads over 4 days next week with a great choice of presentations in multiple tracks including: Cassandra, IoT, Geospatial, Streaming, Machine Learning, and Observability! How good is that!

Technical Review 28

Technical Review Technology Report Open Source 28

Confluent

SEPTEMBER 20, 2019

As a distributed system for collecting, storing, and processing data at scale, Apache Kafka ® comes with its own deployment complexities. To simplify all of this, different providers have emerged to offer Apache Kafka as a managed service. Before Confluent Cloud was announced , a managed service for Apache Kafka did not exist.

Software Review 21

Software Review Technical Review Storage Cloud 21

O'Reilly Media - Ideas

JANUARY 25, 2024

That change is important because event-driven architecture is a tool for designing large systems that have to ingest data from many different streams in real time. Rachel Stephens provides two fascinating pieces of the puzzle in a recent article on the RedMonk blog , but those pieces don’t fit together exactly.

Trends 116

Trends Technical Review Technology Artificial Inteligence 116

Confluent

JULY 31, 2019

Delivers the new Confluent Operator for cloud-native automation on Kubernetes, a redesigned Confluent Control Center user interface to simplify how you manage event streams, and a preview of Role-Based Access Control for enterprise-grade security. Automate Kafka operations for production environments.

Open Source 19

Open Source Authentication Cloud Resources 19

Confluent

SEPTEMBER 13, 2019

Static Membership is an enhancement to the current rebalance protocol that aims to reduce the downtime caused by excessive and unnecessary rebalances for general Apache Kafka ® client implementations. This applies to Kafka consumers, Kafka Connect, and Kafka Streams. Take a Kafka consumer, for example.

Cloud 21

Cloud Groups Software Review Applications 21

Confluent

AUGUST 1, 2019

The Kafka Streams API boasts a number of capabilities that make it well suited for maintaining the global state of a distributed system. At Imperva, we took advantage of Kafka Streams to build shared state microservices that serve as fault-tolerant, highly available single sources of truth about the state of objects in our system.

Microservices 20

Microservices Systems Review System Software Review 20

Altexsoft

MAY 14, 2021

Not only does Big Data apply to the huge volumes of continuously growing data that come in different formats, but it also refers to the range of processes, tools, and approaches used to gain insights from that data. Also, we’ll introduce you to the popular Big Data analytics tools and existing use cases. Key Big Data characteristics.

Big Data 78

Big Data Analytics Tools Applications 78

Confluent

AUGUST 19, 2019

This post specifically outlines the process by which we verify partner integrations, and is a means of letting the world know about our partner’s contributions to our connector ecosystem. It points to best practices for anyone writing Kafka Connect connectors. Over the years, we’ve since seen wide adoption of Kafka Connect.

Programming 15

Programming Software Review Technical Review Systems Review 15

Confluent

OCTOBER 24, 2019

I’ve written an event sourcing bank simulation in Clojure (a lisp build for Java virtual machines or JVMs) called open-bank-mark , which you are welcome to read about in my previous blog post explaining the story behind this open source example. Also, there are several functions wrapping the Java clients for Kafka.

Banking 18

Banking Software Review Testing Applications 18

Netflix Tech

NOVEMBER 3, 2023

Democratizing Stream Processing @ Netflix By Guil Pires , Mark Cho , Mingliang Liu , Sujay Jain Data powers much of what we do at Netflix. On the Data Platform team, we build the infrastructure used across the company to process data at scale. The Processors themselves are implemented as Flink jobs that use the DataStream API.

Data 106

Data Engineering Construction Infrastructure 106