Remove how-to-increase-throughput-on-kafka-connect-source-connectors
article thumbnail

Kafka Connect and Elasticsearch vs. PostgreSQL Pipelines: Initial Performance Results (Pipeline Series Part 8)

Instaclustr

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect , and what does it look like in Superset. But how big is big enough?

article thumbnail

Change Data Capture (CDC) With Kafka Connect and the Debezium Cassandra Connector (Part 2)

Instaclustr

In Part 1 of this two-part blog series we discovered that Debezium is not a new metallic element (but the name was inspired by the periodic table), but a distributed open source CDC technology, and that CDC (in this context) stands for Change Data Capture (not Centers for Disease Control or the Control Data Corporation).

Data 68
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Kafka Connect and Elasticsearch vs. PostgreSQL Pipelines: Final Performance Results (Pipeline Series Part 9)

Instaclustr

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. Source: Shutterstock).

article thumbnail

Change Data Capture (CDC) With Kafka Connect and the Debezium Cassandra Connector (Part 1)

Instaclustr

Centers for Disease Control and Prevention ( cdc.gov ) has certainly been in the forefront of the news, and their Apache Kafka Covid-19 pipeline was the inspiration for my ongoing Kafka Connect streaming data pipeline series. using timestamps and/or monotonically increasing values), or internal database triggers.

Data 59
article thumbnail

ApacheCon, 9-12 September 2019, USA (Las Vegas) Report—a Look Back at Core, Complementary, and Competing Technologies

Instaclustr

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. We have talks in the Cassandra and Observability tracks, but I’m attending (and blogging about) talks in other tracks that have interesting or challenging use cases (e.g. Source: Shutterstock).

article thumbnail

ApacheCon, 9-12 September 2019, USA (Las Vegas) Report – a Look Back at Core, Complementary, and Competing Technologies

Instaclustr

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. . We have talks in the Cassandra and Observability tracks, but I’m attending (and blogging about) talks in other tracks that have interesting or challenging use cases (e.g.

article thumbnail

The Good and the Bad of Apache Kafka Streaming Platform

Altexsoft

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. What is Kafka? It offers high throughput, low latency, and scalability that meets the requirements of Big Data.