Instaclustr

JUNE 4, 2019

In the past few months, our Technology Evangelist, Paul Brebner has been relentlessly testing the limits of massive-scale deployment of a data pipeline consisting of Apache Kafka and Apache Cassandra on the Instaclustr Managed Platform in conjunction with an example Anomaly detection application running on a Kubernetes cluster deployed on AWS EKS.

Scalability 29

Scalability Open Source AWS Applications 29

Linux Academy

APRIL 30, 2019

Stay tuned to the Linux Academy blog for further details. In the end, you should have a grasp of how to program. Monitoring Kubernetes with Prometheus — Are you interested in deploying Prometheus to Kubernetes? Linux Study Group in May. What do you do next? Ways to participate in the study group: 1) Watch – [link].

Linux 113

Linux AWS Big Data Course 113

Linux Academy

MAY 28, 2019

Stay tuned to the Linux Academy blog for further details. By the end of this course, you will have a solid understanding of how network routing works and how networking decisions are made. Students will also learn how to use deployment slots as staging environments for web apps, which can then be swapped into production when needed.

Linux 104

Linux AWS Azure Technical Review 104

Linux Academy

JUNE 25, 2019

Stay tuned to the Linux Academy blog for details! DevOps Monitoring Deep Dive. We use Prometheus, AlertManager, and Grafana to demonstrate monitoring concepts that we can use on any monitoring stack. To continually support you in your mission to learn and grow we are always adding new courses and resources.

Linux 60

Linux Course Cloud Google Cloud 60

Cloudera

SEPTEMBER 11, 2018

Last week Cloudera introduced an open end-to-end architecture for IoT and the different components needed to help satisfy today’s enterprise needs regarding operational technology (OT), information technology (IT), data analytics and machine learning (ML), along with modern and traditional application development, deployment, and integration.

IoT 40

IoT Machine Learning Artificial Inteligence Data 40

Linux Academy

APRIL 29, 2019

Stay tuned to the Linux Academy blog for further details. In the end, you should have a grasp of how to program. Monitoring Kubernetes with Prometheus — Are you interested in deploying Prometheus to Kubernetes? Linux Study Group in May. What do you do next? Ways to participate in the study group: 1) Watch – [link].

Linux 60

Linux AWS Big Data Course 60

Cloudera

FEBRUARY 28, 2024

This blog post walks you through how you can use prefixless replication with Streams Replication Manager (SRM) to aggregate Kafka topics from multiple sources. If not, you can check out this related blog post. All clusters contain Kafka. Security setup and other advanced configurations are not discussed.

Testing 68

Testing Big Data Tools Data 68

Altexsoft

OCTOBER 21, 2022

Kafka can continue the list of brand names that became generic terms for the entire type of technology. In this article, we’ll explain why businesses choose Kafka and what problems they face when using it. What is Kafka? How Apache Kafka streams relate to Franz Kafka’s books. What Kafka is used for.

Weak Development Team 93

Weak Development Team Technical Review Systems Review Software Review 93

Confluent

JUNE 18, 2019

Distributed transactions are very hard to implement successfully, which is why we’ll introduce a log-inspired system such as Apache Kafka ®. Distributed transactions are very hard to implement successfully, which is why we’ll introduce a log-inspired system such as Apache Kafka ®. Direct indexing.

Scalability 96

Scalability Architecture Machine Learning Artificial Inteligence 96

Instaclustr

APRIL 29, 2019

In this tenth and final blog of the Anomalia Machina series we tune the anomaly detection system and succeed in scaling the application out from 3 to 48 Cassandra nodes, and get some impressive numbers: 574 CPU cores (across Cassandra, Kafka, and Kubernetes clusters), 2.3 Odysseus’s final challenge was to regain his throne!

Scalability 49

Scalability Systems Review Metrics AWS 49

Cloudera

MARCH 15, 2023

In this post, I will demonstrate how to use the Cloudera Data Platform (CDP) and its streaming solutions to set up reliable data exchange in modern applications between high-scale microservices, and ensure that the internal state will stay consistent even under the highest load. Introduction Many modern application designs are event-driven.

Data 87

Data Microservices Storage Applications 87

Altexsoft

NOVEMBER 7, 2022

But apparently, things were much more difficult before Apache Airflow appeared. What is Apache Airflow? Apache Airflow is an open-source Python -based workflow orchestrator that enables you to design, schedule, and monitor data pipelines. Source: Apache Airflow. Source: Apache Airflow.

Weak Development Team 52

Weak Development Team Technical Review Software Review Systems Review 52

Confluent

MAY 22, 2019

In light of this, we’ll share an emerging machine-to-machine (M2M) architecture pattern in which MQTT, Apache Kafka ® , and Scylla all work together to provide an end-to-end IoT solution. This growth depends greatly on the overall reliability and scalability of IoT deployments. trillion by 2024.

IoT 97

IoT Google Cloud Scalability Microservices 97

Instaclustr

AUGUST 11, 2021

In Part 1 of this two-part blog series we discovered that Debezium is not a new metallic element (but the name was inspired by the periodic table), but a distributed open source CDC technology, and that CDC (in this context) stands for Change Data Capture (not Centers for Disease Control or the Control Data Corporation).

Data 68

Data Systems Review Scalability Off-The-Shelf 68

Bernd Rucker

APRIL 6, 2020

Webinar FAQ for Monitoring & Orchestrating Your Microservices Landscape using Workflow Automation Answering leftover questions from my webinar in March 2020 On Wednesday, March 11, 2020, I conducted the webinar titled “ Monitoring & Orchestrating Your Microservices Landscape using Workflow Automation ”.

Microservices 52

Microservices Architecture Technical Review Engineering 52

Cloudera

AUGUST 20, 2021

The Cloudera Data Platform comprises a number of ‘data experiences’ each delivering a distinct analytical capability using one or more purposely-built Apache open source projects such as Apache Spark for Data Engineering and Apache HBase for Operational Database workloads.

Strategy 94

Strategy Data Technical Review Weak Development Team 94

Linux Academy

JULY 30, 2019

Likewise, the materials covered will equip you with hands-on experience of various AWS services dealing with encryption, monitoring, and auditing. To continually support you in your mission to learn and grow we are always adding new courses and resources. Join our dedicated study group and we’ll help you pass the exam.

Linux 12

Linux Course AWS Google Cloud 12

Instaclustr

AUGUST 4, 2021

Centers for Disease Control and Prevention ( cdc.gov ) has certainly been in the forefront of the news, and their Apache Kafka Covid-19 pipeline was the inspiration for my ongoing Kafka Connect streaming data pipeline series. So when colleagues at work recently mentioned CDC for databases I was initially perplexed. (2)

Data 59

Data Open Source Analytics System 59

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. The Apache Software Foundation has been around since 1999 when it started out with a single project, their “Apache” HTTP Server. Countdown begins: The week before ApacheCon.

Technical Review 36

Technical Review Technology Report Open Source 36

Instaclustr

OCTOBER 14, 2019

This blog provides a brief of things I learnt during the 4-day event, including a summary of talks I attended and presented. . The Apache Software Foundation has been around since 1999 when it started out with a single project, their “Apache” HTTP Server. Countdown begins: The week before ApacheCon.

Technical Review 28

Technical Review Technology Report Open Source 28

Confluent

SEPTEMBER 20, 2019

As a distributed system for collecting, storing, and processing data at scale, Apache Kafka ® comes with its own deployment complexities. Luckily for on-premises scenarios, a myriad of deployment options are available, such as the Confluent Platform which can be deployed on bare metal, virtual machines, containers, etc.

Software Review 21

Software Review Technical Review Storage Cloud 21

Confluent

OCTOBER 10, 2019

Apache Kafka ® and its surrounding ecosystem, which includes Kafka Connect, Kafka Streams, and KSQL, have become the technology of choice for integrating and processing these kinds of datasets. Confluent Platform and Confluent Cloud are already used in many IoT deployments, both in Consumer IoT and Industrial IoT (IIoT).

IoT 20

IoT Internet Weak Development Team Scalability 20

Confluent

MAY 9, 2019

Deployment model. Yes, we can transact across partitions in Apache Kafka ® , and with traditional database transactions you get many “trust” semantics for free; however, they are pushed down into the database runtime. Event-first thinking enables us to build a new atomic unit: the event. Four pillars of event streaming.

Microservices 93

Microservices Metrics Systems Review Architecture 93

Confluent

AUGUST 19, 2019

This post specifically outlines the process by which we verify partner integrations, and is a means of letting the world know about our partner’s contributions to our connector ecosystem. It points to best practices for anyone writing Kafka Connect connectors. Over the years, we’ve since seen wide adoption of Kafka Connect.

Programming 15

Programming Software Review Technical Review Systems Review 15

Confluent

OCTOBER 24, 2019

I’ve written an event sourcing bank simulation in Clojure (a lisp build for Java virtual machines or JVMs) called open-bank-mark , which you are welcome to read about in my previous blog post explaining the story behind this open source example. The bank application. Either way, both are accomplished with event sourcing.

Banking 18

Banking Software Review Testing Applications 18

Confluent

AUGUST 14, 2019

For Apache Kafka ® , in which services read configuration files on startup, the question arises: how should you protect these secrets? Now you can deploy end-to-end Secret Protection in your production event pipeline, including the brokers, Connect, KSQL, Confluent Schema Registry, Confluent Control Center, Confluent REST Proxy, etc.

Examples 12

Examples Software Review Backup Linux 12

Cloudera

JUNE 16, 2022

In 2015, Cloudera became one of the first vendors to provide enterprise support for Apache Kafka, which marked the genesis of the Cloudera Stream Processing (CSP) offering. Today, CSP is powered by Apache Flink and Kafka and provides a complete, enterprise-grade stream management and stateful processing solution.

Data 83

Data Disaster Recovery Analytics Microservices 83