Remove Big Data Remove Journal Remove Microservices Remove Storage
article thumbnail

Microservices, Apache Kafka, and Domain-Driven Design

Confluent

Microservices have a symbiotic relationship with domain-driven design (DDD)—a design approach where the business domain is carefully modeled in software and evolved over time, independently of the plumbing that makes the system work. In these projects, microservice architectures use Kafka as an event streaming platform. Microservices.

article thumbnail

Machine Learning with Python, Jupyter, KSQL and TensorFlow

Confluent

This can either be built natively around the Kafka ecosystem, or you could use Kafka just for ingestion into another storage and processing cluster such as HDFS or AWS S3 with Spark. New MQTT input data can directly be used in real time to make predictions. Anomaly detection of IoT sensor data with a model embedded into a KSQL UDF.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How we built a highly scalable distributed state machine

Bernd Rucker

like a journal in accounting. Storage Zeebe writes the log to disk and RocksDB also flushes its state to disk. We regularly discuss making storage logic pluggable?—?for I contrasted this to traditional workflow engine architectures using a RDMS in part 1 of this blog post. Nothing will ever be changed once its written?—?like

article thumbnail

Real-Time Analytics and Monitoring Dashboards with Apache Kafka and Rockset

Confluent

Apache Kafka is an event streaming platform that combines messages, storage, and data processing. Kai’s main area of expertise lies within the fields of big data analytics, machine learning, integration, microservices, Internet of Things, stream processing, and blockchain.

article thumbnail

Journey to Event Driven – Part 2: Programming Models for the Event-Driven Architecture

Confluent

Do I need to use a microservices framework? Distributed object (RPC sync), service-oriented architecture (SOA), enterprise service bus (ESB), event-driven architecture (EDA), reactive programming to microservices and now FaaS have each built on the learnings of the previous. Event-driven architecture. Comparing persistence models.

article thumbnail

Internet of Things (IoT) and Event Streaming at Scale with Apache Kafka and MQTT

Confluent

Different teams can develop, maintain, and change integration to devices and machines without being dependent on other sources or the sink systems that process and analyze the data. Microservices, Apache Kafka, and Domain-Driven Design (DDD) covers this in more detail. Long-term storage and buffering. High throughput.

IoT 20