Remove Azure Remove Download Remove Firewall Remove SOA
article thumbnail

Egnyte Architecture: Lessons learned in building and scaling a multi petabyte content platform

High Scalability

SOA architecture based on REST APIs. Tens of petabytes of data stored in our servers and other object stores such as GCS, S3 and Azure Blobstore. Version5: files metadata in MySQL, files stored in EOS/GCS/S3/Azure and served via HTTP, search in Lucene. Data interdependence. Level of concurrent reads. Level of concurrent writes.

article thumbnail

The Rise of Managed Services for Apache Kafka

Confluent

Cloud Memorystore, Amazon ElastiCache, and Azure Cache), applying this concept to a distributed streaming platform is fairly new. There are different connectors available, such as ActiveMQ, HDFS, JDBC, Salesforce, cloud storage (GCP, Azure, and AWS), IBM MQ, and RabbitMQ, to name a few. This is no easy task.