Cloudera

APRIL 9, 2021

This is part 4 in this blog series. This blog series follows the manufacturing and operations data lifecycle stages of an electric car manufacturer – typically experienced in large, data-driven manufacturing companies. The second blog dealt with creating and managing Data Enrichment pipelines.

Machine Learning 98

Machine Learning Artificial Inteligence Data Data Engineering 98

Cloudera

MARCH 14, 2023

We just announced the general availability of Cloudera DataFlow Designer , bringing self-service data flow development to all CDP Public Cloud customers. In our previous DataFlow Designer blog post , we introduced you to the new user interface and highlighted its key capabilities.

Agile 80

Agile Development Data Serverless 80

Instaclustr

SEPTEMBER 28, 2021

In the last installment of the pipeline blog series , we explored writing streaming JSON data into PostgreSQL using Kafka Connect. In this blog, it’s time to find out if our fears of encountering mutant monsters in the gloom of an abandoned uranium mine were warranted or not. What Is Apache Superset?

Data 68

Data Virtualization Metrics Open Source 68

Cloudera

OCTOBER 13, 2020

On September 24, 2019, Cloudera launched CDP Public Cloud (CDP-PC) as the first step in delivering the industry’s first Enterprise Data Cloud. CDP Machine Learning: a kubernetes-based service that allows data scientists to deploy collaborative workspaces with secure, self-service access to enterprise data. That Was Then.

Cloud 90

Cloud Machine Learning Artificial Inteligence Azure 90

Flexagon

JANUARY 25, 2023

We increased our investment in support of enterprise software technologies with support for Oracle EBS on OCI (Oracle Cloud Infrastructure), Oracle Fusion Apps, SAP, and Salesforce continuing to address the inherent complexities and intricacies, simplifying the adoption speeding the development and delivery pipelines. With FlexDeploy 6.0

UI/UX 78

UI/UX Software Review Off-The-Shelf Azure 78

OpenCredo

NOVEMBER 22, 2023

Data is established as the driving force behind many industries today, and having a modern data architecture is pivotal for organizations to be successful. The first part of this blog is related to the Flink and S3 infra design. A tenant is the owner of the data. Good for streaming use cases. No S3 state backend.

Data 59

Data AWS Policies Compliance 59

Instaclustr

OCTOBER 18, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect, and what does it look like in Superset. Explosions were common on the TV show “ MythBusters ”!

Performance 84

Performance Comparison Systems Review Metrics 84

Cloudera

DECEMBER 9, 2022

Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Now, we shift focus on the needs of developers and addressing the challenges they face when building dataflows in the cloud.

Testing 95

Testing Azure Cloud AWS 95

Confluent

MARCH 26, 2019

We will cover Kafka clients, Kafka Streams applications, Kafka Connect pipelines and KSQL. The translation service, on the other hand, receives a call to the translate operation and records tracing data. A distributed tracing system is designed to collect, process and store tracing data to be queried and visualized later.

Applications 111

Applications Transportation Architecture Open Source 111

Confluent

APRIL 18, 2019

Frehse and his team are using Confluent Cloud and associated IoT technologies to build a data-driven food value chain for all their partners from farm to fork. By capturing data throughout the chain, BAADER can give factories the ability to improve animal welfare, track trucks and identify machines that need maintenance.

IoT 82

IoT Industry Cloud Retail 82

Honeycomb

JUNE 22, 2022

Among some of the issues are visualizations, and the time it takes to be able to query data. This data can be very useful to understand the usage of your site. Azure Event Hubs is a streaming event service that is compatible with Apache Kafka. And we’re now done setting up the Logs pipeline. Let’s get started.

Azure 64

Azure Load Balancer Linux Software Review 64

Netflix Tech

OCTOBER 7, 2021

However, Netflix is available for streaming on thousands of types of devices and it is powered by hundreds of micro-services which are deployed independently, making it extremely challenging to comprehensively test internally. At Netflix, we have significant investments in ensuring new versions of our applications are well tested.

Applications 79

Applications Metrics Testing Analysis 79

Altexsoft

FEBRUARY 11, 2023

Data is now one of the most valuable assets for any kind of business. The 11th annual survey of Chief Data Officers (CDOs) and Chief Data and Analytics Officers reveals 82 percent of organizations are planning to increase their investments in data modernization in 2023. What is a data architect?

Data 87

Data Data Engineering Big Data Architecture 87

Cloudera

SEPTEMBER 9, 2020

This blog post will present a simple “hello world” kind of example on how to get data that is stored in S3 indexed and served by an Apache Solr service hosted in a Data Discovery and Exploration cluster in CDP. We will only cover AWS and S3 environments in this blog. Index your Data.

Data 81

Data How To AWS Resources 81

Netflix Tech

AUGUST 30, 2021

By Benson Ma , Alok Ahuja Introduction At Netflix, hundreds of different device types, from streaming sticks to smart TVs, are tested every day through automation to ensure that new software releases continue to deliver the quality of the Netflix experience that our customers enjoy. In this blog post, we will focus on the latter feature set.

Software Review 85

Software Review Systems Review Windows Testing 85

Cloudera

SEPTEMBER 1, 2020

What is ‘Data Discovery and Exploration’ in CDP Data Hub? The Data Discovery and Exploration (DDE) template in CDP Data Hub was released as Tech Preview a few weeks ago. DDE is a new template flavor within CDP Data Hub in Cloudera’s public cloud deployment option (CDP PC). data best served through Apache Solr).

Data 66

Data Backup Disaster Recovery Storage 66

Kentik

AUGUST 28, 2019

Streaming telemetry is no longer an unfamiliar term in the network monitoring realm. In fact, interest in streaming telemetry is increasing over recent years, while SNMP (Simple Network Management Protoco) is falling, according to Google Trends: What is Streaming Telemetry? Streaming Telemetry: Where are We Now?

Network 52

Network Analytics Metrics Technical Review 52

Confluent

AUGUST 29, 2019

We know that Apache Kafka ® is great when you’re dealing with streams, allowing you to conveniently look at streams as tables. Stream processing engines like KSQL furthermore give you the ability to manipulate all of this fluently. You can use this as an example of how to add graph abilities to any event streaming application.

Social 55

Social Network Applications Cloud 55

Altexsoft

OCTOBER 6, 2021

Another plus is that SAST is easy to implement – it’s quite easy to add a static scanner to your development pipeline and IDE. The ability to build customized reports adds an extra layer of visualization to the process, making risky code easier to track and facilitating the remediation routine. Global SAST market.

Applications 52

Applications Testing Tools Software Review 52

Xebia

AUGUST 9, 2023

Design Process Clarify requirements Frame problem as an ML task Identify data sources and their availability Model development Serve predictions Observability Iterate on your design What is Machine Learning System Design? The isolated building blocks are the individual applications that will run within your system.

System Design 130

System Design Systems Review System Machine Learning 130

Confluent

MAY 30, 2019

Following part 1 and part 2 of the Spring for Apache Kafka Deep Dive blog series, here in part 3 we will discuss another project from the Spring team: Spring Cloud Data Flow , which focuses on enabling developers to easily develop, deploy, and orchestrate event streaming pipelines based on Apache Kafka ®.

Cloud 93

Cloud Data Applications Windows 93

John Snow Labs

MAY 3, 2024

Pretrained AI pipelines streamline complex processes into a single line of code, offering easy access, superior performance, resource savings, smooth integration, and continuous updates. In this blog post, we’ll see that instead of creating long pipelines, we can achieve the same result with pre-trained pipelines.

Healthcare 52

Healthcare Analysis Artificial Inteligence Training 52

Kentik

AUGUST 28, 2019

Streaming telemetry is no longer an unfamiliar term in the network monitoring realm. Steaming telemetry uses a push-based mechanism with which data can be transmitted automatically and continuously from various remote sources (such as routers, switches, firewalls, etc.) Streaming Telemetry: Where are We Now? Core Technology.

Network 16

Network Analytics Metrics Technical Review 16

Cloudera

FEBRUARY 8, 2021

This is part 2 in this blog series. You can read part 1, here: Digital Transformation is a Data Journey From Edge to Insight. The first blog introduced a mock connected vehicle manufacturing company, The Electric Car Company (ECC), to illustrate the manufacturing data path through the data lifecycle.

Data 113

Data Technical Review Data Engineering Analysis 113

Altexsoft

MARCH 31, 2020

That means your website must quickly process lots of transactions involving small amounts of data like order ID and details, user ID, or credit card data. It means you must collect transactional data and move it from the database that supports transactions to another system that can handle large volumes of data.

Data 76

Data Storage Analytics Data Center 76

Altexsoft

FEBRUARY 10, 2021

Unless you meet it in the article saying that “only 13 percent data science projects make it into production.” This sounds really ominous — especially, for companies heavily investing in data-driven transformations. New approaches arise to speed up the transformation of raw data into useful insights.

Analytics 75

Analytics DevOps Development Software Review 75

Cloudera

OCTOBER 29, 2020

With the massive explosion of data across the enterprise — both structured and unstructured from existing sources and new innovations such as streaming and IoT — businesses have needed to find creative ways of managing their increasingly complex data lifecycle to speed time to insight.

Data 105

Data Machine Learning Artificial Inteligence Analytics 105

Altexsoft

MARCH 16, 2021

These devices are used to collect tons of various health and fitness-related data, such as daily activity, pulse, temperature, sleep patterns, and so on, all that in real time. But what happens to all the massive amounts of data from all these wearables and other medical and non-medical devices? Let’s see where it can come from.

Big Data 116

Big Data Healthcare Applications Data 116

Altexsoft

NOVEMBER 7, 2022

You can hardly compare data engineering toil with something as easy as breathing or as fast as the wind. The platform went live in 2015 at Airbnb, the biggest home-sharing and vacation rental site, as an orchestrator for increasingly complex data pipelines. How data engineering works. What is Apache Airflow?

Weak Development Team 52

Weak Development Team Technical Review Software Review Systems Review 52

Instaclustr

OCTOBER 13, 2021

In Part 6 and Part 7 of the pipeline series we took a different path in the pipe/tunnel and explored PostgreSQL and Apache Superset, mainly from a functional perspective—how can you get JSON data into PostgreSQL from Kafka Connect , and what does it look like in Superset. Scaling Kafka Connect, Elasticsearch, and PostgreSQL Pipelines.

Performance 83

Performance Metrics Systems Review Testing 83

Cloudera

AUGUST 10, 2022

Cloudera has a strong track record of providing a comprehensive solution for stream processing. Cloudera Stream Processing (CSP), powered by Apache Flink and Apache Kafka, provides a complete stream management and stateful processing solution. Cloudera Stream Processing Community Edition.

Applications 85

Applications Scalability Examples Data 85

Cloudera

MARCH 23, 2022

Please join us on March 24 for Future of Data meetup where we do a deep dive into Iceberg with CDP . By being a truly open table format, Apache Iceberg fits well within the vision of the Cloudera Data Platform (CDP). By being a truly open table format, Apache Iceberg fits well within the vision of the Cloudera Data Platform (CDP).

Data 88

Data Open Source Storage Machine Learning 88

Instaclustr

JULY 22, 2021

Having explored one fork in the path (Elasticsearch and Kibana) in the previous pipeline blog series ( here is part 5 ), in this blog we backtrack to the junction to explore the alternative path ( PostgreSQL and Apache Superset). Fork in an abandoned uranium mine (Source: Shutterstock). Step 2: Kafka and Kafka Connect Clusters.

Open Source 92

Open Source Data AWS Software Review 92

Honeycomb

NOVEMBER 30, 2021

When you send telemetry into Honeycomb, our infrastructure needs to buffer your data before processing it in our “retriever” columnar storage database. For the entirety of Honeycomb’s existence, we have used Apache Kafka to perform this buffering function in our observability pipeline. Let’s dive in.

AWS 145

AWS Storage Technical Review Hardware 145

Cloudera

AUGUST 16, 2021

We just announced Cloudera DataFlow for the Public Cloud (CDF-PC), the first cloud-native runtime for Apache NiFi data flows. In this blog post we’re revisiting the challenges that come with running Apache NiFi at scale before we take a closer look at the architecture and core features of CDF-PC.

Cloud 116

Cloud KPI Metrics Resources 116

Gorilla Logic

AUGUST 17, 2020

As DevOps teams optimize their continuous integration and continuous delivery (CI/CD) pipeline, they may struggle to identify and prioritize improvements that add value to the end customer. While the DevOps goal of reducing waste in the CI/CD pipeline is clear, identifying what is actually wasteful might not not be so easy.

Continuous Delivery 65

Continuous Delivery DevOps Software Review Technical Review 65

Altexsoft

OCTOBER 21, 2022

Similar to Google in web browsing and Photoshop in image processing, it became a gold standard in data streaming, preferred by 70 percent of Fortune 500 companies. Apache Kafka is an open-source, distributed streaming platform for messaging, storing, processing, and integrating large data volumes in real time.

Weak Development Team 93

Weak Development Team Technical Review Systems Review Software Review 93