Cloudera

JANUARY 15, 2021

Cloud data warehouses allow users to run analytic workloads with greater agility, better isolation and scale, and lower administrative overhead than ever before. DW1 is an anonymized cloud data warehouse running on AWS and DW2 is an anonymized data warehouse running on GCP. Overview of Cloudera Data Warehouse.

Performance 92

Performance Cloud Data Storage 92

Apps Associates

JULY 28, 2022

This blog introduces you to Oracle Cloud Infrastructure (OCI) Data Integration service and reviews how to setup Data Integration workspace in OCI. I love Data Integration in OCI and hope to get you excited about this great product as well. Data immersive user experience to boost productivity. Oracle Managed.

Infrastructure 52

Infrastructure Cloud Data Linux 52

Cloudera

FEBRUARY 12, 2024

In Cloudera deployments on public cloud, one of the key configuration elements is the DNS. Get it wrong and your deployment may become wholly unusable with users unable to access and use the Cloudera data services. In a Cloudera deployment scenario, only storage accounts, PostgreSQL DB, and Key Vault support service endpoints.

Azure 52

Azure Firewall Data Engineering Storage 52

Cloudera

FEBRUARY 1, 2024

The other half of the equation requires your team’s emphasis to shift to sustained excellence in managing and optimizing your data ecosystem — better known as Day 2 operations. In this blog, we’ll cover the highlights of our recently published Day 2 Operations Guide and why it matters to enterprises.

Backup 81

Backup Cloud Architecture Resources 81

Tenable

NOVEMBER 3, 2022

When our data engineering team was enlisted to work on Tenable One, we knew we needed a strong partner. When Tenable’s product engineering team came to us in data engineering asking how we could build a data platform to power the product, we knew we had an incredible opportunity to modernize our data stack.

Data 98

Data AWS Storage Data Engineering 98

Perficient

FEBRUARY 16, 2024

In the world of big data processing, efficient and scalable file systems play a crucial role. In this blog post, we’ll explore into what DBFS is, how it works, and provide examples to illustrate its usage. DBFS provides a unified interface to access data stored in various underlying storage systems. What is DBFS?

System 52

System Storage Azure Big Data 52

Perficient

FEBRUARY 28, 2023

This is the final blog in a series that explains how organizations can prevent their Data Lake from becoming a Data Swamp, with insights and strategy from Perficient’s Senior Data Strategist and Solutions Architect, Dr. Chuck Brooks. Once data is in the Data Lake, the data can be made available to anyone.

Data 110

Data Analytics Google Cloud Cloud 110

Erik Bernhardsson

DECEMBER 6, 2022

Please check it out — it lets you run things in the cloud without having to think about infrastructure. It's primarily meant for data teams. What can we do to make data teams 10x more productive when they write code? I wanted to build something that takes code on a user's computer and launches it in the cloud within a second.

CTO Coach 242

CTO Coach Fractional CTO Software Engineering Serverless 242

Cloudera

FEBRUARY 9, 2021

If you are new to Cloudera Operational Database, see this blog post. In this blog post, we’ll look at both Apache HBase and Apache Phoenix concepts relevant to developing applications for Cloudera Operational Database. On-premises: CDP Private Cloud Base. A column family is stored together in the storage. .

Applications 101

Applications Development Storage Database Administration 101

Hu's Place - HitachiVantara

NOVEMBER 11, 2018

Forbes believes it is an imperative for CIOs to view cloud computing as a critical element of their competitiveness. Cloud-based spending will reach 60% of all IT infrastructure and 60-70% of all software, services, and technology spending by 2020.

Cloud 78

Cloud Google Cloud Azure AWS 78

Altexsoft

FEBRUARY 11, 2023

Data architecture is the organization and design of how data is collected, transformed, integrated, stored, and used by a company. If you are not familiar with the above-mentioned concepts, we suggest you to follow the links above to learn more about each of them in our blog posts. Feel free to enjoy it.

Data 87

Data Data Engineering Big Data Architecture 87

InnovationM

MAY 14, 2023

In this article, I will share practical insights and technologies utilized in building and harnessing the potential of data lakes. Demystifying Data Lakes Data lakes serve as flexible storage repositories, enabling organizations to store raw and diverse data types, breaking away from the constraints of traditional data warehouses.

Data 52

Data Storage Construction Business Intelligence 52

Cloudera

SEPTEMBER 21, 2021

Many customers looking at modernizing their pipeline orchestration have turned to Apache Airflow, a flexible and scalable workflow manager for data engineers. A provider could be used to make HTTP requests, connect to a RDBMS, check file systems (such as S3 object storage), invoke cloud provider services, and much more.

Off-The-Shelf 95

Off-The-Shelf Data Engineering Virtualization Cloud 95

Cloudera

SEPTEMBER 29, 2020

Performance is one of the key, if not the most important deciding criterion, in choosing a Cloud Data Warehouse service. In today’s fast changing world, enterprises have to make data driven decisions quickly and for that they rely heavily on their data warehouse service. . Cloudera Data Warehouse vs HDInsight.

Azure 116

Azure Data Comparison Virtualization 116

Mobilunity

MAY 8, 2023

Key zones of an Enterprise Data Lake Architecture typically include ingestion zone, storage zone, processing zone, analytics zone, and governance zone. Ingestion zone is where data is collected from various sources and ingested into the data lake. Storage zone is where the raw data is stored in its original format.

Engineering 52

Engineering Data Storage AWS 52

Cloudera

NOVEMBER 6, 2017

A noteworthy point is that Cloudera complements popular cloud services, such as Amazon Web Services (AWS) and Microsoft Azure. The same enterprise capabilities delivered on premises are optimized for cloud environments, taking advantage of the elasticity and delivering the self-service desired.

Cloud 40

Cloud Azure Analytics AWS 40

Cloudera

DECEMBER 10, 2020

Why worry about costs with cloud-native data warehousing? Have you been burned by the unexpected costs of a cloud data warehouse? If so, you know about the failed economics of some cloud-native solutions on the market today. Data warehouses have been broadly adopted to provide timely reports and valuable insights.

Data 98

Data Technical Review Storage Systems Review 98

Xebia

JANUARY 9, 2024

Let’s imagine we are running dbt as a container within a cloud run job (a cloud-native container runtime within Google Cloud). Every morning when all the raw source data is ingested, we spin up a container via a trigger to do our daily data transformation workload using dbt. target directory of your dbt project.

Testing 130

Testing Data Open Source Google Cloud 130

Cloudera

JULY 27, 2021

While billing used to be one of two critical things for any successful telco (the other being the network), today’s digital service providers prioritise channels, ecosystems, payments and cloud service architectures in enterprise architecture. When it comes to Data and AI, the industry is increasingly committed to a hybrid cloud approach.

Telecommunications 61

Telecommunications Data Architecture Big Data 61

Altexsoft

MARCH 31, 2020

It means you must collect transactional data and move it from the database that supports transactions to another system that can handle large volumes of data. And, as is common, to transform it before loading to another storage system. But how do you move data? The simplest illustration for a data pipeline.

Data 76

Data Storage Analytics Data Center 76

Datavail

JUNE 15, 2023

Data Factory : A data integration tool with 150+ connectors to cloud and on-premises data sources. Synapse Data Engineering : A Spark authoring experience that includes instant start with live pools and collaboration features.

Azure 52

Azure Analytics Storage Generative AI 52

Cloudera

SEPTEMBER 1, 2020

The Data Discovery and Exploration (DDE) template in CDP Data Hub was released as Tech Preview a few weeks ago. DDE is a new template flavor within CDP Data Hub in Cloudera’s public cloud deployment option (CDP PC). data best served through Apache Solr). Before you Get Started. Click Provision Cluster.

Data 67

Data Backup Disaster Recovery Storage 67

Cloudera

JULY 14, 2023

Depending on the size and usage patterns of the data, several different strategies could be pursued to achieve a successful migration. In this blog, I will describe a few strategies one could undertake for various use cases. This will be discussed in a later blog. Relatively fast as the underlying data files are kept in place.

Backup 69

Backup Data Engineering Engineering Data 69

Cloudera

AUGUST 31, 2021

While this “data tsunami” may pose a new set of challenges, it also opens up opportunities for a wide variety of high value business intelligence (BI) and other analytics use cases that most companies are eager to deploy. . Traditional data warehouse vendors may have maturity in data storage, modeling, and high-performance analysis.

Data 80

Data Analytics Cloud Technical Review 80

Cloudera

JANUARY 20, 2021

Most of what is written though has to do with the enabling technology platforms (cloud or edge or point solutions like data warehouses) or use cases that are driving these benefits (predictive analytics applied to preventive maintenance, financial institution’s fraud detection, or predictive health monitoring as examples) not the underlying data.

Data 105

Data Artificial Inteligence Analytics Machine Learning 105

Confluent

FEBRUARY 6, 2019

The blog posts How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka and Using Apache Kafka to Drive Cutting-Edge Machine Learning describe the benefits of leveraging the Apache Kafka ® ecosystem as a central, scalable and mission-critical nervous system. For now, we’ll focus on Kafka.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

O'Reilly Media - Ideas

JANUARY 25, 2024

Before that, cloud computing itself took off in roughly 2010 (AWS was founded in 2006); and Agile goes back to 2000 (the Agile Manifesto dates back to 2001, Extreme Programming to 1999). Rachel Stephens provides two fascinating pieces of the puzzle in a recent article on the RedMonk blog , but those pieces don’t fit together exactly.

Trends 118

Trends Technical Review Technology Artificial Inteligence 118

AWS Machine Learning - AI

JANUARY 26, 2024

Build generative AI applications on secure cloud foundations At AWS, security is our top priority. AWS is architected to be the most secure global cloud infrastructure on which to build, migrate, and manage applications and workloads.

Artificial Inteligence 119

Artificial Inteligence Generative AI Security Applications 119

Cloudera

JUNE 18, 2022

Delta lake had a Spark-heavy evolution; customer options dwindle rapidly if they need freedom to choose a different engine than what is primary to the table format. . More formats, more engines, more interoperability. Today, the Hive metastore is used from multiple engines and with multiple storage options.

Data 90

Data Analytics Open Source Architecture 90

Netflix Tech

FEBRUARY 9, 2022

Let’s define some requirements that we are interested in delivering to the Netflix data engineers or anyone who would like to schedule a workflow with some external assets in it. This causes the user-managed storage system to be a critical runtime dependency. Real example of a deployment script.

Data 80

Data Testing Software Review Systems Review 80

Cloudera

FEBRUARY 16, 2022

Each workspace is associated with a collection of cloud resources. In the case of CDP Public Cloud, this includes virtual networking constructs and the data lake as provided by a combination of a Cloudera Shared Data Experience (SDX) and the underlying cloud storage. Machine Learning Model Explainability .

Machine Learning 81

Machine Learning Artificial Inteligence Weak Development Team Construction 81

Hu's Place - HitachiVantara

JANUARY 3, 2019

Public cloud, agile methodologies and devops, RESTful APIs, containers, analytics and machine learning are being adopted. More focus will be on the operational aspects of data rather than the fundamentals of capturing, storing and protecting data. Happy New Year and welcome to 2019, a year full of possibilities.

Trends 86

Trends Artificial Inteligence Data Center Machine Learning 86

TIBCO - Connected Intelligence

APRIL 22, 2021

In its annual Worldwide Global Datasphere Forecast, 2019-2023, IDC projected that only 15% of annual data growth is actually net new data. That means 85% of data growth results from copying data you already have. Opportunity 4: Migrate to the cloud. How data virtualization helps you migrate to the cloud faster.

Sustainability 46

Sustainability Virtualization Data Energy 46

TIBCO - Connected Intelligence

AUGUST 10, 2020

Taking action to leverage your data is a multi-step journey, outlined below: First, you have to recognize that sticking to the status quo is not an option. Your data demands, like your data itself, are outpacing your data engineering methods and teams. This blog sets you up for success. Make it so!

Virtualization 69

Virtualization Data How To Data Engineering 69

Altexsoft

FEBRUARY 10, 2021

Similar to how DevOps once reshaped the software development landscape, another evolving methodology, DataOps, is currently changing Big Data analytics — and for the better. DataOps is a relatively new methodology that knits together data engineering, data analytics, and DevOps to deliver high-quality data products as fast as possible.

Analytics 75

Analytics DevOps Development Software Review 75

Altexsoft

MAY 14, 2021

A growing number of companies now use this data to uncover meaningful insights and improve their decision-making, but they can’t store and process it by the means of traditional data storage and processing units. Key Big Data characteristics. Data storage and processing.

Big Data 78

Big Data Analytics Tools Applications 78

TIBCO - Connected Intelligence

DECEMBER 11, 2020

This integration foundation has continued to evolve in line with technology change, so today this domain includes significant work in REST, JSON, API management, and of course cloud migration. Over time, as TIBCO added analytics capabilities and a broad set of data management solutions, we also added these to our solution mix.”.

Business Transformation 52

Business Transformation Data Analytics Hotels 52