Altexsoft

FEBRUARY 11, 2023

Data is now one of the most valuable assets for any kind of business. The 11th annual survey of Chief Data Officers (CDOs) and Chief Data and Analytics Officers reveals 82 percent of organizations are planning to increase their investments in data modernization in 2023. What is a data architect?

Data 87

Data Data Engineering Big Data Architecture 87

Xebia

FEBRUARY 3, 2023

You start out really small, perhaps a Proof of Concept, a small app or data engineering pipeline. Point 1 you most likely cannot learn from a blog post, but point 2 is definitively something we can tackle here. Architecture rules are defined in simple Pytest test cases and can run as part of a CI/CD pipeline.

How To 130

How To Architecture Data Engineering Applications 130

Cloudera

MARCH 17, 2023

As the use of ChatGPT becomes more prevalent, I frequently encounter customers and data users citing ChatGPT’s responses in their discussions. I love the enthusiasm surrounding ChatGPT and the eagerness to learn about modern data architectures such as data lakehouses, data meshes, and data fabrics.

ChatGPT 65

ChatGPT Education Data Comparison 65

Cloudera

JUNE 7, 2022

We live in a hybrid data world. In the past decade, the amount of structured data created, captured, copied, and consumed globally has grown from less than 1 ZB in 2011 to nearly 14 ZB in 2020. Impressive, but dwarfed by the amount of unstructured data, cloud data, and machine data – another 50 ZB.

Data 113

Data Architecture Analytics Government 113

Cloudera

JUNE 18, 2022

Cloudera customers run some of the biggest data lakes on earth. These lakes power mission critical large scale data analytics, business intelligence (BI), and machine learning use cases, including enterprise data warehouses. On data warehouses and data lakes. But with vastly different architectural worldviews.

Data 94

Data Analytics Open Source Architecture 94

Cloudera

DECEMBER 21, 2020

In this blog we will take you through a persona-based data adventure, with short demos attached, to show you the A-Z data worker workflow expedited and made easier through self-service, seamless integration, and cloud-native technologies. In our data adventure we assume the following: . The Data Scientist.

Data 97

Data Virtualization Banking Data Engineering 97

Cloudera

JULY 27, 2021

While billing used to be one of two critical things for any successful telco (the other being the network), today’s digital service providers prioritise channels, ecosystems, payments and cloud service architectures in enterprise architecture. Big Data has long been a growth area in telecom,’ he told me.

Telecommunications 65

Telecommunications Data Architecture Big Data 65

Cloudera

OCTOBER 5, 2020

Cloudera Data Platform Powered by NVIDIA RAPIDS Software Aims to Dramatically Increase Performance of the Data Lifecycle Across Public and Private Clouds. This exciting initiative is built on our shared vision to make data-driven decision-making a reality for every business. Compared to previous CPU-based architectures, CDP 7.1

Enterprise 93

Enterprise Cloud Data Machine Learning 93

Cloudera

JANUARY 15, 2021

Cloud data warehouses allow users to run analytic workloads with greater agility, better isolation and scale, and lower administrative overhead than ever before. The results demonstrate superior price performance of Cloudera Data Warehouse on the full set of 99 queries from the TPC-DS benchmark. Overview of Cloudera Data Warehouse.

Performance 97

Performance Cloud Data Storage 97

Mobilunity

MAY 8, 2023

An Enterprise Data Lake is a large, centralized repository that stores structured and unstructured data at scale. It is designed to store vast amounts of data from a variety of sources. Moreover an Enterprise Data Lake makes it accessible to data scientists, analysts, and other users across the enterprise.

Engineering 52

Engineering Data Storage AWS 52

Cloudera

FEBRUARY 1, 2024

Delivering transformational innovation and accurate business decisions requires harnessing the full potential of your organization’s entire data ecosystem. Ultimately, this boils down to how reliable and trustworthy the underlying data that feeds your insights and applications is. How does Cloudera support Day 2 operations?

Backup 82

Backup Architecture Cloud Resources 82

Cloudera

DECEMBER 13, 2023

Implementing a cohesive data vision LGIM’s Global Chief Operating Office is responsible for the company’s technology, data, client servicing and the management of its strategic operating agenda. LGIM’s data ecosystem had become fragmented over time as it had grown.

CTO 89

CTO Scalability Architecture Analytics 89

Cloudera

FEBRUARY 15, 2023

His day-to-day consists of development activities like writing and reviewing code, working on features around release timelines, and participating in design meetings for the team supporting the CDP Data Engineering product. Amogh has the unique experience of working on CDP Data Engineering during his internship.

Software Engineering 84

Software Engineering Software Review Engineering Software 84

Cloudera

MAY 8, 2023

Out of the box Cloudera Data platform (CDP) performs superbly but over time, if data architecture, data engineering, and DevOps best practices are not maintained, you can get stuck maintaining the wild, wild west. The post Visibility and Transparency appeared first on Cloudera Blog.

Data Engineering 77

Data Engineering Microservices DevOps Architecture 77

Cloudera

FEBRUARY 12, 2024

Get it wrong and your deployment may become wholly unusable with users unable to access and use the Cloudera data services. In this blog, we’ll take you through our tried and tested best practices for setting up your DNS for use with Cloudera on Azure. Most Azure users use hub-spoke network topology.

Azure 52

Azure Firewall Data Engineering Storage 52

Cloudera

DECEMBER 10, 2020

Why worry about costs with cloud-native data warehousing? Have you been burned by the unexpected costs of a cloud data warehouse? If not, before adopting a cloud data warehouse, consider the true costs of a cloud-native data warehouse. These costs impede the adoption of cloud-native data warehouses.

Data 98

Data Technical Review Storage Systems Review 98

Cloudera

AUGUST 31, 2021

Cloudera and Accenture demonstrate strength in their relationship with an accelerator called the Smart Data Transition Toolkit for migration of legacy data warehouses into Cloudera Data Platform. Accenture’s Smart Data Transition Toolkit . Are you looking for your data warehouse to support the hybrid multi-cloud?

Data 82

Data Analytics Cloud Technical Review 82

Cloudera

OCTOBER 4, 2023

Fast moving data and real time analysis present us with some amazing opportunities. Every organization has some data that happens in real time, whether it is understanding what our users are doing on our websites or watching our systems and equipment as they perform mission critical tasks for us. Don’t blink — or you’ll miss it!

Analytics 89

Analytics Machine Learning Artificial Inteligence Telecommunications 89

Netflix Tech

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. We have also noted a great potential for further improvement by model tuning (see the section of Rollout in Production).

Machine Learning 84

Machine Learning Artificial Inteligence Data Systems Review 84

Cloudera

APRIL 24, 2023

To this six-part series, where we’ll look at how to get control of the health of your Cloudera Data platform (CDP) environment. With each blog we’ll outline the symptoms and root causes of common environmental health challenges and prescribe solutions. That’s observability. We’ve done it too. We confess. Let the healing begin!

Case Study 81

Case Study Hardware Guidelines Performance 81

Cloudera

DECEMBER 1, 2017

If you’re going to Strata Data Singapore 2017 at the Suntec Singapore Convention & Exhibition Centre , here are four sessions to attend that cover various combinations of my favorite themes: big data, safe data, and cloud data. A deep dive into r unning big data workloads in the cloud. Location: Room 308/309.

Big Data 40

Big Data Data Cloud Data Engineering 40

Cloudera

NOVEMBER 1, 2022

These systems also pose security risks, including the inability to use current security best practices, such as data encryption and multi-factor authentication, making these systems particularly vulnerable to malicious cyber activity. These are challenges that must be assessed and mitigated and ultimately resolved with data. .

Cloud 89

Cloud Government Storage Analytics 89

Mobilunity

MAY 3, 2024

When it comes to financial technology, data engineers are the most important architects. As fintech continues to change the way standard financial services are done, the data engineer’s job becomes more and more important in shaping the future of the industry. Knowledge of Scala or R can also be advantageous.

Data Engineering 52

Data Engineering Fintech Engineering Data 52

Cloudera

AUGUST 3, 2022

That’s why we are excited to introduce Spark Secure Access , a new security feature for Apache Spark in the Cloudera Data Platform (CDP), that adheres to all security policies without resorting to 3rd party tools. Within CDP, Shared Data Experience (SDX) provides centralized governance, security, cataloging, and lineage. df.show().

Policies 90

Policies Machine Learning Artificial Inteligence Data Engineering 90

Cloudera

SEPTEMBER 1, 2020

We wanted to do something about this search-engine deployment-related pain point and created a pre-configured service template to expedite the ditch-rich path of getting to a reliable Solr service, deployed for application developers to start using in just minutes. What is ‘Data Discovery and Exploration’ in CDP Data Hub?

Data 71

Data Backup Disaster Recovery Storage 71

Mobilunity

DECEMBER 21, 2022

One of the essential goals of sourcing and using data is to help businesses make better decisions, so they can be at the top of their industries. To do this effectively, many businesses employ data scientists. These experts help to collect, visualize, and make sense of all kinds of data correctly. Agriculture.

Data 52

Data How To Machine Learning Artificial Inteligence 52

TIBCO - Connected Intelligence

DECEMBER 11, 2020

Like the rest of the world, data is transforming the landscape of how Nordics citizens live and work, how commerce occurs, how its governments engage, and so much more. To better understand data-driven innovation in the Nordics, I reached out to Enfo Group’s Björn Arkenfall , Executive Vice President. “We But data can be troublesome.

Business Transformation 52

Business Transformation Data Analytics Hotels 52

Cloudera

SEPTEMBER 21, 2021

Many customers looking at modernizing their pipeline orchestration have turned to Apache Airflow, a flexible and scalable workflow manager for data engineers. But now it has become very simple and secure with our release of the Cloudera Airflow provider , which gives users the best of Airflow and CDP data services.

Off-The-Shelf 100

Off-The-Shelf Data Engineering Virtualization Cloud 100

Cloudera

NOVEMBER 12, 2020

Traditional on-premise architectures, which create a fixed, finite set of resources, forces every business request for new insight to be a crazy resource balancing act, coupled with long wait times, or a straight-up no, it cannot be done. Typical scenarios for most customer data centers. A tale of two organizations.

Data Center 104

Data Center Cloud Data Policies 104

Confluent

FEBRUARY 6, 2019

The blog posts How to Build and Deploy Scalable Machine Learning in Production with Apache Kafka and Using Apache Kafka to Drive Cutting-Edge Machine Learning describe the benefits of leveraging the Apache Kafka ® ecosystem as a central, scalable and mission-critical nervous system. Data scientists love Python, period.

Machine Learning 106

Machine Learning Artificial Inteligence Scalability Data Engineering 106

Netflix Tech

MARCH 5, 2019

While our engineering teams have and continue to build solutions to lighten this cognitive load (better guardrails, improved tooling, …), data and its derived products are critical elements to understanding, optimizing and abstracting our infrastructure. In the Reliability space, our data teams focus on two main approaches.

Infrastructure 73

Infrastructure Scalability Cloud Data 73

AWS Machine Learning - AI

JANUARY 26, 2024

Understanding and addressing LLM vulnerabilities, threats, and risks during the design and architecture phases helps teams focus on maximizing the economic and productivity benefits generative AI can bring. Many customers are looking for guidance on how to manage security, privacy, and compliance as they develop generative AI applications.

Artificial Inteligence 115

Artificial Inteligence Generative AI Security Applications 115

Cloudera

JANUARY 19, 2022

Cloudera Data Platform (CDP) scored among the top 10 vendors on all four Analytical Use Cases — Data Warehouse, Logical Data Warehouse, Data Lake and Operational Intelligence in the Critical Capabilities for Cloud Database Management Systems for Analytics Use Cases.

Report 90

Report Technical Advisors Cloud Analytics 90

Cloudera

MAY 13, 2021

but have you really examined the stream processing engines out there in a side-by-side comparison to make sure? Our Choose the Right Stream Processing Engine for Your Data Needs whitepaper makes those comparisons for you, so you can quickly and confidently determine which engine best meets your key business requirements.

Engineering 102

Engineering Comparison Open Source Scalability 102

Erik Bernhardsson

OCTOBER 27, 2015

I was featured in Peadar Coyle’s interview series interviewing various “data scientists” – which is kind of arguable since (a) all the other ppl in that series are much cooler than me (b) I’m not really a data scientist. There’s no clear problem formulation, no clear loss function, lots of various data sets to use.

Data 100

Data Big Data Machine Learning Artificial Inteligence 100

TIBCO - Connected Intelligence

OCTOBER 15, 2020

That’s part of why I was excited to attend the “What’s New and What’s Next for TIBCO® Data Virtualization ” session at our recent TIBCO NOW event. . Self-service data discovery (e.g., products like TIBCO Spotfire®) have empowered the business community, giving them more freedom to do data analysis. Show Me The Money!

Virtualization 50

Virtualization Data Energy Innovation 50

Erik Bernhardsson

OCTOBER 27, 2015

I was featured in Peadar Coyle’s interview series interviewing various “data scientists” – which is kind of arguable since (a) all the other ppl in that series are much cooler than me (b) I’m not really a data scientist. There’s no clear problem formulation, no clear loss function, lots of various data sets to use.

Data 100

Data Big Data Machine Learning Artificial Inteligence 100