Confluent

FEBRUARY 6, 2019

This blog post focuses on how the Kafka ecosystem can help solve the impedance mismatch between data scientists, data engineers and production engineers. Impedance mismatch between data scientists, data engineers and production engineers. For now, we’ll focus on Kafka.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

Cloudera

JANUARY 20, 2021

This story will show how data is collected, enriched, stored, served, and then used to predict events in the car’s manufacturing process using Cloudera Data Platform. STEP 3: Monitor data throughput from each factory. STEP 4: Capture data from Apache Kafka streams. STEP 5: Push data to storage solutions.

Data 105

Data Artificial Inteligence Analytics Machine Learning 105

Altexsoft

JUNE 25, 2019

If we look at the hierarchy of needs in data science implementations, we’ll see that the next step after gathering your data for analysis is data engineering. This discipline is not to be underestimated, as it enables effective data storing and reliable data flow while taking charge of the infrastructure.

Data Engineering 106

Data Engineering Engineering Data Artificial Inteligence 106

AWS Machine Learning - AI

JANUARY 26, 2024

Conversely, the data in your model may be extremely sensitive and highly regulated, so deviation from AWS Key Management Service (AWS KMS) customer managed key (CMK) rotation and use of AWS Network Firewall to help enforce Transport Layer Security (TLS) for ingress and egress traffic to protect against data exfiltration may be an unacceptable risk.

Artificial Inteligence 117

Artificial Inteligence Generative AI Security Applications 117

CIO

JULY 15, 2022

Its weather-related services can be as simple as helping utilities predict short-term demand for energy, or as complex as advising maritime transporters on routing ocean-going cargo ships around developing storms. Very little innovation was happening because most of the energy was going towards having those five systems run in parallel.”.

Systems Review 268

Systems Review Fractional CTO System Development Team Review 268

Altexsoft

NOVEMBER 23, 2020

Otherwise, let’s start from the most basic question: What is data migration? What is data migration? In general terms, data migration is the transfer of the existing historical data to new storage, system, or file format. What makes companies migrate their data assets. Data migration vs data replication.

Data 104

Data Transportation Backup Storage 104

Altexsoft

JANUARY 22, 2020

As a result, it became possible to provide real-time analytics by processing streamed data. Please note: this topic requires some general understanding of analytics and data engineering, so we suggest you read the following articles if you’re new to the topic: Data engineering overview. Stream processing.

Analytics 20

Analytics Data IoT Analysis 20

Altexsoft

JANUARY 27, 2022

In the last decades, many cities adopted intelligent transportation systems (ITS) that support urban transportation network planning and traffic management. Transportation, delivery, field service, and other businesses have to accurately schedule their operations and create the most efficient routes. National/local authorities.

Machine Learning 69

Machine Learning Artificial Inteligence Transportation Network 69

Altexsoft

JULY 29, 2022

Apache Hadoop is an open-source Java-based framework that relies on parallel processing and distributed storage for analyzing massive datasets. Developed in 2006 by Doug Cutting and Mike Cafarella to run the web crawler Apache Nutch, it has become a standard for Big Data analytics. What is Hadoop? Apache Hadoop architecture.

Big Data 59

Big Data Data Google Cloud Storage 59

Altexsoft

MARCH 18, 2021

This includes Apache Hadoop , an open-source software that was initially created to continuously ingest data from different sources, no matter its type. Cloud data warehouses such as Snowflake, Redshift, and BigQuery also support ELT, as they separate storage and compute resources and are highly scalable.

Systems Review 109

Systems Review Technical Review Software Review Compliance 109

Altexsoft

DECEMBER 14, 2022

During shipment, goods are carried using different types of transport: trucks, cranes, forklifts, trains, ships, etc. What’s more, the goods come in different sizes and shapes and have different transportation requirements. Then came standardized intermodal containers that revolutionized the transportation industry.

Weak Development Team 52

Weak Development Team Linux Operating System Virtualization 52

Hu's Place - HitachiVantara

MARCH 18, 2019

As a megacity Istanbul has turned to smart technologies to answer the challenges of urbanization, with more efficient delivery of city services and increasing the quality and accessibility of such services as transportation, energy, healthcare, and social services. This improved lead time from 2 days to less than 10 minutes.

Healthcare 61

Healthcare Tourism Systems Review Energy 61

Altexsoft

JUNE 26, 2023

Data ingestion means taking data from several sources and moving it to a target system without any transformation. So it can be a part of data integration or a separate process aiming at transporting information in its initial form. For this task, you need a dedicated specialist — a data engineer or ETL developer.

Machine Learning 52

Machine Learning Artificial Inteligence Data Systems Review 52

Altexsoft

FEBRUARY 22, 2022

Fleet owners in trucking , car rental , delivery, and other transportation companies know that poorly maintained vehicles burn more fuel, require frequent oiling, and go kaput every other mile. It’s an awful lot of data, so it has to be processed with special tools. Processing data.

Software Review 52

Software Review Technical Review Software Technology 52

Altexsoft

MAY 14, 2021

A growing number of companies now use this data to uncover meaningful insights and improve their decision-making, but they can’t store and process it by the means of traditional data storage and processing units. Key Big Data characteristics. Let’s take the transportation industry for example.

Big Data 78

Big Data Analytics Tools Applications 78

Altexsoft

OCTOBER 2, 2020

Data is a valuable source that needs management. If your business generates tons of data and you’re looking for ways to organize it for storage and further use, you’re at the right place. Read the article to learn what components data management consists of and how to implement a data management strategy in your business.

Database Administration 64

Database Administration Strategy Data Technical Review 64

Altexsoft

NOVEMBER 9, 2021

Digitization has already greatly improved this business aspect, facilitating contract creation and editing, introducing e-signatures, increasing security, tracking expiration dates, and enabling convenient search and storage functionalities. Meanwhile, we’ll describe the process of turning raw data around you into actionable insights.

Analytics 52

Analytics Software Review Systems Review Technical Review 52

Altexsoft

DECEMBER 4, 2020

Three types of data migration tools. Automation scripts can be written by data engineers or ETL developers in charge of your migration project. This makes sense when you move a relatively small amount of data and deal with simple requirements. Phases of the data migration process. Data sources and destinations.

Software Review 69

Software Review Software Data Technical Review 69

Altexsoft

NOVEMBER 22, 2019

There are several pillar data sets you have to consider in the first place. Important hotel data sets and overlaps between them. Booking and property data. The main storage of hotel booking information is your property management system (PMS). Data processing in a nutshell and ETL steps outline.

Hotels 18

Hotels Data Technical Review Systems Review 18

Altexsoft

MARCH 14, 2023

That’s why some MDS tools are commercial distributions designed to be low-code or even no-code, making them accessible to data practitioners with minimal technical expertise. This means that companies don’t necessarily need a large data engineering team. Data democratization. Data storage component in a modern data stack.

Data 59

Data Technical Review Software Review Artificial Inteligence 59