Altexsoft

AUGUST 25, 2020

Big data is tons of mixed, unstructured information that keeps piling up at high speed. That’s why traditional data transportation methods can’t efficiently manage the big data flow. Big data fosters the development of new tools for transporting, storing, and analyzing vast amounts of unstructured data.

Big Data 75

Big Data Data Engineering Engineering Data 75

TIBCO - Connected Intelligence

DECEMBER 1, 2020

A TIBCO analytics user, LeadMind, CAF´s data-driven platform, provides hi-tech solutions to improve the operations and maintenance of those trains. Its clients include public transport giants around the globe: Renfe, SNCF, CPTM, STC in Mexico, Northern, Wales and Borders, Transport for London and Auckland Transport among many others.

Training 34

Training Transportation Analytics IoT 34

O'Reilly Media - Data

APRIL 3, 2018

Data Science and Machine Learning sessions will cover tools, techniques, and case studies. This year’s sessions on Data Engineering and Architecture showcases streaming and real-time applications, along with the data platforms used at several leading companies. Here are some examples: Data Case Studies (12 presentations).

Machine Learning 159

Machine Learning Artificial Inteligence Company Case Study 159

CTOvision

JUNE 15, 2015

They also launched a plan to train over a million data scientists and data engineers on Spark. As data and analytics are embedded into the fabric of business and society –from popular apps to the Internet of Things (IoT) –Spark brings essential advances to large-scale data processing.

Open Source 117

Open Source Big Data Machine Learning Artificial Inteligence 117

Altexsoft

APRIL 13, 2023

If we speak about end-to-end visibility, we mean that we should be able to have a granular view of all the main components of a supply chain: transportation – which entails control over the actual delivery process, tracking shipments , predicting ETA , etc.; to develop all the data architecture and analytics solutions.

Technical Review 59

Technical Review Software Review Analytics Systems Review 59

Hu's Place - HitachiVantara

MAY 10, 2019

A Big Data Analytics pipeline– from ingestion of data to embedding analytics consists of three steps Data Engineering : The first step is flexible data on-boarding that accelerates time to value. This will require another product for data governance. This is colloquially called data wrangling.

Data 90

Data Machine Learning Artificial Inteligence Weak Development Team 90

Confluent

FEBRUARY 6, 2019

This blog post focuses on how the Kafka ecosystem can help solve the impedance mismatch between data scientists, data engineers and production engineers. Impedance mismatch between data scientists, data engineers and production engineers. For now, we’ll focus on Kafka.

Machine Learning 107

Machine Learning Artificial Inteligence Scalability Data Engineering 107

CTOvision

JANUARY 28, 2015

Our speakers have a laser-sharp focus on the data issues shaping all aspects of business, including verticals such as finance, media, retail and transportation, and government. The data industry is growing fast, and Strata + Hadoop World has grown right along with it. Data scientists. Data engineers.

Big Data 109

Big Data Case Study Conference Study 109

O'Reilly Media - Ideas

FEBRUARY 11, 2019

Machine learning and AI require data—specifically, labeled data for training models. There are many articles that point to the explosion of data, but in order for that data that be useful for analytics and ML, it has to be collected, transported, cleaned, stored, and combined with other data sources.

Big Data 86

Big Data Technology Tools Cloud 86

Altexsoft

JUNE 25, 2019

If we look at the hierarchy of needs in data science implementations, we’ll see that the next step after gathering your data for analysis is data engineering. This discipline is not to be underestimated, as it enables effective data storing and reliable data flow while taking charge of the infrastructure.

Data Engineering 106

Data Engineering Engineering Data Artificial Inteligence 106

CTOvision

FEBRUARY 23, 2017

Speakers have a laser-sharp focus on the data issues shaping all aspects of business, including verticals such as finance, media, retail and transportation, and government. The data industry is growing fast, and Strata + Hadoop World has grown right along with it. Data scientists. Data engineers.

Big Data 61

Big Data Artificial Intelligence Artificial Inteligence Case Study 61

Altexsoft

DECEMBER 7, 2021

In logistics, it refers to the transportation of goods and is typically used to inform customers of the time when the vehicle carrying their freight will arrive. Estimated time of departure is the time when the transport departs from the starting point. It’s crucial for all parties involved in the transportation process.

Artificial Inteligence 52

Artificial Inteligence How To Software Review Systems Review 52

Cloudera

JANUARY 20, 2021

This story will show how data is collected, enriched, stored, served, and then used to predict events in the car’s manufacturing process using Cloudera Data Platform.

Data 106

Data Artificial Inteligence Analytics Machine Learning 106

Altexsoft

JUNE 11, 2021

Process mining offers a lot of optimization opportunities to the compex, multifaceted supply chain industry, including such aspects as manufacturing, warehousing , transportation , inventory management , retail management, etc. Establishing secure data exchange between systems would facilitate information collection and analysis.

Applications 69

Applications Weak Development Team Systems Review Software Review 69

Trigent

NOVEMBER 3, 2022

Areas covered may include shipments, geographical locations, transport channels, and campaigns. Predictive analytics – This data helps forecast trends as it predicts what could happen in your organization. It helps you keep track of your operations regularly through dashboards and databases.

Analytics 52

Analytics Data IoT Trends 52

Marcusoft

SEPTEMBER 10, 2019

He is a brilliant programmer, data engineer, agile aficionado and he keeps my argumentation sharp with his analytic abilities. Lars needs to go places and transport things. This is one story that I’ve told many times and I wanted to share it here too. The story. I have a good friend called Lars. Same feeling. When can I use it?

Agile 40

Agile Transportation Coaching Data Engineering 40

O'Reilly Media - Ideas

MAY 1, 2019

Data science and data tools. Practical Linux Command Line for Data Engineers and Analysts , May 20. First Steps in Data Analysis , May 20. Data Analysis Paradigms in the Tidyverse , May 30. Data Visualization with Matplotlib and Seaborn , June 4. Expert Transport Layer Security (TLS) , June 13.

Course 46

Course Training Artificial Inteligence Machine Learning 46

Altexsoft

NOVEMBER 27, 2020

Just like any industry, transportation is experiencing a difficult year. In the transportation process, such companies are called shippers, even if they employ third-parties to ship their goods. Finding the most efficient route, choose the transport mode(s), assigning vehicles, drivers, and balancing the load.

Software 69

Software Transportation Analytics System 69

Kentik

MAY 9, 2017

ingested into the Kentik Data Engine with two new fields that represent the Device (router) and Site (PoP) where that flow will exit the network to an adjacent autonomous system (AS). In a nutshell, Ultimate Exit uses BGP to enhance every flow record (NetFlow, sFlow, IPFIX, etc.)

Internet 40

Internet Analysis Network Analytics 40

Altexsoft

FEBRUARY 8, 2021

Supply chain practitioners and CEOs surveyed by 6river share that the main challenges of the industry are: keeping up with the rapidly changing customer demand, dealing with delays and disruptions, inefficient planning, lack of automation, rising costs (of transportation, labor, etc.), Analytics in logistics and transportation.

Business Intelligence 87

Business Intelligence Analytics Analysis Data 87

AWS Machine Learning - AI

JANUARY 26, 2024

Conversely, the data in your model may be extremely sensitive and highly regulated, so deviation from AWS Key Management Service (AWS KMS) customer managed key (CMK) rotation and use of AWS Network Firewall to help enforce Transport Layer Security (TLS) for ingress and egress traffic to protect against data exfiltration may be an unacceptable risk.

Artificial Inteligence 118

Artificial Inteligence Generative AI Security Applications 118

Abhishek Tiwari

JULY 7, 2023

Airflow provides rich scheduling and execution semantics enabling data engineers to easily define complex pipelines, running at regular intervals. From transportation and logistics to e-commerce and food delivery, the core operations of many successful companies can be viewed as workflow problems.

Data 52

Data Transportation Scalability Systems Review 52

Altexsoft

JANUARY 27, 2022

In the last decades, many cities adopted intelligent transportation systems (ITS) that support urban transportation network planning and traffic management. Transportation, delivery, field service, and other businesses have to accurately schedule their operations and create the most efficient routes. National/local authorities.

Machine Learning 69

Machine Learning Artificial Inteligence Transportation Network 69

CIO

JULY 15, 2022

Its weather-related services can be as simple as helping utilities predict short-term demand for energy, or as complex as advising maritime transporters on routing ocean-going cargo ships around developing storms. I am a firm believer in in-house resources.

Systems Review 279

Systems Review Fractional CTO System Development Team Review 279

Altexsoft

DECEMBER 14, 2022

During shipment, goods are carried using different types of transport: trucks, cranes, forklifts, trains, ships, etc. What’s more, the goods come in different sizes and shapes and have different transportation requirements. Then came standardized intermodal containers that revolutionized the transportation industry.

Weak Development Team 52

Weak Development Team Linux Operating System Virtualization 52

Altexsoft

NOVEMBER 23, 2020

Data migration is a one-way journey that ends once all the information is transported to a target location. Integration, in contrast, can be a continuous process, that involves streaming real-time data and sharing information across systems. Data migration vs data replication. Data migration vs data replication.

Data 104

Data Transportation Backup Storage 104

Altexsoft

JANUARY 22, 2020

As a result, it became possible to provide real-time analytics by processing streamed data. Please note: this topic requires some general understanding of analytics and data engineering, so we suggest you read the following articles if you’re new to the topic: Data engineering overview.

Analytics 20

Analytics Data IoT Analysis 20

Altexsoft

FEBRUARY 22, 2022

Fleet owners in trucking , car rental , delivery, and other transportation companies know that poorly maintained vehicles burn more fuel, require frequent oiling, and go kaput every other mile. At the same time, those novel approaches require much more data and data engineering efforts than more traditional ML methods.

Software Review 52

Software Review Technical Review Software Technology 52

Altexsoft

JULY 29, 2022

a runtime environment (sandbox) for classic business intelligence (BI), advanced analysis of large volumes of data, predictive maintenance , and data discovery and exploration; a store for raw data; a tool for large-scale data integration ; and. a suitable technology to implement data lake architecture.

Big Data 59

Big Data Data Google Cloud Storage 59

Netflix Tech

MARCH 25, 2019

We adopted the following mission statement to guide our investments: “Provide a complete and accurate data lineage system enabling decision-makers to win moments of truth.” To improve data accuracy, we decided to leverage AWS S3 access logs to identify entity relationships not been captured by our traditional ingestion process.

Infrastructure 87

Infrastructure Data Technical Review Systems Review 87

Kentik

SEPTEMBER 5, 2017

To briefly review, Interface Classification enables an organization to quickly and efficiently assign a Connectivity Type and Network Boundary value to every interface in the network, and to store those values in the Kentik Data Engine (KDE) records of each flow that is ingested by Kentik Detect.

Transportation 40

Transportation Network Analysis Groups 40

Altexsoft

MARCH 18, 2021

Transformations may include: data sorting and filtering to get rid of irrelevant items, de-duplicating and cleansing, translating and converting, removing or encrypting to protect sensitive information, splitting or joining tables, etc. These are data engineers who are responsible for implementing these processes.

Systems Review 109

Systems Review Technical Review Software Review Compliance 109

Hu's Place - HitachiVantara

MARCH 18, 2019

As a megacity Istanbul has turned to smart technologies to answer the challenges of urbanization, with more efficient delivery of city services and increasing the quality and accessibility of such services as transportation, energy, healthcare, and social services. This improved lead time from 2 days to less than 10 minutes.

Healthcare 61

Healthcare Tourism Systems Review Energy 61

Altexsoft

NOVEMBER 9, 2021

Indirect spend is any expenses that are needed to operate the business, such as office supplies, utilities, transportation, insurance, marketing, business travel, warehousing costs, wages, and so on. Meanwhile, we’ll describe the process of turning raw data around you into actionable insights. Extract data. Consolidate data.

Analytics 52

Analytics Software Review Systems Review Technical Review 52

Kentik

APRIL 18, 2016

This approach would take a little bit less communication and require a lot less work to match templates to data packets. You could take the well-known data types like IPv4 and IPv6 and build a fast path for them. With templates out-of-band, the protocol would also be ‘re-sample-able’ in transport. Kentik KFlow.

Transportation 40

Transportation IPv6 Network Data 40

Altexsoft

JUNE 26, 2023

Data ingestion means taking data from several sources and moving it to a target system without any transformation. So it can be a part of data integration or a separate process aiming at transporting information in its initial form. For this task, you need a dedicated specialist — a data engineer or ETL developer.

Machine Learning 52

Machine Learning Artificial Inteligence Data Systems Review 52

Altexsoft

DECEMBER 4, 2020

Three types of data migration tools. Automation scripts can be written by data engineers or ETL developers in charge of your migration project. This makes sense when you move a relatively small amount of data and deal with simple requirements. Phases of the data migration process. Data sources and destinations.

Software Review 69

Software Review Software Data Technical Review 69