Remove Article Remove Azure Remove DevOps Remove Storage
article thumbnail

Partitioning Historical Data Into Daily Parquet Files in Azure Data Lake Using Azure Data Factory and Azure Notebook

Dzone - DevOps

When working with historical data, it is often necessary to partition the data into daily files based on a key column for efficient storage and querying. Azure Data Factory (ADF) provides a powerful data integration service, while Azure Notebook offers an interactive environment for data exploration and analysis.

Azure 87
article thumbnail

Pulumi With an Azure Blob Storage Backend

Dzone - DevOps

In this article, we will see how we can do that using Azure. However, sometimes for governance or pricing concerns, or any other reasons, you don't want to use Pulumi Service and you prefer to manage the state yourself with your own backend. A Quick Reminder About States and Backends. What Is This State We Need to Store?

Azure 96
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Hire a Kubernetes DevOps: Azure & AWS

Mobilunity

Nowadays, Kubernetes is widely used by DevOps, and more companies are in search of a certified Kubernetes application developer. In this article, we discuss the specifics of Kubernetes (Kube, K8), its applicability, benefits, and how to hire a highly qualified Kubernetes developer. What Can DevOps Bring to Software Development?

Azure 83
article thumbnail

Azure Function Build Release Pipeline in Azure DevOps CI/CD

Dzone - DevOps

Playing with Azure Functions is always a nice feeling, and it is very important to configure both build and release pipelines for all of your applications. Azure Functions are no different. In this article, we will see how we can create both build and release pipelines in Azure DevOps for our Azure Function application.

Azure 52
article thumbnail

Medallion Architecture: Efficient Batch and Stream Processing Data Pipelines With Azure Databricks and Delta Lake

Dzone - DevOps

This article explores the concepts of Medallion Architecture and demonstrates how to implement batch and stream processing pipelines using Azure Databricks and Delta Lake. In Azure Databricks, this architecture can be implemented using Delta Lake to provide reliable data storage and processing capabilities.

Azure 70
article thumbnail

A Comprehensive Overview of Azure Chatbot Services

Exadel

Azure provides a variety of powerful chatbot-related services: creating rule-based chatbots, understanding user intents, creating simple FAQ chatbots, and orchestrating all those services. In this article, we will review all Azure chatbot services and figure out how they can work together. Azure Bot Service.

Azure 75
article thumbnail

Continuous deployment for Azure functions

CircleCI

Firebase Cloud Functions by Google, Azure Functions. In this tutorial, you will learn and demonstrate how to continuously deploy an Azure function. An Azure account. Azure CLI installed. Azure functions core tools installed. Creating an Azure Service Principal account. Creating a storage account.

Azure 52