Xebia

article thumbnail

Use CloudWatch LogGroups for EC2 logging

Xebia

You can protect yourself from losing logs on Amazon EC2 by using CloudWatch Logs. Configure the CloudWatch Agent to stream your logs to a LogGroup. This protects you from losing logs. For example, when the instance is replaced by autoscaling. You are also protected against tampering of the logs. An attacker who has gained access to your system can remove the logs.

AWS 130
article thumbnail

Winners Recipe for Finetuning LLMs

Xebia

Winning Recipe for Finetuning LLMs At NeurIPS 2023 we participated in the LLM Efficiency Challenge. During the conference, I met up with the winners of the competition and joined the workshop where they shared their approach. In this blog, we share the key takeaways on the winning approaches. The Challenge The goal of the competition is to finetune a Large Language Model (LLM) to perform well on a broad range of tasks.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Keyless Google Cloud deployments from Azure Pipelines

Xebia

Deploying Google Cloud (GCP) resources via Azure Pipelines used to require service account keys. Today, however, Azure DevOps OIDC tokens can be exchanged to Google credentials using Google Cloud Workload Identity Federation. This blog uses the Google Cloud Auth to do so. Azure DevOps Google Cloud Deployment Pipeline Overview The high-level deployment pipeline consists of two steps.

article thumbnail

Shuttle: Fastest Way to Deploy a Custom HTTP-Based Application Server?

Xebia

Is Shuttle Possibly the Fastest Way to Deploy a Custom HTTP-Based Application Server? tl;dr Who: Focus on easily prototyping your POC or scaling MVP backends in Rust What: Provide the fastest possible backend development experience When: Alpha March 2022, beta June 2023, … Where: Serverless backend framework on their cloud, your cloud, or “in your garage” Why: Setting up and wiring all the infrastructure is a time-consuming and error-prone process How: If this may be for you, c

article thumbnail

How to configure Google Cloud Workload Identity Federation for Azure DevOps

Xebia

Deploying Google Cloud (GCP) resources via Azure Pipelines used to require service account keys. Today, however, Azure DevOps OIDC tokens can be exchanged to Google credentials using Google Cloud Workload Identity Federation. Google Cloud Workload Identity Federation External workloads can access Google Cloud resources using workload identity federation , without using a service account key.

article thumbnail

Machine learning model serving architectures

Xebia

After months of crunching data, plotting distributions, and testing out various machine learning algorithms you have finally proven to your stakeholders that your model can deliver business value. Your model has to leave the comforts of your development environment and is ready to move to production to be consumed by the end user. Serving a model cannot be too hard, right?

article thumbnail

Reflecting on Saudi’s LEAP conference

Xebia

LEAP, the world’s most attended tech conference, took place in Riyadh, Saudi Arabia on March 4th – 7th, 2024. Xebia was proud to be a featured exhibitor and presenter in the official Google booth at the event. Xebia team members were on site to discuss cutting-edge topics, including Google Cloud Best Practices, Data Platforms, Applied and Generative AI, Digital Product Development, and Cloud Migration with attendees from around the globe.