Remove Architecture Remove Lambda Remove Scalability Remove Travel
article thumbnail

Techniques and approaches for monitoring large language models on AWS

AWS Machine Learning - AI

Our proposed architecture provides a scalable and customizable solution for online LLM monitoring, enabling teams to tailor your monitoring solution to your specific use cases and requirements. A modular architecture, where each module can intake model inference data and produce its own metrics, is necessary.

article thumbnail

Automate the process to change image backgrounds using Amazon Bedrock and AWS Step Functions

AWS Machine Learning - AI

The following diagram provides a simplified view of the solution architecture and highlights the key elements. The DynamoDB update triggers an AWS Lambda function, which starts a Step Functions workflow. The Step Functions workflow invokes a Lambda function to generate a status report. height – The height of the image in pixels.

AWS 114
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Transform one-on-one customer interactions: Build speech-capable order processing agents with AWS and generative AI

AWS Machine Learning - AI

In this post, we show you how to build a speech-capable order processing agent using Amazon Lex, Amazon Bedrock, and AWS Lambda. Solution overview The following diagram illustrates our solution architecture. This can be done with a Lambda layer or by using a specific AMI with the required libraries. awscli>=1.29.57

article thumbnail

Architect defense-in-depth security for generative AI applications using the OWASP Top 10 for LLMs

AWS Machine Learning - AI

Understanding and addressing LLM vulnerabilities, threats, and risks during the design and architecture phases helps teams focus on maximizing the economic and productivity benefits generative AI can bring. Many customers are looking for guidance on how to manage security, privacy, and compliance as they develop generative AI applications.

article thumbnail

Automating product description generation with Amazon Bedrock

AWS Machine Learning - AI

The platform enables you to create managed agents for complex business tasks without the need for coding, such as booking travel, processing insurance claims, creating ad campaigns, and managing inventory. AWS Lambda – AWS Lambda provides serverless compute for processing. This could be any database of your choice.

article thumbnail

Build an internal SaaS service with cost and usage tracking for foundation models on Amazon Bedrock

AWS Machine Learning - AI

API gateways can provide loose coupling between model consumers and the model endpoint service, and flexibility to adapt to changing model, architectures, and invocation methods. In this post, we show you how to build an internal SaaS layer to access foundation models with Amazon Bedrock in a multi-tenant (team) architecture.

Lambda 125
article thumbnail

The journey of PGA TOUR’s generative AI virtual assistant, from concept to development to prototype

AWS Machine Learning - AI

We use AWS Lambda as our orchestration function responsible for interacting with various data sources, LLMs and error correction based on the user query. The following figure illustrates this architecture. Outside of work, he enjoys trying new food, traveling, and teaching taekwondo.