article thumbnail

Techniques and approaches for monitoring large language models on AWS

AWS Machine Learning - AI

Our proposed architecture provides a scalable and customizable solution for online LLM monitoring, enabling teams to tailor your monitoring solution to your specific use cases and requirements. A modular architecture, where each module can intake model inference data and produce its own metrics, is necessary.

article thumbnail

Automate the process to change image backgrounds using Amazon Bedrock and AWS Step Functions

AWS Machine Learning - AI

The following diagram provides a simplified view of the solution architecture and highlights the key elements. The DynamoDB update triggers an AWS Lambda function, which starts a Step Functions workflow. The Step Functions workflow invokes a Lambda function to generate a status report. height – The height of the image in pixels.

AWS 110
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Legacy Architecture Modernisation With Strategic Domain-Driven Design

Strategic Tech

Most organisations go through an architecture modernisation effort at some point as their systems drift into a state of intolerable maintenance costs and they diverge too far from modern technological advances. What architecture will be optimal for enabling that business vision? How are we going to deliver the new architecture?

article thumbnail

Transform one-on-one customer interactions: Build speech-capable order processing agents with AWS and generative AI

AWS Machine Learning - AI

In this post, we show you how to build a speech-capable order processing agent using Amazon Lex, Amazon Bedrock, and AWS Lambda. Solution overview The following diagram illustrates our solution architecture. This can be done with a Lambda layer or by using a specific AMI with the required libraries. awscli>=1.29.57

article thumbnail

CBRE and AWS perform natural language queries of structured data using Amazon Bedrock

AWS Machine Learning - AI

In this post, we describe how CBRE partnered with AWS Prototyping to develop a custom query environment allowing natural language query (NLQ) prompts by using Amazon Bedrock, AWS Lambda , Amazon Relational Database Service (Amazon RDS), and Amazon OpenSearch Service. A Lambda function with business logic invokes the primary Lambda function.

AWS 97
article thumbnail

Architect defense-in-depth security for generative AI applications using the OWASP Top 10 for LLMs

AWS Machine Learning - AI

Understanding and addressing LLM vulnerabilities, threats, and risks during the design and architecture phases helps teams focus on maximizing the economic and productivity benefits generative AI can bring. Many customers are looking for guidance on how to manage security, privacy, and compliance as they develop generative AI applications.

article thumbnail

Automating product description generation with Amazon Bedrock

AWS Machine Learning - AI

The platform enables you to create managed agents for complex business tasks without the need for coding, such as booking travel, processing insurance claims, creating ad campaigns, and managing inventory. AWS Lambda – AWS Lambda provides serverless compute for processing. This could be any database of your choice.