AWS, Generative AI and System Design

Multi-LLM routing strategies for generative AI applications on AWS

AWS Machine Learning - AI

APRIL 9, 2025

Organizations are increasingly using multiple large language models (LLMs) when building generative AI applications. For instance, consider an AI-driven legal document analysis system designed for businesses of varying sizes, offering two primary subscription tiers: Basic and Pro.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Applications

Accelerating insurance policy reviews with generative AI: Verisk’s Mozart companion

AWS Machine Learning - AI

MARCH 7, 2025

At the forefront of using generative AI in the insurance industry, Verisks generative AI-powered solutions, like Mozart, remain rooted in ethical and responsible AI use. Data: Policy forms Mozart is designed to author policy forms like coverage and endorsements.

Generative AI

Generative AI Technical Review Insurance Policies

Ground truth generation and review best practices for evaluating generative AI question-answering with FMEval

AWS Machine Learning - AI

MARCH 5, 2025

Generative AI question-answering applications are pushing the boundaries of enterprise productivity. These assistants can be powered by various backend architectures including Retrieval Augmented Generation (RAG), agentic workflows, fine-tuned large language models (LLMs), or a combination of these techniques.

Generative AI

Generative AI Systems Review Software Review Artificial Inteligence

Webinars

Automation, Evolved: Your New Playbook For Smarter Knowledge Work

MORE WEBINARS

Automate emails for task management using Amazon Bedrock Agents, Amazon Bedrock Knowledge Bases, and Amazon Bedrock Guardrails

AWS Machine Learning - AI

NOVEMBER 19, 2024

Amazon Bedrock offers a serverless experience so you can get started quickly, privately customize FMs with your own data, and integrate and deploy them into your applications using AWS tools without having to manage infrastructure. The following diagram provides a detailed view of the architecture to enhance email support using generative AI.

Knowledge Base

Knowledge Base Generative AI Technical Review Lambda

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

AWS Machine Learning - AI

AUGUST 26, 2024

At AWS, we are transforming our seller and customer journeys by using generative artificial intelligence (AI) across the sales lifecycle. Prospecting, opportunity progression, and customer engagement present exciting opportunities to utilize generative AI, using historical data, to drive efficiency and effectiveness.

Generative AI

Generative AI AWS Artificial Inteligence Technical Review

Medical content creation in the age of generative AI

AWS Machine Learning - AI

JULY 3, 2024

Generative AI and transformer-based large language models (LLMs) have been in the top headlines recently. These models demonstrate impressive performance in question answering, text summarization, code, and text generation. The imperative for regulatory oversight of large language models (or generative AI) in healthcare.

Artificial Inteligence

Artificial Inteligence Generative AI Lambda Healthcare

How Mixbook used generative AI to offer personalized photo book experiences

AWS Machine Learning - AI

JULY 15, 2024

Years ago, Mixbook undertook a strategic initiative to transition their operational workloads to Amazon Web Services (AWS) , a move that has continually yielded significant advantages. The data intake process involves three macro components: Amazon Aurora MySQL-Compatible Edition , Amazon S3, and AWS Fargate for Amazon ECS.

Generative AI

Generative AI Artificial Inteligence AWS Technical Review

Creating asynchronous AI agents with Amazon Bedrock

AWS Machine Learning - AI

MARCH 13, 2025

The integration of generative AI agents into business processes is poised to accelerate as organizations recognize the untapped potential of these technologies. This post will discuss agentic AI driven architecture and ways of implementing. This post will discuss agentic AI driven architecture and ways of implementing.

Artificial Inteligence

Artificial Inteligence Lambda Travel Generative AI

Build an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and AWS CloudFormation

AWS Machine Learning - AI

AUGUST 5, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and AWS CloudFormation , enabling organizations to quickly and effortlessly set up a powerful RAG system. On the AWS CloudFormation console, create a new stack. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

Knowledge Base

Knowledge Base AWS Generative AI Artificial Inteligence

Reinvent personalization with generative AI on Amazon Bedrock using task decomposition for agentic workflows

AWS Machine Learning - AI

SEPTEMBER 18, 2024

Generative AI and large language models (LLMs) offer new possibilities, although some businesses might hesitate due to concerns about consistency and adherence to company guidelines. The personalized content is built using generative AI by following human guidance and provided sources of truth.

Generative AI

Generative AI Artificial Inteligence Fractional CTO Guidelines

Create a generative AI-based application builder assistant using Amazon Bedrock Agents

AWS Machine Learning - AI

OCTOBER 24, 2024

Amazon Bedrock Agents helps you accelerate generative AI application development by orchestrating multistep tasks. These agents work with AWS managed infrastructure capabilities and Amazon Bedrock , reducing infrastructure management overhead. The following are sample user queries: How can I design secure VPCs?

Generative AI

Generative AI Artificial Inteligence Applications Knowledge Base

Build an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and the AWS CDK

AWS Machine Learning - AI

AUGUST 28, 2024

This post demonstrates how to seamlessly automate the deployment of an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and the AWS Cloud Development Kit (AWS CDK), enabling organizations to quickly set up a powerful question answering system. The AWS CDK already set up. txt,md,html,doc/docx,csv,xls/.xlsx,pdf).

Knowledge Base

Knowledge Base AWS Generative AI Artificial Inteligence

Ground truth curation and metric interpretation best practices for evaluating generative AI question answering using FMEval

AWS Machine Learning - AI

SEPTEMBER 6, 2024

This post focuses on evaluating and interpreting metrics using FMEval for question answering in a generative AI application. billion 50,067 million 50.067 billion What were Amazon’s AWS sales for the second quarter of 2023? Amazon’s AWS sales for the second quarter of 2023 were $22.1

Generative AI

Generative AI Metrics Artificial Inteligence Systems Review

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

AWS Machine Learning - AI

AUGUST 1, 2024

Amazon Bedrock also provides a broad set of capabilities needed to build generative AI applications with security, privacy, and responsible AI practices. However, deploying customized FMs to support generative AI applications in a secure and scalable manner isn’t a trivial task.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Artificial Intelligence

Knowledge Bases for Amazon Bedrock now supports advanced parsing, chunking, and query reformulation giving greater control of accuracy in RAG based applications

AWS Machine Learning - AI

JULY 10, 2024

From the AWS Management Console for Amazon Bedrock, you can start creating a knowledge base by choosing Create knowledge base. Custom processing using Lambda functions For those seeking more control and flexibility, Knowledge Bases for Amazon Bedrock now offers the ability to define custom processing logic using AWS Lambda functions.

Knowledge Base

Knowledge Base Artificial Inteligence Lambda Applications

Build a contextual text and image search engine for product recommendations using Amazon Bedrock and Amazon OpenSearch Serverless

AWS Machine Learning - AI

APRIL 3, 2024

Search engines and recommendation systems powered by generative AI can improve the product search experience exponentially by understanding natural language queries and returning more accurate results. Virginia) and US West (Oregon) AWS Regions. These steps are discussed in detail in the following sections.

Serverless

Serverless Artificial Inteligence Engineering Generative AI

Import a question answering fine-tuned model into Amazon Bedrock as a custom model

AWS Machine Learning - AI

SEPTEMBER 30, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Software Review

Radar Trends to Watch: September 2024

O'Reilly Media - Ideas

SEPTEMBER 3, 2024

Many developers report huge time savings when using generative AI to understand or update legacy code. Andy Jassy, Amazon’s CEO, has claimed that they saved 4,500 developer-years by using AI to upgrade 30,000 Java applications from Java 8 to Java 17. The developers promise that, soon, it will be possible to deploy to AWS S3.

Trends

Trends Artificial Inteligence Open Source Software Review

Align and monitor your Amazon Bedrock powered insurance assistance chatbot to responsible AI principles with AWS Audit Manager

AWS Machine Learning - AI

JANUARY 7, 2025

Generative AI applications are gaining widespread adoption across various industries, including regulated industries such as financial services and healthcare. To address this need, AWS generative AI best practices framework was launched within AWS Audit Manager , enabling auditing and monitoring of generative AI applications.

Insurance

Insurance AWS Generative AI Artificial Inteligence

Design multi-agent orchestration with reasoning using Amazon Bedrock and open source frameworks

AWS Machine Learning - AI

DECEMBER 19, 2024

As generative AI capabilities evolve, successful business adoptions hinge on the development of robust problem-solving capabilities. At the forefront of this transformation are agentic systems, which harness the power of foundation models (FMs) to tackle complex, real-world challenges.

Open Source

Open Source Artificial Inteligence AWS Generative AI

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

AWS Machine Learning - AI

FEBRUARY 21, 2025

Likewise, to address the challenges of lack of human feedback data, we use LLMs to generate AI grades and feedback that scale up the dataset for reinforcement learning from AI feedback ( RLAIF ). In the next section, we discuss using a compound AI system to implement this framework to achieve high versatility and reusability.

Artificial Inteligence

Artificial Inteligence Systems Review System Metrics

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

AWS Machine Learning - AI

JANUARY 28, 2025

In production generative AI applications, responsiveness is just as important as the intelligence behind the model. Latency-optimized inference: A deep dive Amazon Bedrock latency-optimized inference capabilities are designed to provide higher OTPS and quicker TTFT, enabling applications to handle workloads more reliably.

Artificial Inteligence

Artificial Inteligence Generative AI Metrics Applications

CTO Universe

Multi-LLM routing strategies for generative AI applications on AWS

Accelerating insurance policy reviews with generative AI: Verisk’s Mozart companion

Webinars

Trending Sources

Ground truth generation and review best practices for evaluating generative AI question-answering with FMEval

Webinars

Automate emails for task management using Amazon Bedrock Agents, Amazon Bedrock Knowledge Bases, and Amazon Bedrock Guardrails

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

Medical content creation in the age of generative AI

How Mixbook used generative AI to offer personalized photo book experiences

Creating asynchronous AI agents with Amazon Bedrock

Build an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and AWS CloudFormation

Reinvent personalization with generative AI on Amazon Bedrock using task decomposition for agentic workflows

Create a generative AI-based application builder assistant using Amazon Bedrock Agents

Build an end-to-end RAG solution using Knowledge Bases for Amazon Bedrock and the AWS CDK

Ground truth curation and metric interpretation best practices for evaluating generative AI question answering using FMEval

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

Knowledge Bases for Amazon Bedrock now supports advanced parsing, chunking, and query reformulation giving greater control of accuracy in RAG based applications

Build a contextual text and image search engine for product recommendations using Amazon Bedrock and Amazon OpenSearch Serverless

Import a question answering fine-tuned model into Amazon Bedrock as a custom model

Radar Trends to Watch: September 2024

Align and monitor your Amazon Bedrock powered insurance assistance chatbot to responsible AI principles with AWS Audit Manager

Design multi-agent orchestration with reasoning using Amazon Bedrock and open source frameworks

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

Stay Connected