Architecture, Generative AI and System Design

Agentic AI design: An architectural case study

CIO

NOVEMBER 19, 2024

With all this talk, you would think it is easy to define what qualifies as agentic AI, but it isn’t always straightforward. An agent is part of an AI system designed to act autonomously, making decisions and taking action without direct human intervention or interaction. Let’s start with the basics: What is an agent?

Case Study

Case Study Artificial Inteligence Study Architecture

Multi-LLM routing strategies for generative AI applications on AWS

AWS Machine Learning - AI

APRIL 9, 2025

Organizations are increasingly using multiple large language models (LLMs) when building generative AI applications. For instance, consider an AI-driven legal document analysis system designed for businesses of varying sizes, offering two primary subscription tiers: Basic and Pro. 70B and 8B.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Applications

Accelerating insurance policy reviews with generative AI: Verisk’s Mozart companion

AWS Machine Learning - AI

MARCH 7, 2025

At the forefront of using generative AI in the insurance industry, Verisks generative AI-powered solutions, like Mozart, remain rooted in ethical and responsible AI use. Data: Policy forms Mozart is designed to author policy forms like coverage and endorsements.

Generative AI

Generative AI Technical Review Insurance Policies

Webinars

Agent Tooling: Connecting AI to Your Tools, Systems & Data

Automation, Evolved: Your New Playbook for Smarter Knowledge Work

Mastering Apache Airflow® 3.0: What’s New (and What’s Next) for Data Orchestration

MORE WEBINARS

How to win at AI: think like a systems designer, not a tech shopper

CIO

APRIL 30, 2025

AI in 2025 isnt about chasing the next model its about building the muscle to deploy it responsibly, repeatedly, and at scale. IT should think like a systems designer, not a tech shopper.

System Design

System Design Technical Advisors System How To

Automate emails for task management using Amazon Bedrock Agents, Amazon Bedrock Knowledge Bases, and Amazon Bedrock Guardrails

AWS Machine Learning - AI

NOVEMBER 19, 2024

With Amazon Bedrock and other AWS services, you can build a generative AI-based email support solution to streamline email management, enhancing overall customer satisfaction and operational efficiency. AI integration accelerates response times and increases the accuracy and relevance of communications, enhancing customer satisfaction.

Knowledge Base

Knowledge Base Generative AI Technical Review Lambda

Ground truth generation and review best practices for evaluating generative AI question-answering with FMEval

AWS Machine Learning - AI

MARCH 5, 2025

Generative AI question-answering applications are pushing the boundaries of enterprise productivity. These assistants can be powered by various backend architectures including Retrieval Augmented Generation (RAG), agentic workflows, fine-tuned large language models (LLMs), or a combination of these techniques.

Generative AI

Generative AI Systems Review Software Review Artificial Inteligence

Extend large language models powered by Amazon SageMaker AI using Model Context Protocol

AWS Machine Learning - AI

MAY 1, 2025

We will deep dive into the MCP architecture later in this post. Developed by Anthropic as an open protocol, the MCP provides a standardized way to connect AI models to virtually any data source or tool. The following diagram illustrates this workflow.

Artificial Inteligence

Artificial Inteligence AWS Architecture Generative AI

Medical content creation in the age of generative AI

AWS Machine Learning - AI

JULY 3, 2024

Generative AI and transformer-based large language models (LLMs) have been in the top headlines recently. These models demonstrate impressive performance in question answering, text summarization, code, and text generation. The imperative for regulatory oversight of large language models (or generative AI) in healthcare.

Artificial Inteligence

Artificial Inteligence Generative AI Lambda Healthcare

Unit 42 Predicts the Year of Disruption and Other Top Threats in 2025

Palo Alto Networks

NOVEMBER 21, 2024

Additionally, the cost of cyber disruption will increase next year as businesses experience downtime due to cyberattacks and scramble to implement defenses fit for the AI-enabled attacker era. In 2025, attackers will begin developing and testing generative AI technologies to use over the next 3-5 years.

Fractional VPE

Fractional VPE Disaster Recovery Software Review Fractional CTO

Creating asynchronous AI agents with Amazon Bedrock

AWS Machine Learning - AI

MARCH 13, 2025

The integration of generative AI agents into business processes is poised to accelerate as organizations recognize the untapped potential of these technologies. This post will discuss agentic AI driven architecture and ways of implementing. This post will discuss agentic AI driven architecture and ways of implementing.

Artificial Inteligence

Artificial Inteligence Lambda Travel Generative AI

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

AWS Machine Learning - AI

AUGUST 26, 2024

Prospecting, opportunity progression, and customer engagement present exciting opportunities to utilize generative AI, using historical data, to drive efficiency and effectiveness. Use case overview Using generative AI, we built Account Summaries by seamlessly integrating both structured and unstructured data from diverse sources.

Generative AI

Generative AI AWS Artificial Inteligence Technical Review

How Mixbook used generative AI to offer personalized photo book experiences

AWS Machine Learning - AI

JULY 15, 2024

The inference pipeline is powered by an AWS Lambda -based multi-step architecture, which maximizes cost-efficiency and elasticity by running independent image analysis steps in parallel. And now, with the new AWS generative AI capabilities, we are able to blow our customers minds with creative power they never thought possible.

Generative AI

Generative AI Artificial Inteligence AWS Technical Review

Reinvent personalization with generative AI on Amazon Bedrock using task decomposition for agentic workflows

AWS Machine Learning - AI

SEPTEMBER 18, 2024

Generative AI and large language models (LLMs) offer new possibilities, although some businesses might hesitate due to concerns about consistency and adherence to company guidelines. The personalized content is built using generative AI by following human guidance and provided sources of truth.

Generative AI

Generative AI Artificial Inteligence Fractional CTO Guidelines

Create a generative AI-based application builder assistant using Amazon Bedrock Agents

AWS Machine Learning - AI

OCTOBER 24, 2024

Amazon Bedrock Agents helps you accelerate generative AI application development by orchestrating multistep tasks. The generative AI–based application builder assistant from this post will help you accomplish tasks through all three tiers. Generate UI and backend code with LLMs. Delete the knowledge bases.

Generative AI

Generative AI Artificial Inteligence Applications Knowledge Base

Ground truth curation and metric interpretation best practices for evaluating generative AI question answering using FMEval

AWS Machine Learning - AI

SEPTEMBER 6, 2024

This post focuses on evaluating and interpreting metrics using FMEval for question answering in a generative AI application. Evaluation for question answering in a generative AI application A generative AI pipeline can have many subcomponents, such as a RAG pipeline.

Generative AI

Generative AI Metrics Artificial Inteligence Systems Review

Build a contextual text and image search engine for product recommendations using Amazon Bedrock and Amazon OpenSearch Serverless

AWS Machine Learning - AI

APRIL 3, 2024

Search engines and recommendation systems powered by generative AI can improve the product search experience exponentially by understanding natural language queries and returning more accurate results. The following diagram illustrates the solution architecture. You then display the top similar results.

Serverless

Serverless Artificial Inteligence Engineering Generative AI

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

AWS Machine Learning - AI

AUGUST 1, 2024

Amazon Bedrock also provides a broad set of capabilities needed to build generative AI applications with security, privacy, and responsible AI practices. However, deploying customized FMs to support generative AI applications in a secure and scalable manner isn’t a trivial task.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Artificial Intelligence

AI-Driven SOC Transformation with Cloudera: Enhancing Security Operations with Agentic AI

Cloudera

JANUARY 22, 2025

Generative AI (GenAI), coupled with Agentic AI, offers a revolutionary approach to addressing these pain points. By automating repetitive tasks, enabling proactive threat mitigation, and providing actionable insights, artificial intelligence (AI) is reshaping the future of SOCs. What are AI Agents?

Artificial Inteligence

Artificial Inteligence Software Review Compliance Systems Review

Import a question answering fine-tuned model into Amazon Bedrock as a custom model

AWS Machine Learning - AI

SEPTEMBER 30, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Artificial Inteligence

Artificial Inteligence Generative AI AWS Software Review

The C-suite is expanding — and IT leaders are stepping up

CIO

APRIL 8, 2024

“We’re in the early innings and it’s such a cool tech transition; … this will have a long tail and will have bigger inflection and a bigger impact,’’ he says of AI and more recently emerging generative AI technologies. I’m excited about the seat I’m in and participating in this fourth revolution.”

Fractional CTO

Fractional CTO CTO Real Estate Sustainability

Vector Database vs. Knowledge Graph: Making the Right Choice When Implementing RAG

CIO

FEBRUARY 21, 2024

Generative AI (GenAI) continues to amaze users with its ability to synthesize vast amounts of information to produce near-instant outputs. When to choose Knowledge Graphs vs. Vector DBs Specific use cases where Vector DBs excel are in RAG systems designed to assist customer service representatives.

Artificial Inteligence

Artificial Inteligence Generative AI Insurance Artificial Intelligence

Open-Source and DataStax Cassandra Versions: A Comprehensive Guide

Datavail

NOVEMBER 6, 2023

Understanding Apache Cassandra Apache Cassandra is a free and open-source distributed database management system designed to handle large amounts of data across multiple commodity servers. It follows a peer-to-peer architecture, employing a decentralized approach to data storage and replication. Apache Cassandra 4.x

Open Source

Open Source Scalability Analytics Database Administration

How to build an AI-ready organization: the Enterprise Intelligence Architecture

CIO

MAY 7, 2025

In our conversation we get the benefit of that advice as we discuss how organizations need to manage data to take advantage of agentic and generative AI. Marlanna proposes what she calls the Enterprise Intelligence Architecture, in which data is considered across four planes, laddering up to business activity.

Align and monitor your Amazon Bedrock powered insurance assistance chatbot to responsible AI principles with AWS Audit Manager

AWS Machine Learning - AI

JANUARY 7, 2025

Generative AI applications are gaining widespread adoption across various industries, including regulated industries such as financial services and healthcare. To address this need, AWS generative AI best practices framework was launched within AWS Audit Manager , enabling auditing and monitoring of generative AI applications.

Insurance

Insurance AWS Generative AI Artificial Inteligence

Design multi-agent orchestration with reasoning using Amazon Bedrock and open source frameworks

AWS Machine Learning - AI

DECEMBER 19, 2024

As generative AI capabilities evolve, successful business adoptions hinge on the development of robust problem-solving capabilities. At the forefront of this transformation are agentic systems, which harness the power of foundation models (FMs) to tackle complex, real-world challenges.

Open Source

Open Source Artificial Inteligence AWS Generative AI

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

AWS Machine Learning - AI

JANUARY 28, 2025

In production generative AI applications, responsiveness is just as important as the intelligence behind the model. Building production-ready AI applications Although individual optimizations are important, production applications require a holistic approach to latency management.

Artificial Inteligence

Artificial Inteligence Generative AI Metrics Applications

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

AWS Machine Learning - AI

FEBRUARY 21, 2025

Likewise, to address the challenges of lack of human feedback data, we use LLMs to generate AI grades and feedback that scale up the dataset for reinforcement learning from AI feedback ( RLAIF ). In the next section, we discuss using a compound AI system to implement this framework to achieve high versatility and reusability.

Artificial Inteligence

Artificial Inteligence Systems Review System Metrics

ServiceNow puts Salesforce in the crosshairs with expanded CRM tools

CIO

MAY 7, 2025

CRM needs to transition from an internally focused, sales-driven, customer data management system designed for monologue communication, process efficiency, and cost reductions, to an externally focused, conversation-driven, customer engagement solution designed to engage customers in dialogues across channel, Schaeffer said.

8 AI trends that will define product development in 2025 & beyond

Modus Create

FEBRUARY 12, 2025

8 AI trends that will define product development By Greg Sterndale Posted in Digital Transformation , Product Published on: February 12, 2025 Last update: February 10, 2025 From modular architecture to agentic AI How product development will evolve in 2025 & beyond In product development, change is the only constant.

Weak Development Team

Weak Development Team Trends Development Technical Review

CTO Universe

Agentic AI design: An architectural case study

Multi-LLM routing strategies for generative AI applications on AWS

Webinars

Trending Sources

Accelerating insurance policy reviews with generative AI: Verisk’s Mozart companion

Webinars

How to win at AI: think like a systems designer, not a tech shopper

Automate emails for task management using Amazon Bedrock Agents, Amazon Bedrock Knowledge Bases, and Amazon Bedrock Guardrails

Ground truth generation and review best practices for evaluating generative AI question-answering with FMEval

Extend large language models powered by Amazon SageMaker AI using Model Context Protocol

Medical content creation in the age of generative AI

Unit 42 Predicts the Year of Disruption and Other Top Threats in 2025

Creating asynchronous AI agents with Amazon Bedrock

AWS empowers sales teams using generative AI solution built on Amazon Bedrock

How Mixbook used generative AI to offer personalized photo book experiences

Reinvent personalization with generative AI on Amazon Bedrock using task decomposition for agentic workflows

Create a generative AI-based application builder assistant using Amazon Bedrock Agents

Ground truth curation and metric interpretation best practices for evaluating generative AI question answering using FMEval

Build a contextual text and image search engine for product recommendations using Amazon Bedrock and Amazon OpenSearch Serverless

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

AI-Driven SOC Transformation with Cloudera: Enhancing Security Operations with Agentic AI

Import a question answering fine-tuned model into Amazon Bedrock as a custom model

The C-suite is expanding — and IT leaders are stepping up

Vector Database vs. Knowledge Graph: Making the Right Choice When Implementing RAG

Open-Source and DataStax Cassandra Versions: A Comprehensive Guide

How to build an AI-ready organization: the Enterprise Intelligence Architecture

Align and monitor your Amazon Bedrock powered insurance assistance chatbot to responsible AI principles with AWS Audit Manager

Design multi-agent orchestration with reasoning using Amazon Bedrock and open source frameworks

Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

ServiceNow puts Salesforce in the crosshairs with expanded CRM tools

8 AI trends that will define product development in 2025 & beyond

Stay Connected