article thumbnail

Agentic AI design: An architectural case study

CIO

Development teams starting small and building up, learning, testing and figuring out the realities from the hype will be the ones to succeed. Let’s review a case study and see how we can start to realize benefits now. In our real-world case study, we needed a system that would create test data.

article thumbnail

Model customization, RAG, or both: A case study with Amazon Nova

AWS Machine Learning - AI

Solution overview To evaluate the effectiveness of RAG compared to model customization, we designed a comprehensive testing framework using a set of AWS-specific questions. Our study used Amazon Nova Micro and Amazon Nova Lite as baseline FMs and tested their performance across different configurations.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

TechCrunch+ roundup: New VC rules, AI biotech investor survey, Instagram ad case study

TechCrunch

In a case study based on Instagram campaigns for a site that facilitates bookings for freelance beauty professionals, digital marketer Angelina Liparteliani looked at Instagram Reels, Feed Posts and Stories. Diversify your ad strategy, test different ideas and don’t give up if your ad doesn’t show results right away.”.

article thumbnail

DIY LLM Evaluation, a Case Study of Rhyming in ABBA Schema

Xebia

DIY LLM Evaluation, a Case Study of Rhyming in ABBA Schema It’s becoming common knowledge: You should not choose your LLMs based on static benchmarks. That’s why I’ve been testing new LLMs always with this task: how much effort does it take to get it to rhyme in ABBA schema. If you found it useful let me know!

article thumbnail

A Tale of Two Case Studies: Using LLMs in Production

Speaker: Tony Karrer, Ryan Barker, Grant Wiles, Zach Asman, & Mark Pace

We'll walk through two compelling case studies that showcase how AI is reimagining industries and revolutionizing the way we interact with technology. Join our exclusive webinar with top industry visionaries, where we'll explore the latest innovations in Artificial Intelligence and the incredible potential of LLMs.

article thumbnail

What is a cloud architect? A vital role for success in the cloud

CIO

Youll also be tested on your knowledge of AWS deployment and management services, among other AWS services. The exam uses case studies to test your knowledge in real-world scenarios, and tests your knowledge of software development methodologies and how they apply to multi-tiered distributed applications across several hybrid environments.

Cloud 163
article thumbnail

Case in point: taking stock of the CrowdStrike outages

CIO

It was an interesting case study of global cyber impact, says Charles Clancy, CTO at Mitre. But, as of January 28, the companys stock price was over $400, an all-time high, helped by a perfect score on an industry test for ransomware detection. After the testing is complete, the update is then rolled out in stages.

article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation metrics for at-scale production guardrails.

article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

Using this case study, he'll also take us through his systematic approach of iterative cycles of human feedback, engineering, and measuring performance. . 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

The 5 Product Discovery Secrets Every PM Should Know

Speaker: Jim Morris, Founder, Product Discovery Group

By using the Product Discovery Cycle, teams can find new ideas, understand customer pain points, and test solutions quickly and cheaply. During this presentation, attendees will hear case studies, examples, and best practices gleaned from Jim's 25 years of using the Product Discovery Cycle.

article thumbnail

How to Achieve Product-Market Fit

Speaker: Dan Olsen - Product Management Trainer and Consultant, Author, and Speaker

Come learn how to turn product management into more of a science than an art to improve your odds of success. December 7, 2023 at 11:00 am PT, 2:00 pm ET, 7:00 pm GMT Use Product Management Today’s webinars to earn professional development hours!