article thumbnail

Cost, security, and flexibility: the business case for open source gen AI

CIO

Weve evaluated all the major open source large language models and have found that Mistral is the best for our use case once its up-trained, he says. Another consideration is the size of the LLM, which could impact inference time. For example, he says, Metas Llama is very large, which impacts inference time.

article thumbnail

Your CEO has little idea who IT is or what IT does

CIO

Executives need to understand and hopefully have a respected relationship with the following IT dramatis personae : IT operations director, development director, CISO, project management office (PMO) director, enterprise architecture director, governance and compliance Director, vendor management director, and innovation director.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning - AI

It’s serverless so you don’t have to manage the infrastructure. You can also bring your own customized models and deploy them to Amazon Bedrock for supported architectures. Prompt catalog – Crafting effective prompts is important for guiding large language models (LLMs) to generate the desired outputs.

article thumbnail

How to know a business process is ripe for agentic AI

CIO

The IT department uses Asana AI Studio for vendor management, to support help-desk requests, and to ensure its meeting software and compliance management requirements. We are fast tracking those use cases where we can go beyond traditional machine learning to acting autonomously to complete tasks and make decisions.

How To 191
article thumbnail

CIOs still grapple with what gen AI can do for the enterprise

CIO

There’s indeed a lot of hype around the latest wave of large language models (LLM) and associated tools, yet beneath the noise, there’s a whisper about how the technology will one day become indispensable. But in its current state, it’s just a toolbox.” The big question is what to do with it now.

article thumbnail

The year’s top 10 enterprise AI trends — so far

CIO

This is where large language models get me really excited. AI vendor management Only the biggest companies are going to build or manage their own AI models, and even those will rely on vendors to provide most of the AI they use. In August, Meta continued releasing models.

article thumbnail

12 AI predictions for 2025

CIO

Multi-model routing Not to be confused with multi-modal AI, multi-modal routing is when companies use more than one LLM to power their gen AI applications. Different AI models are better at different things, and some are cheaper than others, or have lower latency.