Remove Artificial Inteligence Remove Artificial Intelligence Remove Research
article thumbnail

LLM benchmarking: How to find the right AI model

CIO

But how do companies decide which large language model (LLM) is right for them? LLM benchmarks could be the answer. They provide a yardstick that helps user companies better evaluate and classify the major language models. LLM benchmarks are the measuring instrument of the AI world.

article thumbnail

IDC chief research officer: GenAI, from experimentation to adoption

CIO

As the chief research officer at IDC, I lead a global team of analysts who develop research and provide advice to help our clients navigate the technology landscape. Back in 2023, at the CIO 100 awards ceremony, we were about nine months into exploring generative artificial intelligence (genAI). Build or buy?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

CAIOs are stepping out from the CIO’s shadow

CIO

In 2016, Andrew Ng, one of the best-known researchers in the field of AI,wroteabout the benefits of establishing a chief AI officer role in companies, as well as the characteristics and responsibilities such a role should have. It is not, and it must be considered as a strategic pillar aligned with business objectives.

article thumbnail

AI dominates Gartner’s 2025 predictions

CIO

Artificial Intelligence continues to dominate this week’s Gartner IT Symposium/Xpo, as well as the research firm’s annual predictions list. “It It is clear that no matter where we go, we cannot avoid the impact of AI,” Daryl Plummer, distinguished vice president analyst, chief of research and Gartner Fellow told attendees. “AI

article thumbnail

Agentic AI design: An architectural case study

CIO

From obscurity to ubiquity, the rise of large language models (LLMs) is a testament to rapid technological advancement. Just a few short years ago, models like GPT-1 (2018) and GPT-2 (2019) barely registered a blip on anyone’s tech radar. If the LLM didn’t create enough output, the agent would need to run again.

article thumbnail

AI in the C-suite: Using AI to shape business strategy

CIO

Jeff Schumacher, CEO of artificial intelligence (AI) software company NAX Group, told the World Economic Forum : “To truly realize the promise of AI, businesses must not only adopt it, but also operationalize it.” Most AI hype has focused on large language models (LLMs).

article thumbnail

Multi-LLM routing strategies for generative AI applications on AWS

AWS Machine Learning - AI

Organizations are increasingly using multiple large language models (LLMs) when building generative AI applications. Although an individual LLM can be highly capable, it might not optimally address a wide range of use cases or meet diverse performance requirements.