article thumbnail

IT leaders see big business potential in small AI models

CIO

Small language models (SLMs) are giving CIOs greater opportunities to develop specialized, business-specific AI applications that are less expensive to run than those reliant on general-purpose large language models (LLMs). Cant run the risk of a hallucination in a healthcare use case.

article thumbnail

Sweat the small stuff: Data protection in the age of AI

CIO

While NIST released NIST-AI- 600-1, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile on July 26, 2024, most organizations are just beginning to digest and implement its guidance, with the formation of internal AI Councils as a first step in AI governance.So

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

3 principles for regulatory-grade large language model application

CIO

In recent years, we have witnessed a tidal wave of progress and excitement around large language models (LLMs) such as ChatGPT and GPT-4. Moreover, LLMs should strive for transparency in their methodologies, showcasing how they arrived at a given conclusion.

article thumbnail

How MCP can revolutionize the way DevOps teams use AI

CIO

Imagine, for example, asking an LLM which Amazon S3 storage buckets or Azure storage accounts contain data that is publicly accessible, then change their access settings? Or having an LLM identify documents in an Amazon DynamoDB database that havent been updated in over a year and delete or archive them.

DevOps 196
article thumbnail

Cybersecurity Snapshot: AI Security Roundup: Best Practices, Research and Insights

Tenable

Harden configurations : Follow best practices for the deployment environment, such as using hardened containers for running ML models; applying allowlists on firewalls; encrypting sensitive AI data; and employing strong authentication. The AI Risk Repository is a “living database” that’ll be expanded and updated, according to MIT.

article thumbnail

Host concurrent LLMs with LoRAX

AWS Machine Learning - AI

Out-of-the-box models often lack the specific knowledge required for certain domains or organizational terminologies. To address this, businesses are turning to custom fine-tuned models, also known as domain-specific large language models (LLMs). You have the option to quantize the model.

article thumbnail

What’s next for network firewalls?

CIO

Firewalls have come a long way from their humble beginnings of assessing network traffic based on appearance alone. Here are six predictions for the future of the firewall. For example, a typical NGFW now may be equipped with firewalling, SD-WAN, a Wi-Fi controller for SD-Branch, an Ethernet controller, and zero-trust functionality.

Firewall 148