article thumbnail

Reduce ML training costs with Amazon SageMaker HyperPod

AWS Machine Learning - AI

Training a frontier model is highly compute-intensive, requiring a distributed system of hundreds, or thousands, of accelerated instances running for several weeks or months to complete a single job. For example, pre-training the Llama 3 70B model with 15 trillion training tokens took 6.5 During the training of Llama 3.1

Training 104
article thumbnail

ThirdAI raises $6M to democratize AI to any hardware

TechCrunch

Houston-based ThirdAI , a company building tools to speed up deep learning technology without the need for specialized hardware like graphics processing units, brought in $6 million in seed funding. Their algorithm, “sub-linear deep learning engine,” instead uses CPUs that don’t require specialized acceleration hardware.

Hardware 277
article thumbnail

Exafunction aims to reduce AI dev costs by abstracting away hardware

TechCrunch

But they share a common bottleneck: hardware. New techniques and chips designed to accelerate certain aspects of AI system development promise to (and, indeed, already have) cut hardware requirements. Emerging from stealth today, Exafunction is developing a platform to abstract away the complexity of using hardware to train AI systems.

Hardware 243
article thumbnail

Efficiently train models with large sequence lengths using Amazon SageMaker model parallel

AWS Machine Learning - AI

Across diverse industries—including healthcare, finance, and marketing—organizations are now engaged in pre-training and fine-tuning these increasingly larger LLMs, which often boast billions of parameters and larger input sequence length. This approach reduces memory pressure and enables efficient training of large models.

Training 104
article thumbnail

Dulling the impact of AI-fueled cyber threats with AI

CIO

While LLMs are trained on large amounts of information, they have expanded the attack surface for businesses. From prompt injections to poisoning training data, these critical vulnerabilities are ripe for exploitation, potentially leading to increased security risks for businesses deploying GenAI.

article thumbnail

Human firewalls: The first line of defense against cyber threats in 2025

CIO

While a firewall is simply hardware or software that identifies and blocks malicious traffic based on rules, a human firewall is a more versatile, real-time, and intelligent version that learns, identifies, and responds to security threats in a trained manner. The training has to result in behavioral change and be habit-forming.

Firewall 148
article thumbnail

Strength-training startup Tonal crosses unicorn status after raising $250M

TechCrunch

According to Tonal, the new funds will allow it to spend more on marketing its strength-training product to shoppers to increase brand visibility, grow its catalog of streamed fitness classes and invest further in operations and scaling its business to meet increased demand.

Training 248