Host concurrent LLMs with LoRAX
AWS Machine Learning - AI
APRIL 16, 2025
Under Firewall (security groups) , for Security group name , enter Inference Server Security Group. Factoring the operating system space, downloaded drivers and dependencies, and various project files, 128 GB is a safer storage size to start off with before adjusting up or down.
Let's personalize your content