Deploy Meta Llama 3.1-8B on AWS Inferentia using Amazon EKS and vLLM
AWS Machine Learning - AI
NOVEMBER 26, 2024
Before running the following commands, make sure you authenticate towards AWS : export AWS_REGION=us-east-1 export CLUSTER_NAME=my-cluster export EKS_VERSION=1.30 Before running the following commands, make sure you authenticate towards AWS : export AWS_REGION=us-east-1 export CLUSTER_NAME=my-cluster export EKS_VERSION=1.30
Let's personalize your content