Meet Llama 3.1

Llama 3.1 models

Flagship foundation model driving widest variety of use cases.

Highly performant, cost effective model that enables diverse use cases.

Light-weight, ultra-fast model you can run anywhere.

Start building more advanced use cases, leveraging our resources.

Tool use

Upload a dataset and analyze it. Prompt model to plot graphs and fetch market data.

Choose from real-time inference or batch inference services. Download model weights to further optimize cost per token.

Adapt for your application, improve with synthetic data and deploy on-prem or in the cloud.

Use Llama system components and extend the model using zero shot tool use and RAG to build agentic behaviors.

Leverage 405B high quality data to improve specialized models for specific use cases.

Features for
405B models

Real-time inference

Batch inference

Fine-tuning

Model evaluation

RAG

Continual pre-training

Safety guardrails

Synthetic data generation

Distillation recipe

As measured on over 150 benchmark datasets that span a wide range of languages and extensive human evaluations.

Llama 3.1 Performance

Benchmarks