← Back to all models
L

Llama 3.1 405B

by Meta
Flagship Open source 🏆 Ranked #13 of 22
77.6
Overall Score
out of 100
About

Meta's largest open-source model, competing directly with proprietary frontier models. Llama 3.1 405B can be self-hosted and fine-tuned, offering unmatched flexibility for organisations with data privacy requirements.

Key Metrics
Context Window
128K
tokens
Avg Response
1200
milliseconds
Input Cost
$3.0
per million tokens
Output Cost
$3.0
per million tokens
Arena ELO
1266
Chatbot Arena rating
MT-Bench
8.9
out of 10
Benchmark Scores
MMLU
88.6%
HumanEval
89.0%
MATH
73.8%
GPQA
51.1%
MT-Bench
89.0/10
Capability Profile
Strengths & Limitations
Strengths
✓ Open source ✓ Self-hostable ✓ Fine-tuneable ✓ Strong reasoning ✓ Privacy-friendly
Limitations
⚠ Requires significant compute ⚠ No official API SLA ⚠ Higher latency when self-hosted
Ideal Use Cases
On-premise deployment Fine-tuning research Privacy-sensitive tasks Academic research Custom applications
Model Details
Provider Meta
Released 2024-07-23
Open source Yes
Multimodal No
Tier Flagship
Global rank #13 / 22
Pricing (USD)
Input tokens $3.0/M
Output tokens $3.0/M
Per 1,000 tokens ≈ $0.0030 input / $0.0030 output
All Benchmarks
MMLU 88.6%
HumanEval 89.0%
MATH 73.8%
GPQA 51.1%
MT-Bench 8.9/10
Arena ELO 1266
Compare this model View leaderboard

You might also consider