← Back to all models
O

OLMo 3 7B

by AllenAI
Efficient Free & Open Source 🏆 Ranked #80 of 85
53.4
Overall Score
out of 100
About

Allen Institute for AI's open 7B language model built with full transparency — open data, open training code, open weights. A benchmark for truly open AI research.

Key Metrics
Context Window
4K
tokens
Avg Response
400
milliseconds
Input Cost
$0.04
per million tokens
Output Cost
$0.04
per million tokens
Arena ELO
1140
Chatbot Arena rating
MT-Bench
7.7
out of 10
Benchmark Scores
MMLU
65.0%
HumanEval
64.0%
MATH
45.0%
GPQA
27.0%
MT-Bench
77.0/10
Capability Profile
Strengths & Limitations
Strengths
✓ Fully open ✓ Research transparency ✓ Open training data ✓ Open source ✓ Good for research
Limitations
⚠ Less capable than commercial models ⚠ Smaller ecosystem ⚠ Below leading open-weights models
Ideal Use Cases
AI research Academic study Open-science projects Education Transparent AI development
Model Details
Provider AllenAI
Released 2025-02-01
Type Free & Open Source
Multimodal No
Tier Efficient
Global rank #80 / 85
Pricing (USD)
Input tokens $0.04/M
Output tokens $0.04/M
Per 1,000 tokens ≈ $0.0000 input / $0.0000 output
All Benchmarks
MMLU 65.0%
HumanEval 64.0%
MATH 45.0%
GPQA 27.0%
MT-Bench 7.7/10
Arena ELO 1140
Compare this model View Rankings

You might also consider