← Back to all models
P

Phi-3.5 Mini

by Microsoft
Efficient Free & Open Source 🏆 Ranked #68 of 85
61.9
Overall Score
out of 100
About

Microsoft's 3.8B parameter model trained on high-quality synthetic data. Phi-3.5 Mini delivers remarkable performance for its tiny size, competing with models 3x larger on reasoning and coding tasks.

Key Metrics
Context Window
128K
tokens
Avg Response
200
milliseconds
Input Cost
$0.025
per million tokens
Output Cost
$0.025
per million tokens
Arena ELO
1150
Chatbot Arena rating
MT-Bench
8.0
out of 10
Benchmark Scores
MMLU
69.0%
HumanEval
78.0%
MATH
69.0%
GPQA
30.0%
MT-Bench
80.0/10
Capability Profile
Strengths & Limitations
Strengths
✓ Tiny footprint ✓ Strong reasoning for size ✓ Open source ✓ Fast on CPU ✓ Low memory
Limitations
⚠ Limited complex reasoning ⚠ Smaller knowledge base ⚠ Best for focused tasks
Ideal Use Cases
Mobile AI Offline assistants Edge devices Personal productivity Lightweight coding
Model Details
Provider Microsoft
Released 2024-08-20
Type Free & Open Source
Multimodal No
Tier Efficient
Global rank #68 / 85
Pricing (USD)
Input tokens $0.025/M
Output tokens $0.025/M
Per 1,000 tokens ≈ $0.0000 input / $0.0000 output
All Benchmarks
MMLU 69.0%
HumanEval 78.0%
MATH 69.0%
GPQA 30.0%
MT-Bench 8.0/10
Arena ELO 1150
Compare this model View Rankings

You might also consider