wrapped·Apr 26, 2026
/r/r_akcbpx5vcqayour run
Qwen2.5-0.5B-Instruct-4bit
on M3 Pro
287
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
1/11M3 Pro runstop 9%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- Qwen3-Coder-30B-A3B-Instruct on RTX 5090260 tok/s
- Qwen2.5-Coder-7B-Instruct on RTX 5090255 tok/s
- Qwen2.5-7B-Instruct on RTX 5090247 tok/s