wrapped·Apr 26, 2026
/r/r_bftqtkilvoeyour run
Qwen2.5-0.5B-Instruct-4bit
on M3 Pro
282.6
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
2/11M3 Pro runstop 18%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- Qwen2.5-Coder-7B-Instruct on RTX 5090255.3 tok/s
- Qwen2.5-7B-Instruct on RTX 5090246.7 tok/s
- gpt-oss-20b on RTX 4090242.6 tok/s