wrapped·Apr 28, 2026
/r/r_llzv_g-ymafyour run
Qwen2.5-7B-Instruct-4bit
on M3 Pro
30.5
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
3/11M3 Pro runstop 27%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- Muse-Spark-Open-816B-A42B-UD-00001-of-00005 on 3x A10026.3 tok/s
- llama3.2 on AMD64 Family 23 Model 104 Stepping 1, AuthenticAMD23.9 tok/s
- Llama-3.3-70B-Instruct on 2x RTX 309019.1 tok/s