wrapped·Apr 28, 2026
/r/r_uoehjq0nvc0your run
Qwen2.5-Coder-7B-Instruct-4bit
on M3 Ultra
139
tok/sdecode
M3 Ultra (60-core GPU) + 96GB unified
rank in tier
7/26M3 Ultra runstop 27%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- llama3.1 on RTX 3090136 tok/s
- r1 on RTX 4090134 tok/s
- Qwen2.5-14B-Instruct on RTX 5090133 tok/s