Skip to content
llm-speed
Leaderboard/hardware/m4-max-40-core-gpu

M4 Max LLM benchmark

The highest recorded decode rate in these M4 Max submissions is from qwen3-coder-bench-32k (30.5B) at 113.3 decode tok/s via ollama (source run). This page contains 17 workload rows from 5 submitted runs across 2 model labels. Model sizes, workloads and reported hardware configurations differ; the highest rate is not a quality ranking or a speed guarantee.

Fastest single result in these submissions (any model size)

113.3 decode tok/s

qwen3-coder-bench-32k (30.5B) via ollama (Q4_K_M). Workload: chat-short. Reported hardware: M4 Max (40-core GPU) + 128GB unified. see full run

qwen3-coder-bench-32k

WorkloadModel sizeReported hardwareBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-short30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M113.3tok/s84.12tok/s1,308msr_roktphpc--8
chat-long30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M97.40tok/s1,342.8tok/s2,344msr_roktphpc--8
concurrent-decode30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M109.7tok/sno datano datar_roktphpc--8
agent-trace30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M103.2tok/s3,371.6tok/s477msr_roktphpc--8

qwen3-coder

WorkloadModel sizeReported hardwareBackendQuantdecode tok/sprefill tok/sTTFTRun
chat-short30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M94.51tok/s65.06tok/s1,691msr_r0di2hkku1h
chat-long30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M97.35tok/s1,397.3tok/s2,252msr_r0di2hkku1h
concurrent-decode30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M109.9tok/sno datano datar_r0di2hkku1h
agent-trace30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_Mno datano datano datar_r0di2hkku1h
chat-short30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M55.45tok/s675.2tok/s163msr_1o8q4lhgj88
chat-long30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M57.86tok/s28,422.4tok/s111msr_1o8q4lhgj88
concurrent-decode30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M67.01tok/sno datano datar_1o8q4lhgj88
agent-trace30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_Mno datano datano datar_1o8q4lhgj88
chat-short30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M92.70tok/s719.0tok/s153msr_40h1dznuznk
chat-long30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M94.61tok/s1,396.5tok/s2,253msr_40h1dznuznk
concurrent-decode30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M109.1tok/sno datano datar_40h1dznuznk
agent-trace30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_Mno datano datano datar_40h1dznuznk
chat-short30.5B
M4 Max (40-core GPU) + 128GB unified
ollama@0.30.11Q4_K_M93.17tok/s13.30tok/s8,270msr_txvkjgoyyxs

Models measured on M4 Max