Skip to content
llm-speed

Qwen2.5-Coder-7B-Instruct vs Qwen2.5-7B-Instruct

MeasuredOn the same M3 Ultra (same quant and runtime family, chat-short), Qwen2.5-Coder-7B-Instruct decoded at 138.6 tok/s and Qwen2.5-7B-Instruct at 139.6 tok/s, each model's fastest matched run on that hardware.

Signed, community-submitted decode tok/s, prefill, and TTFT for Qwen2.5-Coder-7B-Instruct vs Qwen2.5-7B-Instruct — every number links to the run it came from.

How to read these results

On the same M3 Ultra, Qwen2.5-Coder-7B-Instruct decoded at 138.6 tok/s and Qwen2.5-7B-Instruct at 139.6 tok/s. Each row in the table is a like-for-like pair: the same hardware, quant and runtime family on the chat-short workload, using each side's fastest such run. Runs can still differ in host, runtime build and context. These are reference results, not a controlled speed or answer-quality ranking. Inspect both source runs before choosing hardware. 1 more hardware config was measured on both but not like-for-like; they are listed separately in the "Not a like-for-like pair" table below and left out of the comparison.

model
Qwen2.5-Coder-7B-Instruct
Qwen · 7B
View Qwen2.5-Coder-7B-Instruct page →
model
Qwen2.5-7B-Instruct
Qwen · 7B
View Qwen2.5-7B-Instruct page →

Hardware with data on both models

HardwareQwen2.5-Coder-7B-Instruct decodeQwen2.5-7B-Instruct decodeΔSource runs
M3 Ultra (60-core GPU)138.6tok/s
chat-short · mlx · 4BIT (from file name)
139.6tok/s
chat-short · mlx · 4bit
-1.0r_uoehjq0nvc0 · r_5r6rhiynenc

Not a like-for-like pair

These have data on both sides, but the model size, quant or runtime differs, so they are not a head-to-head and are left out of the comparison above.

HardwareQwen2.5-Coder-7B-Instruct decodeQwen2.5-7B-Instruct decodeWhy it isn't matchedRuns
RTX 5090 (32GB)255.3tok/s
llama.cpp · quant unreported
246.7tok/s
llama.cpp · quant unreported
quant unreportedr_2b9o6y_49mi · r_3yn-4321hp-

See also: Qwen2.5-Coder-7B-Instruct benchmarks · Qwen2.5-7B-Instruct benchmarks · All hardware · All models · Methodology

Request the missing runs

No measured run yet for these pairs. Vote for the one you want; the most-requested runs go first. See all requests.

Qwen2.5-Coder-7B-Instruct on M3 Pro0 votes

We never sell or share your email. Privacy

Needs a community run · Submit your own