Skip to content
llm-speed

RTX 5090 vs RTX 4090

MeasuredOn gpt-oss-20b (same quant and runtime family, chat-short), the RTX 5090 decoded at 324.2 tok/s and the RTX 4090 at 242.6 tok/s, each side's fastest matched run for that model.

Signed, community-submitted decode tok/s, prefill, and TTFT for RTX 5090 vs RTX 4090 — every number links to the run it came from.

Verdict (measured runs)

On five matched pairs (same model, same quant, llama.cpp, chat-short), the RTX 5090 decoded faster every time, by 1.33× to 1.75×: LFM2.5-24B-A2B Q4_K_M at 308.5 vs 231.9 tok/s (≈1.33×, r_c8k6fleym09 vs r_bqmpv9kncyd); Qwen3.6-35B-A3B Q4_K_M at 224.0 vs 160.6 (≈1.39×, r_g1aw3mizd32 vs r_m6j1zxwvp-f); gemma-4-12b-it-qat Q4_0 at 141.1 vs 97.72 (≈1.44×, r_v5arqmazf31 vs r_jfh0qkngw76); Qwen3.6-27B Q4_K_M at 73.96 vs 47.14 (≈1.57×, r_f7ulllqu4vk vs r_d_wda_rw62f); and Qwen3.8-27B Q4_K_M at 75.19 vs 43.06 (≈1.75×, r_qfrb2zmyk0k vs r_11kn1epxewh). Ratios are calculated from single measured runs. Two of the 5090 quants come from the model file name. Only the LFM2.5 pair used the same llama.cpp build; the others ran on different hosts and builds, so these are measured reference points, not a controlled ranking. Five more models with runs on both cards (gpt-oss-20b, Qwen3-Coder-30B-A3B, Qwen2.5-Coder-14B, Qwen3-32B and Nemotron Bolt) are listed separately, because the 5090 runs don't record a quant. With MTP on, the 4090 measured 84.51 tok/s on Qwen3.8-27B (r_7j8rpk9mwhg); we have no 5090 MTP run yet, so don't compare MTP-on against MTP-off across cards.

How to read these results

On gpt-oss-20b, the RTX 5090 decoded at 324.2 tok/s and the RTX 4090 at 242.6 tok/s. Each row in the table is a like-for-like pair: the same model and size, quant and runtime family on the chat-short workload, using each side's fastest such run. Runs can still differ in host, runtime build and context. These are reference results, not a controlled speed or answer-quality ranking. Inspect both source runs before choosing hardware. 1 more model was measured on both but not like-for-like; they are listed separately in the "Not a like-for-like pair" table below and left out of the comparison.

hardware
RTX 5090
NVIDIA Ada/Blackwell · 32 GB VRAM
View RTX 5090 page →
hardware
RTX 4090
NVIDIA Ada/Blackwell · 24 GB VRAM
View RTX 4090 page →

Models that have data on both rigs

ModelRTX 5090 decodeRTX 4090 decodeΔSource runs
gpt-oss-20b324.2tok/s
chat-short · llama.cpp · Q4_K_M
242.6tok/s
chat-short · llama.cpp · Q4_K_M
+81.6r_dwp5fgdapmw · r_t-a9v_ipdit
LFM2.5-24B-A2B308.5tok/s
chat-short · llama.cpp · Q4_K_M
231.9tok/s
chat-short · llama.cpp · Q4_K_M
+76.6r_c8k6fleym09 · r_bqmpv9kncyd
Qwen3-Coder-30B-A3B-Instruct304.9tok/s
chat-short · llama.cpp · Q4_K_M
232.5tok/s
chat-short · llama.cpp · Q4_K_M
+72.4r_vsype4pm1ko · r_1k8942tw3zf
Qwen3.6-35B-A3B224.0tok/s
chat-short · llama.cpp · Q4_K_M (from file name)
160.6tok/s
chat-short · llama.cpp · Q4_K_M
+63.4r_g1aw3mizd32 · r_m6j1zxwvp-f
gemma-4-12b-it-qat141.1tok/s
chat-short · llama.cpp · Q4_0
97.72tok/s
chat-short · llama.cpp · Q4_0
+43.4r_v5arqmazf31 · r_jfh0qkngw76
Qwen2.5-Coder-14B-Instruct137.3tok/s
chat-short · llama.cpp · Q4_K_M
89.87tok/s
chat-short · llama.cpp · Q4_K_M
+47.4r_xnr_k4emoyr · r_eqnsqmgz29a
Qwen3.6-27B75.09tok/s
chat-short · llama.cpp · Q4_K_M
47.14tok/s
chat-short · llama.cpp · Q4_K_M
+28.0r_pob-co51bd- · r_d_wda_rw62f
Qwen3.8-27B75.19tok/s
chat-short · llama.cpp · Q4_K_M
43.06tok/s
chat-short · llama.cpp · Q4_K_M
+32.1r_qfrb2zmyk0k · r_11kn1epxewh
Qwen3-32B69.83tok/s
chat-short · llama.cpp · Q4_K_M
43.47tok/s
chat-short · llama.cpp · Q4_K_M
+26.4r_vhbqyt1f_xr · r_ayy9rjgha5r

Not a like-for-like pair

These have data on both sides, but the model size, quant or runtime differs, so they are not a head-to-head and are left out of the comparison above.

ModelRTX 5090 decodeRTX 4090 decodeWhy it isn't matchedRuns
NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB157.3tok/s
llama.cpp · quant unreported
107.3tok/s
llama.cpp · quant unreported
quant unreportedr_ymx58emedxd · r_vkjsinuhlyl

See also: RTX 5090 benchmarks · RTX 4090 benchmarks · All hardware · All models · Methodology

Request the missing runs

No measured run yet for these pairs. Vote for the one you want; the most-requested runs go first. See all requests.

0 votes

We never sell or share your email. Privacy

We can rent this card · Submit your own