RTX 5090 vs RTX 4090
MeasuredOn gpt-oss-20b (same quant and runtime family, chat-short), the RTX 5090 decoded at 324.2 tok/s and the RTX 4090 at 242.6 tok/s, each side's fastest matched run for that model.
Signed, community-submitted decode tok/s, prefill, and TTFT for RTX 5090 vs RTX 4090 — every number links to the run it came from.
On five matched pairs (same model, same quant, llama.cpp, chat-short), the RTX 5090 decoded faster every time, by 1.33× to 1.75×: LFM2.5-24B-A2B Q4_K_M at 308.5 vs 231.9 tok/s (≈1.33×, r_c8k6fleym09 vs r_bqmpv9kncyd); Qwen3.6-35B-A3B Q4_K_M at 224.0 vs 160.6 (≈1.39×, r_g1aw3mizd32 vs r_m6j1zxwvp-f); gemma-4-12b-it-qat Q4_0 at 141.1 vs 97.72 (≈1.44×, r_v5arqmazf31 vs r_jfh0qkngw76); Qwen3.6-27B Q4_K_M at 73.96 vs 47.14 (≈1.57×, r_f7ulllqu4vk vs r_d_wda_rw62f); and Qwen3.8-27B Q4_K_M at 75.19 vs 43.06 (≈1.75×, r_qfrb2zmyk0k vs r_11kn1epxewh). Ratios are calculated from single measured runs. Two of the 5090 quants come from the model file name. Only the LFM2.5 pair used the same llama.cpp build; the others ran on different hosts and builds, so these are measured reference points, not a controlled ranking. Five more models with runs on both cards (gpt-oss-20b, Qwen3-Coder-30B-A3B, Qwen2.5-Coder-14B, Qwen3-32B and Nemotron Bolt) are listed separately, because the 5090 runs don't record a quant. With MTP on, the 4090 measured 84.51 tok/s on Qwen3.8-27B (r_7j8rpk9mwhg); we have no 5090 MTP run yet, so don't compare MTP-on against MTP-off across cards.
How to read these results
On gpt-oss-20b, the RTX 5090 decoded at 324.2 tok/s and the RTX 4090 at 242.6 tok/s. Each row in the table is a like-for-like pair: the same model and size, quant and runtime family on the chat-short workload, using each side's fastest such run. Runs can still differ in host, runtime build and context. These are reference results, not a controlled speed or answer-quality ranking. Inspect both source runs before choosing hardware. 1 more model was measured on both but not like-for-like; they are listed separately in the "Not a like-for-like pair" table below and left out of the comparison.
Models that have data on both rigs
| Model | RTX 5090 decode | RTX 4090 decode | Δ | Source runs |
|---|---|---|---|---|
| gpt-oss-20b | 324.2tok/s chat-short · llama.cpp · Q4_K_M | 242.6tok/s chat-short · llama.cpp · Q4_K_M | +81.6 | r_dwp5fgdapmw · r_t-a9v_ipdit |
| LFM2.5-24B-A2B | 308.5tok/s chat-short · llama.cpp · Q4_K_M | 231.9tok/s chat-short · llama.cpp · Q4_K_M | +76.6 | r_c8k6fleym09 · r_bqmpv9kncyd |
| Qwen3-Coder-30B-A3B-Instruct | 304.9tok/s chat-short · llama.cpp · Q4_K_M | 232.5tok/s chat-short · llama.cpp · Q4_K_M | +72.4 | r_vsype4pm1ko · r_1k8942tw3zf |
| Qwen3.6-35B-A3B | 224.0tok/s chat-short · llama.cpp · Q4_K_M (from file name) | 160.6tok/s chat-short · llama.cpp · Q4_K_M | +63.4 | r_g1aw3mizd32 · r_m6j1zxwvp-f |
| gemma-4-12b-it-qat | 141.1tok/s chat-short · llama.cpp · Q4_0 | 97.72tok/s chat-short · llama.cpp · Q4_0 | +43.4 | r_v5arqmazf31 · r_jfh0qkngw76 |
| Qwen2.5-Coder-14B-Instruct | 137.3tok/s chat-short · llama.cpp · Q4_K_M | 89.87tok/s chat-short · llama.cpp · Q4_K_M | +47.4 | r_xnr_k4emoyr · r_eqnsqmgz29a |
| Qwen3.6-27B | 75.09tok/s chat-short · llama.cpp · Q4_K_M | 47.14tok/s chat-short · llama.cpp · Q4_K_M | +28.0 | r_pob-co51bd- · r_d_wda_rw62f |
| Qwen3.8-27B | 75.19tok/s chat-short · llama.cpp · Q4_K_M | 43.06tok/s chat-short · llama.cpp · Q4_K_M | +32.1 | r_qfrb2zmyk0k · r_11kn1epxewh |
| Qwen3-32B | 69.83tok/s chat-short · llama.cpp · Q4_K_M | 43.47tok/s chat-short · llama.cpp · Q4_K_M | +26.4 | r_vhbqyt1f_xr · r_ayy9rjgha5r |
Not a like-for-like pair
These have data on both sides, but the model size, quant or runtime differs, so they are not a head-to-head and are left out of the comparison above.
| Model | RTX 5090 decode | RTX 4090 decode | Why it isn't matched | Runs |
|---|---|---|---|---|
| NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB | 157.3tok/s llama.cpp · quant unreported | 107.3tok/s llama.cpp · quant unreported | quant unreported | r_ymx58emedxd · r_vkjsinuhlyl |
See also: RTX 5090 benchmarks · RTX 4090 benchmarks · All hardware · All models · Methodology
Request the missing runs
No measured run yet for these pairs. Vote for the one you want; the most-requested runs go first. See all requests.
We never sell or share your email. Privacy