Choose your cards and links to find matching recipes, with measured speeds and clearly labeled estimates.
Go to the calculator ยท How the numbers work
Matching recipes to your setup needs JavaScript. Every recipe is below as posted on the wiki.
Every recipe as posted
| Recipe | Cards | Links | 1 user tok/s | Many users tok/s | Prefill tok/s | Status |
|---|---|---|---|---|---|---|
| Qwen3.8 Flash NextQwen3.8 Flash Next on 1x 8 GB (ElectroHobo 3 bpw)Not reproduced yet: confirm on your own card | 1 x 8 GB | PCIe Gen2 x16, no P2P | 296.4 | 1,384 (48 users) | 4,243 | reported |
| Qwen3.8 27BQwen3.8 27B on 1x 8 GB (W4A16 vLLM)Add your confirmation | 1 x 8 GB | PCIe not stated, no P2P | 169.5 (users not stated) | not stated | not stated | proven |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE)Add your confirmation | 1 x 8 GB | PCIe not stated, no P2P | 110.99 | 667 (16 users) | 2,636 | proven |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (ElectroHobo W4A16 TP2)Add your confirmation | 2 x 8 GB | PCIe Gen2 x16, P2P needed | 349.7 | 1,937 (128 users) | 4,696 | proven |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (Plean PP2)Add your confirmation | 2 x 8 GB | PCIe not stated, no P2P | 197 (users not stated) | not stated | 5,800 | proven |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (mannydelrio PP2)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe Gen2 x4, no P2P | 177.8 | 734.2 (8 users) | 7,006 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (Qwen-Flash-SM80, GDS TEP2)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe Gen2 mixed, P2P needed | 168.29 | 749.67 (10 users) | 1,986.38 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (Morrowmake EXL3)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe x16, P2P needed | 152.6 | 674.7 (8 users) | 2,651 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (DUFRelic PP2)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe not stated, P2P optional | 133.39 | 245.17 (4 users) | 6,213.66 | reported |
| GLM 5.3 FlashGLM 5.3 Flash on 2x 8 GB (ExLlamaV3 TP2)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe Gen2 x16, P2P optional | 107.67 | 67.25 (2 users) | 1,533 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 2x 8 GB (vektorprime PP2)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe not stated, P2P not stated | 75.4 | not stated | not stated | reported |
| GLM 5.3 FlashGLM 5.3 Flash on 2x 8 GB (Project Maya)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe Gen2 x4, P2P not stated | 61.3 (users not stated) | not stated | 514 | reported |
| GLM 5.3 FlashGLM 5.3 Flash on 2x 8 GB (ExLlamaV3 layer split)Add your confirmation | 2 x 8 GB | PCIe not stated, no P2P | 60 (users not stated) | not stated | not stated | proven |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 2x 8 GB (Project Maya)Not reproduced yet: confirm on your own card | 2 x 8 GB | PCIe not stated, P2P not stated | 47 (users not stated) | not stated | 1,190 | reported |
| DeepSeek V4 FlashDeepSeek V4 Flash 0731 on 3x 8 GB (PP3 DSpark)Not reproduced yet: confirm on your own card | 3 x 8 GB | PCIe Gen2 x4, no P2P | 93 (users not stated) | not stated | not stated | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 3x 8 GB (clee PP3)Add your confirmation | 3 x 8 GB | PCIe x4, no P2P | 74.4 | not stated | 4,831 | proven |
| GLM 5.3 FlashGLM 5.3 Flash on 3x 8 GBNot reproduced yet: confirm on your own card | 3 x 8 GB | PCIe not stated, P2P not stated | not stated | not stated | not stated | reported |
| GLM 5.3 FlashGLM 5.3 Flash on 4x 8 GBAdd your confirmation | 4 x 8 GB | PCIe Gen2 x16, P2P optional | 442.1 | 835 (8 users) | 3,161 | proven |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB (Morrowmake)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe x16, P2P optional | 297 | 795 (8 users) | 3,776 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB (GNmac with copy fix and faster prefill)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x16, P2P needed | 283 | 559 (8 users) | 2,732 | reported |
| MiMo V2.6 FlashMiMo V2.6 Flash on 4x 8 GBNot reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x16, P2P needed | 274.9 | 738 (8 users) | 2,722 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB (GNmac)Add your confirmation | 4 x 8 GB | PCIe Gen2 x16, P2P needed | 258 | 544 (8 users) | 2,416 | proven |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash heretic on 4x 8 GBNot reproduced yet: confirm on your own card | 4 x 8 GB | PCIe not stated, P2P not stated | 158 | 323 (8 users) | 2,453 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB (CurtisAccelerate TC-MoE)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x16, no P2P | 144.2 | 271.6 (8 users) | 1,523 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 4x 8 GBNot reproduced yet: confirm on your own card | 4 x 8 GB | PCIe not stated, P2P not stated | 116.49 | not stated | 2,101.4 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB (alanoo fidelity build)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x16, P2P needed | 105 | 482.4 (8 users) | 2,514 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 4x 8 GB plus RTX PRO 6000 (ExLlamaV3 TP5)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe x16, no P2P | 99.9 | not stated | 2,116 | reported |
| DeepSeek V4 FlashDeepSeek V4 Flash 0731 on 4x 8 GB (allover326 PP4 DSpark)Add your confirmation | 4 x 8 GB | PCIe Gen2 x4, no P2P | 98.1 | 712.8 (64 users) | 5,300 | proven |
| GLM 5.3 FlashGLM 5.3 Flash on 4x 8 GB (kaka86mm EXL3 + Marlin sidecar + DFlash2)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x4, no P2P | 96 (users not stated) | 199 (4 users) | 2,077 | reported |
| Qwen3.8 Flash NextQwen3.8 Flash Next on 3x or 4x 8 GB (zebgop-ops FP8 PP)Not reproduced yet: confirm on your own card | 4 x 8 GB | PCIe Gen2 x4, no P2P | 89 | 442 (8 users) | 11,100 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 5x 8 GB (PP5 full residency)Not reproduced yet: confirm on your own card | 5 x 8 GB | PCIe Gen2 x16, P2P not stated | not stated | not stated | 4,600 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 6x 8 GB (Deepinfer-SM80 TP2 x PP3)Not reproduced yet: confirm on your own card | 6 x 8 GB | PCIe not stated, P2P not stated | 160.8 | not stated | 4,037 | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 6x 8 GB (TP6)Not reproduced yet: confirm on your own card | 6 x 8 GB | PCIe Gen2 x16, P2P not stated | 78.55 | not stated | not stated | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 8x 8 GB (Deepinfer-SM80 TP4 x PP2)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe not stated, P2P not stated | 153.35 | 620.22 (12 users) | 3,463 | reported |
| GLM 5.3 FlashGLM 5.3 Flash on 8x 8 GB (promisezackr PP8 NVFP4 DFlash2)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe Gen2 x4, no P2P | 123 | 276 (16 users) | not stated | reported |
| DeepSeek V4.1 FlashDeepSeek V4.1 Flash on 8x 8 GB (Zanooda PP8)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe Gen2 mixed, P2P optional | 117 | 560 (8 users) | 6,066 | reported |
| GLM 5.3GLM 5.3 on 8x 8 GB plus 2x RTX PRO 6000 (vLLM TP2 x PP5)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe Gen2 x16, P2P on | 104 | 244 (8 users) | 3,400 | reported |
| GLM 5.3GLM 5.3 on 8x 8 GB (cebeuq glm53-cmp170hx-recipe)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe Gen2 x16, P2P needed | 68.3 | 135.5 (8 users) | not stated | reported |
| GLM 5.3GLM 5.3 on 8x 8 GB (vllm-170hx-glm5)Add your confirmation | 8 x 8 GB | PCIe Gen2 x4, P2P not stated | 48.7 | 174.1 (8 users) | 1,833 | proven |
| GLM 5.2GLM 5.2 on 8x 8 GBNot reproduced yet: confirm on your own card | 8 x 8 GB | PCIe Gen1 x4, P2P not stated | 30 | not stated | 2,600 | reported |
| GLM 5.3GLM 5.3 on 8x 8 GB (Int4-Int8Mix PP8)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe not stated, P2P not stated | 25 | not stated | not stated | reported |
| Mistral Large 4Mistral Large 4 on 8x 8 GB (llama.cpp lab trial)Not reproduced yet: confirm on your own card | 8 x 8 GB | PCIe not stated, P2P on | 18.7 | 34.1 (8 users) | 131 | reported |
| Qwen3.6 27BQwen3.6 27B on 1x 10 GB (SGLang W8A8)Not reproduced yet: confirm on your own card | 1 x 10 GB | PCIe Gen1 x4, no P2P | 90.26 | 269.31 (4 users) | 4,122.16 | reported |
| Qwen3.6 27BQwen3.6 27B on 1x 10 GB (llama.cpp MTP)Not reproduced yet: confirm on your own card | 1 x 10 GB | PCIe Gen1 x4, no P2P | 46.24 (users not stated) | not stated | 496.85 | reported |
| Laguna-S-2.1Laguna-S-2.1 on 2x 10 GBNot reproduced yet: confirm on your own card | 2 x 10 GB | PCIe not stated, P2P not stated | 53 (users not stated) | not stated | not stated | reported |
| GLM 5.2GLM 5.2 on 3x 10 GB (llama.cpp CPU offload)Not reproduced yet: confirm on your own card | 3 x 10 GB | PCIe Gen2 x4, P2P not stated | 6.39 (users not stated) | not stated | 48.22 | reported |
| DeepSeek V4 FlashDeepSeek V4 Flash pruned on 4x 10 GBNot reproduced yet: confirm on your own card | 4 x 10 GB | PCIe Gen2 x4, P2P not stated | 48.2 (users not stated) | not stated | not stated | reported |
How estimates are made
Every speed on this page carries one of three labels.
- Measured: the recipe's own number, and your setup matches every link field the recipe states (card count, card variant, PCIe generation and width, P2P). Fields a recipe leaves out are listed as not stated. "Measured on N cards" means the recipe runs on N of your cards; no speedup is assumed for the rest.
- Estimated: your setup differs on a point where the wiki has a measured effect. The page starts from the recipe's number, applies each effect below as a range, and lists every step under the recipe.
- Unknown: your setup differs on a point with no measured effect on the wiki. The recipe's own number is shown for reference only.
Effects with a measured basis
- One card, x4 against x16 link width: up to about 3% decode and up to about 4x prefill. Measured once by @exile_1ck (2026-10-07) on one 10 GB card at 40 GB running Strata, an offload engine that streams over the link, so a model held whole in VRAM may gain less. Applied as a range from no change to the full measured effect. Source: PCIe x16 capacitor mod.
- One card, Gen1 against Gen2: up to 9% decode (3 to 9% across answer lengths) and up to 37% prefill. Measured by @eksitus (2026-07-27) on one 10 GB card, Qwen3.6-27B Q8 on ik_llama with MTP, both runs at x4. Applied as a range from no change to the full measured effect. Source: Benchmarks.
- No P2P on a tensor-parallel recipe that ran with P2P, or does not say: decode 0 to 40% lower, prefill 0 to 49% lower. The wiki's A/B results disagree (Contested): no difference on unmodded x4 cards (@deejay9983); with P2P about 8% more decode and 14% more prefill on two cards (@chonsworth); TP2 prefill at 128k 4,900 tok/s with P2P against 2,500 without (@ropuls); MiMo V2.6 Flash TP4 about 40% slower with P2P off (@nathang6866). Recipes marked P2P required are not estimated: they need P2P. Source: P2P.
- More cards than the recipe used: only where the wiki has the same model, quant and engine measured on fewer and on more cards than yours does the page show the range between those two measurements, and it names both recipes.
No measured basis
These differences are shown as Unknown or as a note, never as a number.
- Link width or generation on recipes with two or more cards: The wiki reports that the x16 mod is behind the top multi-card numbers and that each link upgrade raised multi-card tok/s, but gives no multiplier. Source: PCIe x16 capacitor mod.
- PCIe Gen3 and Gen4: No recipe or benchmark on the wiki was measured at Gen3 or Gen4. Source: PCIe Gen3 on the 10 GB card.
- x8 link width: No recipe states x8. Fitting 12 of the 24 capacitors gives x8, and a slot bifurcated x8x8 runs x8 regardless. Source: PCIe x16 capacitor mod.
- SM count: Recipes do not record it. Compute peaks rose about 5.7% from 70 to 74 SMs (the 74/70 ratio), but no tok/s pair exists, at 74 or above. Source: Full SM unlock.
- ECC: A cost of 0 to 10% was stated as an expectation, not measured, and the ECC page lists no measured performance impact. Source: ECC.
- 48 GB on the 10 GB card: No recipe was measured at 48 GB; it changes what fits, not the speed. Source: Memory unlock on the 10 GB card.
- The other card variant: An 8 GB recipe says nothing measured about the 10 GB card, and the other way round (64 GB against 40 GB per card, different HBM). Source: Memory unlock on the 10 GB card.
- Many users (aggregate) decode: None of the measured effects above was measured on aggregate throughput, so aggregate numbers are Measured or Unknown, never Estimated. Source: Benchmarks.
Comparing numbers
- Recipes use different benchmarks. Most use the MiaAI-Lab protocol (400-token answers, temperature 0, thinking off); the lab's bench uses 1,024-token answers; speculative decoding (DFlash2, DSpark, MTP) is on in most rows, and temperature 0 inflates draft acceptance against real use. Each recipe's own note is in its details. Source: Benchmarks.
- Status is recomputed the way the wiki does it: Proven once someone other than the tester adds a confirmation with result Reproduced, otherwise the recipe's own status. Each recipe's details link to the wiki's confirmation form for it, the same form as the "Confirm on your own card" button on the recipe page. Source: Status taxonomy.
The same data on the wiki: Recipe finder (filters by variant, cards, model, engine, P2P and PCIe), All recipes (every recipe in one table) and Benchmarks (every measurement with its setup). 47 recipes read from the wiki's Recipe table at 2026-11-11 23:18 UTC; refreshed every 10 minutes.
About this calculator and its sources
Pick your cards and how they are set up, and this page sorts every recipe on the wiki into what runs on that setup and what does not. Speeds come from the recipe pages. Where your setup differs from the one a recipe was measured on, the page gives an estimate only when the wiki has a measured basis for that difference, as a range with each step listed; otherwise it says unknown. Read the recipe page before you copy a command.