Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > cards: Other & prefill tps: 5000-8000

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash on 8x 8 GB (Zanooda PP8) (1) · Qwen3.8 Flash Next on 2x 8 GB (DUFRelic PP2) (1) · Qwen3.8 Flash Next on 2x 8 GB (mannydelrio PP2) (1) · Qwen3.8 Flash Next on 2x 8 GB (Plean PP2) (1)
model:
DeepSeek-V4.1-Flash-1017 (1) · Qwen3.8-Flash-Next (2) · Qwen3.8-Flash-Next-Uncensored (refusal-removed, from orcarouter) (1)
quant:
AWQ W4A16 g32 (leoncca/Qwen3.8-Flash-Next-Uncensored-AWQ-g32); PLE table converted to INT4 and served from SSD (1) · Mixed INT4 AutoRound (Minachist/Qwen3.8-Flash-Next-INT4-Mixed-AutoRound, about 65 GB) with the full BF16 PLE table on NVMe (1) · Official checkpoint as downloaded: MXFP4 routed experts as Marlin W4A16, MXFP8 dense as Marlin W8A16; KV fp8 (1) · W4A16 INT4 g128 with the PLE table repacked INT4 g32: zankich/Qwen3.8-Flash-Next-W4A16-Merlin-INT4PLE-FP8KV; KV BF16 (1)
engine:
vLLM 0.29.1rc1 nightly plus the checkpoint author's patches (1) · vLLM PR #56201 head (79a7108d) plus a 20-patch sm_80 series; image zanooda/vllm-sm80-ds41f:v41-sm80 (1) · vLLM v0.30.0 + zankich INT4-PLE plugin + six hash-guarded patch layers (1) · wtdcode/vllm-backport 3142ded1 plus a two-file patch and two tinybeast PLE plugins (venv, no container) (1)
engine version:
None (1) · recipe 31318fd; patches 0001-0020 (1) · vLLM v0.30.0 (ced6857a); plugin zankich/vllm v0.29.0z (6609bfef) (1) · vllm-backport 3142ded1 (1)
cards: (Click arrow to add another value)
card count:
2 (3) · 8 (1)
topology:
PP2 (layer partition 25,23), no P2P (1) · PP2, MTP 3, no P2P (1) · PP2, MTP depth 3 (1) · PP8, partition 5,5,5,5,5,5,5,5 (1)
context:
1,048,576 (1) · 262,144 (2) · 262,144 (256K in the post) (1)
decode tps:
117 (1) · 133.39 (1) · 177.8 (1) · 197 (1)
prefill tps:
5,800 (1) · 6,066 (1) · 6,213.66 (1) · 7,006 (1)
vram per card:
64 GB (1) · 64 GB, --gpu-memory-utilization 0.94, TB_TORCH_MEM_CAP_GIB=61.5 (1) · 64 GB; weights 35.9 GB per rank (ranks 1-6), 37.6 GB rank 0, 46.3 GB rank 7 (1) · 64 GiB, --gpu-memory-utilization 0.90 (1)
power cap:
None (1) · 140 W (200 W observed-draw abort guard) (1) · 180 W (1) · 180 W (one card unstable at 250 W) (1)
driver:
None (2) · NVIDIA 610.43.02 (1) · nvidia-open 610.43.02 + cmpunlocker v0.5 or newer (1)
unlock build:
None (1) · amoghmunikote/cmpunlocker 6c442eeb (patch 0016 SM reconfig, 74 SMs) plus Bayley P2P patches 0011/0013/0015 (1) · cmpunlocker v0.5+ (sudo ./install.sh --profile=8gb --no-iommu) (1) · cmpunlocker with the BAR1 P2P patches (64 GiB BAR1 per card) (1)
status:
Reported (4)
tested by:
dufrelic (1) · mrmannyatx (1) · plean. (1) · Zanooda (1)
tested on:
October 3, 2026 (1) · October 7, 2026 (1) · October 15, 2026 (1) · October 19, 2026 (1)
source:
https://github.com/DUFRelic/qwen38-flash-next-recipe (1) · https://github.com/mannydelrio/qwen38-flash-next-2x-cmp170hx (1) · https://github.com/Zanooda/deepseek-v4.1-flash-cmp170hx (1) · https://www.bozocentral.com/2x-cmp170hx-qwen3-flash-next (1)

Showing below up to 4 results in range #1 to #4.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"