Jump to content
Toggle menu
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Page values for "DeepSeek V4.1 Flash on 8x 8 GB (Zanooda PP8)"

From CMP Wiki
More actions

"Recipe" values

1 row is stored for this page
FieldField typeAllowed valuesValue
pagePageDeepSeek V4.1 Flash on 8x 8 GB (Zanooda PP8)
modelStringDeepSeek-V4.1-Flash-1017
quantStringOfficial checkpoint as downloaded: MXFP4 routed experts as Marlin W4A16, MXFP8 dense as Marlin W8A16; KV fp8
engineStringvLLM PR #56201 head (79a7108d) plus a 20-patch sm_80 series; image zanooda/vllm-sm80-ds41f:v41-sm80
engine_versionStringrecipe 31318fd; patches 0001-0020
cardsString8 GB · 10 GB · both8 GB
card_countInteger8
topologyStringPP8, partition 5,5,5,5,5,5,5,5
contextString1,048,576
decode_tpsFloat117.0
prefill_tpsFloat6,066.0
vram_per_cardString64 GB; weights 35.9 GB per rank (ranks 1-6), 37.6 GB rank 0, 46.3 GB rank 7
power_capString180 W (one card unstable at 250 W)
driverString
unlock_buildStringcmpunlocker with the BAR1 P2P patches (64 GiB BAR1 per card)
flagsText--pipeline-parallel-size 8 --max-model-len 1048576 --gpu-memory-utilization 0.95 --block-size 128 --kv-cache-dtype fp8 --max-num-batched-tokens 4096 --max-num-seqs 32; DSpark 5; VLLM_DSV41_SPREAD_DECODE=2; --engram-config storage cpu
statusStringProven · Reported · Theory · Contested · WarningReported
tested_byStringZanooda
tested_onDate2026-10-19
sourceStringhttps://github.com/Zanooda/deepseek-v4.1-flash-cmp170hx
filesWikitext