Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > card count: 4-8 & tested by : Zanooda or voidgiraffe

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash on 4x 8 GB (Morrowmake) (1) · DeepSeek V4.1 Flash on 8x 8 GB (Zanooda PP8) (1) · GLM 5.3 Flash on 4x 8 GB (1)
model:
DeepSeek-V4.1-Flash-1017 (2) · GLM-5.3-Flash (320B MoE, 18B active) (1)
quant:
Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16; KV BF16 (1) · Official checkpoint as downloaded: MXFP4 routed experts as Marlin W4A16, MXFP8 dense as Marlin W8A16; KV fp8 (1) · W4A16 (INT4 weights, group size 128, FP16 activations): canada-quant/GLM-5.3-Flash-W4A16-MTP (1)
engine:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) (2) · vLLM PR #56201 head (79a7108d) plus a 20-patch sm_80 series; image zanooda/vllm-sm80-ds41f:v41-sm80 (1)
engine version:
recipe 1.0.0, engine a0c57b5237 (1) · recipe 1.8.0, engine 819146023f (1) · recipe 31318fd; patches 0001-0020 (1)
cards:
8 GB (3)
card count:
4 (2) · 8 (1)
topology:
PP8, partition 5,5,5,5,5,5,5,5 (1) · TP4 (default) or PP4 (1) · TP4 with expert parallel (96 whole experts per card) (1)
context:
1,048,576 (1) · 262,144 (2)
decode tps:
117 (1) · 287 (1) · 442.1 (1)
prefill tps:
3,161 (1) · 3,818 (1) · 6,066 (1)
vram per card:
64 GB; weights 35.9 GB per rank (ranks 1-6), 37.6 GB rank 0, 46.3 GB rank 7 (1) · 64 GiB exposed, --gpu-memory-utilization 0.95 (2)
power cap:
180 W (2) · 180 W (one card unstable at 250 W) (1)
driver:
None (1) · NVIDIA 580 or newer; P2P needs the Morrowmake/cmpunlocker build (2)
unlock build:
cmpunlocker (64 GiB, 74 SMs); Morrowmake/cmpunlocker for P2P (2) · cmpunlocker with the BAR1 P2P patches (64 GiB BAR1 per card) (1)
status:
Proven (1) · Reported (2)
tested by: (Click arrow to add another value)
tested on:
October 16, 2026 (1) · October 19, 2026 (1) · October 24, 2026 (1)
source:
https://github.com/Morrowmake/dsv41-flash-cmp170hx-recipe (1) · https://github.com/Morrowmake/glm53-flash-cmp170hx-recipe (1) · https://github.com/Zanooda/deepseek-v4.1-flash-cmp170hx (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"