Drilldown: Recipe

DeepSeek V4.1 Flash on 4x 8 GB (GNmac) (1)

DeepSeek-V4.1-Flash-1017 (1)

Hybrid: routed experts EXL3 (mostly 3 bpw, 2 bpw on layers 18-22) from LibertAI's 2.9 bpw pack; attention, shared experts, indexer and DSpark drafter official FP8; KV fp8_ds_mla (1)

vLLM with a pinned sm_80 patch stack (built locally from source) (1)

recipe 1.2.0 (1)

8 GB · Other · None

4 (1)

TP4 (default) or PP4 for x1/x4 links (1)

262,144 (up to 1,048,576) (1)

258 (1)

2,416 (1)

64 GiB, GPU_MEMORY_UTILIZATION 0.95 (1)

None · 180 W · 200 W · 140 W · 140 W (200 W observed-draw abort guard) · 150 W per CMP (PRO 400 W) · 170 W (author's 10-card run) · 180 W (author's cards); about 170 W with a modest memory OC in his Discord numbers · 180 W (nvidia-smi -pl 180) · 180 W (one card unstable at 250 W) · Other

None · 580 or newer (measured on 610.57.04) · NVIDIA 580 or newer; P2P needs the Morrowmake/cmpunlocker build · 580 or newer (measured on 610.57.04); open modules with HMM for the table-on-disk mode · 610.43.03 · 610.57.04 · CUDA 13 capable; measured on 610.43.02 · NVIDIA 610.43.02 · NVIDIA open 610.43.02 from a cmpunlocker fork with a P2P patch · NVIDIA open 610.57.04 patched with Morrowmake/cmpunlocker 1f2c498 (profile 8gb) · nvidia-open 610.43.02 + cmpunlocker v0.5 or newer · Other

cmpunlocker (64 GiB, 74 SMs) with a P2P-capable driver for TP4 (1)

Proven (1)

greencandle9753 (1)

October 26, 2026 (1)

https://github.com/GNmac-lab/deepseek-v41-flash-1017-cmp170hx (1)