Drilldown: Recipe

DeepSeek V4.1 Flash on 4x 8 GB (alanoo fidelity build) (1) · Qwen3.8 Flash Next on 1x 8 GB (ElectroHobo 3 bpw) (1) · Qwen3.8 Flash Next on 2x 8 GB (ElectroHobo W4A16 TP2) (1)

DeepSeek-V4.1-Flash-1017 (1) · Qwen3.8-Flash-Next (125B MoE per the recipe) (2)

AutoRound mixed 2/3-bit (klee100, 2.998 effective bpw, 47 GiB on card) plus halt95's FP8 n-gram table in host RAM (1) · Hybrid: all 40 expert layers at 3 bits (LibertAI 2.9 bpw pack with layers 18-22 grafted from the 3.5 bpw pack), official FP8 dense tensors (1) · W4A16: halt95/Qwen3.8-Flash-Next-W4A16-Merlin (AutoRound INT4 g128 experts, INT8 GDN projections, FP8 n-gram table) (1)

GNmac-lab recipe image 1.2.0 (vLLM with sm_80 patches) plus three patches (1) · Morrowmake/vllm-cmp170hx image (Qwen EXL3 release) with patch files mounted read-only (1) · Morrowmake/vllm-cmp170hx image with patch files mounted read-only (1)

GNmac-lab at 2ad5741ab1; image ds41-cmp170hx:1.2.0-fidelity (1) · recipe 0.2.1; engine 18305948ac (1) · recipe 0.3.1; engine 18305948ac (1)

8 GB (3)

1 (1) · 2 (1) · 4 (1)

single card (1) · TP2 with whole-expert expert parallel (1) · TP4, P2P on (1)

262,144 · 1,048,576 · None · 1,000,000 (YaRN x4 from 262,144) · 1,048,576 (YaRN x4) · 1,048,576 FP16 · 1,048,576 per request · 262,144 (256K in the post) · 262,144 (up to 1,048,576) · 262,144 (weights address 1,048,576) · 262,144 advertised (tested through 32K) · 262,144 native (YaRN to about 500k in the recipe's long variant) · 392,960 (profile q8_384k) · 392,960 per request; 655,360-token Q8 KV pool shared by two requests · about 1,000,000 (8-bit KV cache) · Other

105 (1) · 296.4 (1) · 349.7 (1)

2,514 (1) · 4,243 (1) · 4,696 (1)

64 GiB (64,911 MiB usable), GPU_MEMORY_UTILIZATION 0.98 (1) · 64 GiB, --gpu-memory-utilization 0.95 (fixed) (1) · 64 GiB, GPU_UTIL 0.95 (fixed) (1)

180 W (2) · 200 W (1)

580 or newer (measured on 610.57.04) (1) · 580 or newer (measured on 610.57.04); open modules with HMM for the table-on-disk mode (1) · NVIDIA open 610.43.02 from a cmpunlocker fork with a P2P patch (1)

cmpunlocker (64 GiB, 74 SMs) (1) · cmpunlocker (64 GiB, 74 SMs) with a P2P-capable build (1) · cmpunlocker fork with P2P (without Morrowmake's TRAP31 patch) (1)

Proven (1) · Reported (2)

nathang6866 · voidgiraffe · HalfVulpes · 1a2b3c0967 · 68x0 · alanoo · anoane · c133 · CurtisAccelerate · darkmaniac7 · dufrelic · greencandle9753 · iIIusi0n · kellertreppe123 · matstatman · mrmannyatx · nestaa51 · pcsv. · plean. · reala7096 · shirogeek · vektor_prime · wgkbfcp · ZackO2o · Zanooda · Other · None

October 23, 2026 (2) · October 27, 2026 (1)

https://github.com/alanoo81/deepseek-v41-flash-4x-cmp170hx (1) · https://github.com/ElectroHobo/qwen38-flash-next-3bpw-1x-cmp170hx-recipe (1) · https://github.com/ElectroHobo/qwen38-flash-next-w4a16-2x-cmp170hx-recipe (1)