Drilldown: Recipe

DeepSeek V4.1 Flash on 4x 8 GB (GNmac) (1)

DeepSeek-V4.1-Flash-1017 · Qwen3.8-Flash-Next · GLM-5.3-Flash (320B MoE, 18B active) · Qwen3.8-Flash-Next (125B MoE per the recipe) · DeepSeek-V4.1-Flash-1017 (748B in the Maya README) · DeepSeek-V4.1-Flash-1017 heretic (pqhaz abliteration) · GLM-5.3 (full 78-layer DSA MoE, not Flash) · GLM-5.3 (full 78-layer, not Flash) · GLM-5.3-Flash (321B in the Maya README) · MiMo-V2.6-Flash-RL (309B MoE, 15B active; text, image, video and audio input) · Qwen3.8-27B (dense) · Qwen3.8-Flash-Next-Uncensored (refusal-removed, from orcarouter) · Other · None

Hybrid: routed experts EXL3 (mostly 3 bpw, 2 bpw on layers 18-22) from LibertAI's 2.9 bpw pack; attention, shared experts, indexer and DSpark drafter official FP8; KV fp8_ds_mla (1)

vLLM with a pinned sm_80 patch stack (built locally from source) (1)

recipe 1.2.0 (1)

8 GB · Other · None

4 (1)

TP4 (default) or PP4 for x1/x4 links (1)

262,144 (up to 1,048,576) (1)

258 (1)

2,416 (1)

64 GiB, GPU_MEMORY_UTILIZATION 0.95 (1)

180 W (nvidia-smi -pl 180) (1)

None · 580 or newer (measured on 610.57.04) · NVIDIA 580 or newer; P2P needs the Morrowmake/cmpunlocker build · 580 or newer (measured on 610.57.04); open modules with HMM for the table-on-disk mode · 610.43.03 · 610.57.04 · CUDA 13 capable; measured on 610.43.02 · NVIDIA 610.43.02 · NVIDIA open 610.43.02 from a cmpunlocker fork with a P2P patch · NVIDIA open 610.57.04 patched with Morrowmake/cmpunlocker 1f2c498 (profile 8gb) · nvidia-open 610.43.02 + cmpunlocker v0.5 or newer · Other

cmpunlocker (64 GiB, 74 SMs) with a P2P-capable driver for TP4 (1)

Proven (1)

greencandle9753 (1)

October 26, 2026 (1)

https://github.com/GNmac-lab/deepseek-v41-flash-1017-cmp170hx (1)