Drilldown: Recipe

Qwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE) (1)

Qwen3.8-Flash-Next (1)

AutoRound 3 bpw + MTP: klee100/Qwen3.8-Flash-Next-AutoRound-3bpw-MTP; 95.37 GiB BF16 PLE table on SSD (1)

vLLM a5a30471 plus a 13-file downstream patch (native Linux AIO PLE reader) (1)

0.29.1rc1.dev402+ga5a30471f.ple1 (1)

8 GB · Other · None

1 (1)

single card (1)

262,144 · 1,048,576 · None · 1,000,000 (YaRN x4 from 262,144) · 1,048,576 (YaRN x4) · 1,048,576 FP16 · 1,048,576 per request · 262,144 (256K in the post) · 262,144 (up to 1,048,576) · 262,144 (weights address 1,048,576) · 262,144 advertised (tested through 32K) · 262,144 native (YaRN to about 500k in the recipe's long variant) · 392,960 (profile q8_384k) · 392,960 per request; 655,360-token Q8 KV pool shared by two requests · about 1,000,000 (8-bit KV cache) · Other

110.99 (1)

2,636 (1)

64 GiB, --gpu-memory-utilization 0.96 (1)

180 W (1)

610.43.03 (1)

cmpunlocker (64 GiB) (1)

Proven (1)

iIIusi0n (1)

September 19, 2026 (1)

https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx (1)