Qwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE)/Confirmation 1
From CMP Wiki
More actions
| Confirms | Qwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE) |
|---|---|
| Result | Reproduced |
| By | @tekkenz |
| Date | 2026-10-06 |
| Cards | 8 GB |
| Numbers | Prefill 3.5k tok/s with a 2,048-token chunk size. |
Served klee100/Qwen3.8-Flash-Next-AutoRound-3bpw-MTP with this patched vLLM; had to set MTP=3. Source: @tekkenz, 2026-10-06
Source: @tekkenz, 2026-10-06