Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > card count: 2-3 & status: Proven

Use the filters below to narrow your results.

page:
GLM 5.3 Flash on 2x 8 GB (ExLlamaV3 layer split) (1) · Qwen3.8 Flash Next on 2x 8 GB (ElectroHobo W4A16 TP2) (1) · Qwen3.8 Flash Next on 3x 8 GB (clee PP3) (1)
model:
GLM-5.3-Flash (320B MoE, 18B active) (1) · Qwen3.8-Flash-Next (1) · Qwen3.8-Flash-Next (125B MoE per the recipe) (1)
quant:
EXL3 3.05 bpw: turboderp/GLM-5.3-Flash-exl3 (1) · W4A16 AutoRound: Intel/Qwen3.8-Flash-Next-W4A16-AutoRound; 95.4 GiB BF16 PLE table streamed from NVMe; KV fp8 e4m3 (software-decoded on SM80) (1) · W4A16: halt95/Qwen3.8-Flash-Next-W4A16-Merlin (AutoRound INT4 g128 experts, INT8 GDN projections, FP8 n-gram table) (1)
engine:
ExLlamaV3 1.5.4 (built for SM80) with a small OpenAI-compatible server (1) · Morrowmake/vllm-cmp170hx image (Qwen EXL3 release) with patch files mounted read-only (1) · vLLM nightly 7d0b4e57 plus the author's pure-Python fork clee/vllm-sm80 (branch q38fn/stack) (1)
engine version:
Flun/glm53-flash-cmp170hx-exl3 at 5933112 (1) · q38fn/stack on nightly-7d0b4e57 (1) · recipe 0.3.1; engine 18305948ac (1)
cards:
8 GB (3)
card count:
2 (2) · 3 (1)
topology:
layer split (no tensor parallel), no P2P (1) · PP3, no P2P (works at PP2 on two cards) (1) · TP2 with whole-expert expert parallel (1)
context:
1,048,576 (YaRN x4) (1) · 262,144 (1) · 392,960 (profile q8_384k) (1)
decode tps:
60 (1) · 74.4 (1) · 349.7 (1)
prefill tps:
None (1) · 4,696 (1) · 4,831 (1)
vram per card:
64 GiB, gpu-memory-utilization 0.92 (1) · 64 GiB, GPU_UTIL 0.95 (fixed) (1) · about 58 GiB of 64 GiB (116.6 GiB resident across both) (1)
power cap:
None (2) · 180 W (1)
driver:
None (2) · 580 or newer (measured on 610.57.04); open modules with HMM for the table-on-disk mode (1)
unlock build:
None (2) · cmpunlocker (64 GiB, 74 SMs) with a P2P-capable build (1)
status: (Click arrow to add another value)
tested by:
68x0 (1) · c133 (1) · nathang6866 (1)
tested on:
October 10, 2026 (1) · October 20, 2026 (1) · October 23, 2026 (1)
source:
https://github.com/clee/qwen3.8-flash-next-3x170hx (1) · https://github.com/ElectroHobo/qwen38-flash-next-w4a16-2x-cmp170hx-recipe (1) · https://github.com/Flun/glm53-flash-cmp170hx-exl3 (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"