Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > tested by : CurtisAccelerate or iIIusi0n or kellertreppe123

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash on 4x 8 GB (CurtisAccelerate TC-MoE) (1) · Qwen3.8 27B on 1x 8 GB (W4A16 vLLM) (1) · Qwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE) (1)
model:
DeepSeek-V4.1-Flash-1017 (1) · Qwen3.8-27B (dense) (1) · Qwen3.8-Flash-Next (1)
quant:
AutoRound 3 bpw + MTP: klee100/Qwen3.8-Flash-Next-AutoRound-3bpw-MTP; 95.37 GiB BF16 PLE table on SSD (1) · Hybrid: LibertAI EXL3 2.9 bpw routed experts (layers 0-39), official FP8/FP4 for attention, shared experts, head, draft and Engram; KV fp8_ds_mla (1) · W4A16 (INT4 weights, Marlin kernels) (1)
engine:
Morrowmake/vllm-cmp170hx (bind-mounted sm80 package) plus the author's tensor-core MoE kernels (1) · vLLM (1) · vLLM a5a30471 plus a 13-file downstream patch (native Linux AIO PLE reader) (1)
engine version:
None (1) · 0.29.1rc1.dev402+ga5a30471f.ple1 (1) · vllm-cmp170hx 18305948ac; TC-MoE fb9786ec (1)
cards:
8 GB (3)
card count:
1 (2) · 4 (1)
topology:
single card (2) · TP4, peer access off (NCCL_P2P_DISABLE=1), host all-reduce (1)
context:
262,144 (weights address 1,048,576) (1) · 262,144 advertised (tested through 32K) (1) · 262,144 native (YaRN to about 500k in the recipe's long variant) (1)
decode tps:
110.99 (1) · 144.2 (1) · 170 (1)
prefill tps:
None (1) · 1,523 (1) · 2,636 (1)
vram per card:
64 GB (1) · 64 GiB, --gpu-memory-utilization 0.96 (1) · about 62.5 GB used of 64 GB, --gpu-memory-utilization 0.97 (1)
power cap:
None (1) · 140 W (1) · 180 W (1)
driver:
None (2) · 610.43.03 (1)
unlock build:
None (2) · cmpunlocker (64 GiB) (1)
status:
Proven (1) · Reported (2)
tested by: (Click arrow to add another value)
tested on:
September 19, 2026 (1) · October 5, 2026 (1) · October 22, 2026 (1)
source:
https://github.com/CurtisAccelerate/DeepSeekv41-Flash-1017-EXL3-CMP170HX (1) · https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx (1) · https://www.reddit.com/r/LocalLLM/comments/1w2f03e/qwen3827b_w4a16_on_one_64_gb_cmp_170hx_16070/ (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"