Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > tested by : ZackO2o or greencandle9753 or iIIusi0n

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash on 4x 8 GB (GNmac) (1) · GLM 5.3 Flash on 2x 8 GB (Project Maya) (1) · Qwen3.8 Flash Next on 1x 8 GB (iIIusi0n SSD PLE) (1)
model:
DeepSeek-V4.1-Flash-1017 (1) · GLM-5.3-Flash (321B in the Maya README) (1) · Qwen3.8-Flash-Next (1)
quant:
AutoRound 3 bpw + MTP: klee100/Qwen3.8-Flash-Next-AutoRound-3bpw-MTP; 95.37 GiB BF16 PLE table on SSD (1) · Hybrid: routed experts EXL3 (mostly 3 bpw, 2 bpw on layers 18-22) from LibertAI's 2.9 bpw pack; attention, shared experts, indexer and DSpark drafter official FP8; KV fp8_ds_mla (1) · Maya-M GGUF (116 GB), every expert in VRAM; Maya-S (96.5 GB) and Maya-S24 (94.7 GB) also reported (1)
engine:
Project Maya (Strata and llama.cpp lineage, EXL3 loading, DFlash2 drafter) (1) · vLLM a5a30471 plus a 13-file downstream patch (native Linux AIO PLE reader) (1) · vLLM with a pinned sm_80 patch stack (built locally from source) (1)
engine version:
0.29.1rc1.dev402+ga5a30471f.ple1 (1) · recipe 1.2.0 (1) · v1.0.6 (this row) (1)
cards:
8 GB (3)
card count:
1 (1) · 2 (1) · 4 (1)
topology:
engine-managed split with expert tiering across VRAM, RAM and NVMe (1) · single card (1) · TP4 (default) or PP4 for x1/x4 links (1)
context:
None (1) · 262,144 (up to 1,048,576) (1) · 262,144 advertised (tested through 32K) (1)
decode tps:
61.3 (1) · 110.99 (1) · 258 (1)
prefill tps:
514 (1) · 2,416 (1) · 2,636 (1)
vram per card:
64 GB (1) · 64 GiB, --gpu-memory-utilization 0.96 (1) · 64 GiB, GPU_MEMORY_UTILIZATION 0.95 (1)
power cap:
None (1) · 180 W (1) · 180 W (nvidia-smi -pl 180) (1)
driver:
None (1) · 610.43.03 (1) · CUDA 13 capable; measured on 610.43.02 (1)
unlock build:
None (1) · cmpunlocker (64 GiB) (1) · cmpunlocker (64 GiB, 74 SMs) with a P2P-capable driver for TP4 (1)
status:
Proven (2) · Reported (1)
tested by: (Click arrow to add another value)
tested on:
September 19, 2026 (1) · October 26, 2026 (1)
source:
https://github.com/GNmac-lab/deepseek-v41-flash-1017-cmp170hx (1) · https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx (1) · https://github.com/mw00/project-maya#how-fast-is-it (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"