Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > tested by : ZackO2o or alanoo or vektor_prime

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash on 4x 8 GB (alanoo fidelity build) (1) · GLM 5.3 Flash on 2x 8 GB (Project Maya) (1) · Qwen3.8 Flash Next on 2x 8 GB (vektorprime PP2) (1)
model:
DeepSeek-V4.1-Flash-1017 (1) · GLM-5.3-Flash (321B in the Maya README) (1) · Qwen3.8-Flash-Next (1)
quant:
AWQ INT4: cyankiwi/Qwen3.8-Flash-Next-AWQ-INT4; 95 GiB BF16 PLE table in host RAM (FP8 table optional) (1) · Hybrid: all 40 expert layers at 3 bits (LibertAI 2.9 bpw pack with layers 18-22 grafted from the 3.5 bpw pack), official FP8 dense tensors (1) · Maya-M GGUF (116 GB), every expert in VRAM; Maya-S (96.5 GB) and Maya-S24 (94.7 GB) also reported (1)
engine:
GNmac-lab recipe image 1.2.0 (vLLM with sm_80 patches) plus three patches (1) · Project Maya (Strata and llama.cpp lineage, EXL3 loading, DFlash2 drafter) (1) · vLLM nightly + PR #53899 (a5530b9) + the repo's patch scripts (1)
engine version:
0.1.dev1+ga5530b90c.d20260829 (1) · GNmac-lab at 2ad5741ab1; image ds41-cmp170hx:1.2.0-fidelity (1) · v1.0.6 (this row) (1)
cards:
8 GB (3)
card count:
2 (2) · 4 (1)
topology:
engine-managed split with expert tiering across VRAM, RAM and NVMe (1) · PP2 with PLE CPU offload (1) · TP4, P2P on (1)
context:
None (1) · 262,144 (2)
decode tps:
61.3 (1) · 75.4 (1) · 105 (1)
prefill tps:
None (1) · 514 (1) · 2,514 (1)
vram per card:
64 GB (1) · 64 GiB (64,911 MiB usable), GPU_MEMORY_UTILIZATION 0.98 (1) · 64 GiB; weights PP0 39.48 GiB, PP1 45.53 GiB; --gpu-memory-utilization 0.9 (1)
power cap:
None (2) · 200 W (1)
driver:
None (2) · NVIDIA open 610.43.02 from a cmpunlocker fork with a P2P patch (1)
unlock build:
None (2) · cmpunlocker fork with P2P (without Morrowmake's TRAP31 patch) (1)
status:
Reported (3)
tested by: (Click arrow to add another value)
tested on:
August 2026 (1) · October 2026 (1)
source:
https://github.com/alanoo81/deepseek-v41-flash-4x-cmp170hx (1) · https://github.com/mw00/project-maya#how-fast-is-it (1) · https://github.com/vektorprime/qwen38-flash-next-pp2 (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"