Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > prefill tps: 1800-2500 & status: Reported

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash heretic on 4x 8 GB (1) · DeepSeek V4.1 Flash on 4x 8 GB plus RTX PRO 6000 (ExLlamaV3 TP5) (1) · Qwen3.8 Flash Next on 4x 8 GB (1)
model:
DeepSeek-V4.1-Flash-1017 (1) · DeepSeek-V4.1-Flash-1017 heretic (pqhaz abliteration) (1) · Qwen3.8-Flash-Next (1)
quant:
AWQ W4A16: wtdcode/Qwen3.8-Flash-Next-AWQ-W4A16 (1) · EXL3 3.5 bpw (LibertAIDAI; routed experts 4 bpw on layers 0-9 and 30-39, 3 bpw on 10-29; attention and shared experts 6 bpw) plus the official Engram shards (1) · Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16 with the 38 heretic attn.wo_b tensors (1)
engine:
ExLlamaV3 fork (anoane/exllamav3-anemone) + TabbyAPI fork (anoane/tabbyAPI) (1) · Morrowmake/vllm-cmp170hx (vLLM fork, container image) (1) · wtdcode/vllm-backport (image lazymio/vllm-backport:latest-sm80) (1)
engine version:
latest-sm80 tag as of 2026-10-16 (1) · recipe 1.0.0 (commit d4d1f525), engine a0c57b52 (1) · tag recipe-09 (309ef6d1); TabbyAPI deepseek-v41 (ce250ff) (1)
cards:
8 GB (3)
card count:
4 (3)
topology:
TP4 (1) · TP4 with expert parallel, MTP 3 (1) · TP5 across four CMP 170HX and one RTX PRO 6000 Blackwell (native backend, reduces through host memory); MTP draft on the PRO (1)
context:
1,000,000 (YaRN x4 from 262,144) (1) · 1,048,576 FP16 (1) · 262,144 (1)
decode tps:
99.9 (1) · 116.49 (1) · 158 (1)
prefill tps:
2,101.4 (1) · 2,116 (1) · 2,453 (1)
vram per card:
64 GB (1) · 64 GiB, --gpu-memory-utilization 0.92 (miner co-resident) (1) · gpu_split 58 GB per CMP, 70 GB on the PRO (1)
power cap:
None (2) · 150 W per CMP (PRO 400 W) (1)
driver:
None (2) · NVIDIA open 610.57.04 patched with Morrowmake/cmpunlocker 1f2c498 (profile 8gb) (1)
unlock build:
None (2) · Morrowmake/cmpunlocker 1f2c498; modprobe RmForceEnableGen2=1, RMPcieLinkSpeed=0x1, ForceP2P=0x11 (1)
status: (Click arrow to add another value)
tested by:
anoane (1) · darkmaniac7 (1) · matstatman (1)
tested on:
October 16, 2026 (1) · October 20, 2026 (1) · October 29, 2026 (1)
source:
https://discord.com/channels/1518634379604136178/1528826330454429706/1560602001908170753 (1) · https://github.com/anoane/09-deepseek-v41-flash-1017-exl3-tp5-1m (1) · https://github.com/Morrowmake/dsv41-flash-cmp170hx-recipe (1)

Showing below up to 3 results in range #1 to #3.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"