Jump to content
Toggle search
Toggle menu
CMP Wiki
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Drilldown: Recipe

More actions
Recipe > card count: 4-8 & decode tps: 150-300 & status: Reported

Use the filters below to narrow your results.

page:
DeepSeek V4.1 Flash heretic on 4x 8 GB (1) · DeepSeek V4.1 Flash on 4x 8 GB (Morrowmake) (1) · DeepSeek V4.1 Flash on 6x 8 GB (Deepinfer-SM80 TP2 x PP3) (1) · DeepSeek V4.1 Flash on 8x 8 GB (Deepinfer-SM80 TP4 x PP2) (1) · MiMo V2.6 Flash on 4x 8 GB (1)
model:
DeepSeek-V4.1-Flash-1017 (3) · DeepSeek-V4.1-Flash-1017 heretic (pqhaz abliteration) (1) · MiMo-V2.6-Flash-RL (309B MoE, 15B active; text, image, video and audio input) (1)
quant:
Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16 with the 38 heretic attn.wo_b tensors (1) · Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16; KV BF16 (1) · NVFP4 (ModelOpt mixed precision): ProCreations/MiMo-V2.6-Flash-RL-NVFP4, run as 4-bit weights with BF16 activations through Marlin (1) · Official checkpoint (FP8 dense, FP4 experts); software FP8 on sm_80 (2)
engine:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) (2) · Morrowmake/vllm-cmp170hx image (tag qwen38-recipe-1.0.0) plus one mounted file (vLLM #58235 vision-sink fix) (1) · vLLM PR #56201 head (79a7108d) plus the two Deepinfer-SM80 patches and 30 drop-in modules (2)
engine version:
Deepinfer-SM80 2a828fc lineage; vLLM v0.28.1rc0 base (1) · Deepinfer-SM80, vLLM v0.28.1rc0 base (1) · recipe 0.2.1; engine 18305948ac (1) · recipe 1.0.0 (commit d4d1f525), engine a0c57b52 (1) · recipe 1.0.0, engine a0c57b5237 (1)
cards:
8 GB (5)
card count:
4 (3) · 6 (1) · 8 (1)
topology:
TP2 x PP3, partition 14,14,12 (1) · TP4 (1) · TP4 (P2P on); expert parallel off (1) · TP4 with expert parallel (96 whole experts per card) (1) · TP4 x PP2, partition 20,20 (1)
context:
1,048,576 (3) · 262,144 (2)
decode tps:
153.35 (1) · 158 (1) · 160.8 (1) · 274.9 (1) · 287 (1)
prefill tps:
2,453 (1) · 2,722 (1) · 3,463 (1) · 3,818 (1) · 4,037 (1)
vram per card:
64 GiB (1) · 64 GiB exposed, --gpu-memory-utilization 0.95 (1) · 64 GiB, --gpu-memory-utilization 0.92 (miner co-resident) (1) · 64 GiB, --gpu-memory-utilization 0.95 (1) · 64 GiB; weights 45.5 GiB plus 10 GiB KV per card; GPU_UTIL 0.94 (fixed) (1)
power cap:
None (3) · 180 W (2)
driver:
None (3) · 580 or newer (measured on 610.57.04) (1) · NVIDIA 580 or newer; P2P needs the Morrowmake/cmpunlocker build (1)
unlock build:
None (3) · cmpunlocker (64 GiB, 74 SMs) with a P2P-capable build (1) · cmpunlocker (64 GiB, 74 SMs); Morrowmake/cmpunlocker for P2P (1)
status: (Click arrow to add another value)
tested by:
darkmaniac7 (1) · HalfVulpes (2) · nathang6866 (1) · voidgiraffe (1)
tested on:
October 18, 2026 (1) · October 24, 2026 (1) · October 28, 2026 (2) · October 29, 2026 (1)
source:
https://github.com/ElectroHobo/mimo-v26-flash-cmp170hx-recipe (1) · https://github.com/HalfVulpes/Deepinfer-SM80 (2) · https://github.com/Morrowmake/dsv41-flash-cmp170hx-recipe (2)

Showing below up to 5 results in range #1 to #5.

View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)


View (previous 250 | next 250) (20 | 50 | 100 | 250 | 500)

Retrieved from "https://cmp.wiki/wiki/Special:Drilldown/Recipe"