Drilldown: Recipe
More actions
Recipe > decode tps:
200-500 
& source :
https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx or
Other
& source :
https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx or
Other Use the filters below to narrow your results.
page:
model:
quant:
AutoRound mixed 2/3-bit (klee100, 2.998 effective bpw, 47 GiB on card) plus halt95's FP8 n-gram table in host RAM (1) ·
Hybrid: routed experts EXL3 (mostly 3 bpw, 2 bpw on layers 18-22) from LibertAI's 2.9 bpw pack; attention, shared experts, indexer and DSpark drafter official FP8; KV fp8_ds_mla (1) ·
Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16; KV BF16 (1) ·
NVFP4 (ModelOpt mixed precision): ProCreations/MiMo-V2.6-Flash-RL-NVFP4, run as 4-bit weights with BF16 activations through Marlin (1) ·
W4A16 (INT4 weights, group size 128, FP16 activations): canada-quant/GLM-5.3-Flash-W4A16-MTP (1) ·
W4A16: halt95/Qwen3.8-Flash-Next-W4A16-Merlin (AutoRound INT4 g128 experts, INT8 GDN projections, FP8 n-gram table) (1)
engine:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) (2) ·
Morrowmake/vllm-cmp170hx image (Qwen EXL3 release) with patch files mounted read-only (1) ·
Morrowmake/vllm-cmp170hx image (tag qwen38-recipe-1.0.0) plus one mounted file (vLLM #58235 vision-sink fix) (1) ·
Morrowmake/vllm-cmp170hx image with patch files mounted read-only (1) ·
vLLM with a pinned sm_80 patch stack (built locally from source) (1)
engine version:
cards:
topology:
context:
decode tps:
prefill tps:
vram per card:
power cap:
driver:
unlock build:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 6 results in range #1 to #6.