Drilldown: Recipe
More actions
Recipe > prefill tps:
1800-2500 
& source :
https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx or
Other
& source :
https://github.com/iIIusi0n/qwen3.8-flash-next-cmp170hx or
Other Use the filters below to narrow your results.
page:
model:
quant:
AWQ W4A16: wtdcode/Qwen3.8-Flash-Next-AWQ-W4A16 (1) ·
EXL3 3.5 bpw (LibertAIDAI; routed experts 4 bpw on layers 0-9 and 30-39, 3 bpw on 10-29; attention and shared experts 6 bpw) plus the official Engram shards (1) ·
GLM-5.3-Int4-Int8Mix-AWQ-g64; drafter incoai/GLM-5.3-DFlash2 (1) ·
Hybrid: routed experts EXL3 (mostly 3 bpw, 2 bpw on layers 18-22) from LibertAI's 2.9 bpw pack; attention, shared experts, indexer and DSpark drafter official FP8; KV fp8_ds_mla (1) ·
Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16 with the 38 heretic attn.wo_b tensors (1)
engine:
ExLlamaV3 fork (anoane/exllamav3-anemone) + TabbyAPI fork (anoane/tabbyAPI) (1) ·
Morrowmake/vllm-cmp170hx (vLLM fork, container image) (1) ·
Morrowmake/vllm-cmp170hx branch ampere-glm53 plus fail-closed source patches (1) ·
vLLM with a pinned sm_80 patch stack (built locally from source) (1) ·
wtdcode/vllm-backport (image lazymio/vllm-backport:latest-sm80) (1)
engine version:
cards:
topology:
context:
decode tps:
prefill tps:
vram per card:
power cap:
driver:
unlock build:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 5 results in range #1 to #5.