Drilldown: Recipe
More actions
Recipe > decode tps:
158-200 
& source :
https://github.com/DUFRelic/qwen38-flash-next-recipe or
Other
& source :
https://github.com/DUFRelic/qwen38-flash-next-recipe or
Other Use the filters below to narrow your results.
page:
model:
quant:
AWQ W4A16 g32 (leoncca/Qwen3.8-Flash-Next-Uncensored-AWQ-g32); PLE table converted to INT4 and served from SSD (1) ·
Hybrid: routed experts EXL3 2.9 bpw (LibertAIDAI), everything else official FP8/BF16 with the 38 heretic attn.wo_b tensors (1) ·
Mixed INT4 AutoRound (Minachist/Qwen3.8-Flash-Next-INT4-Mixed-AutoRound, about 65 GB) with the full BF16 PLE table on NVMe (1) ·
Official checkpoint (FP8 dense, FP4 experts); software FP8 on sm_80 (1) ·
W4A16 (INT4 weights, Marlin kernels) (1)
engine:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) (1) ·
vLLM (1) ·
vLLM 0.29.1rc1 nightly plus the checkpoint author's patches (1) ·
vLLM PR #56201 head (79a7108d) plus the two Deepinfer-SM80 patches and 30 drop-in modules (1) ·
wtdcode/vllm-backport 3142ded1 plus a two-file patch and two tinybeast PLE plugins (venv, no container) (1)
engine version:
cards:
topology:
context:
vram per card:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 5 results in range #1 to #5.