Drilldown: Recipe
More actions
Recipe > decode tps:
110-150 
& source :
https://github.com/vektorprime/qwen38-flash-next-pp2 or
Other
& source :
https://github.com/vektorprime/qwen38-flash-next-pp2 or
Other Use the filters below to narrow your results.
page:
quant:
AutoRound 3 bpw + MTP: klee100/Qwen3.8-Flash-Next-AutoRound-3bpw-MTP; 95.37 GiB BF16 PLE table on SSD (1) ·
AWQ W4A16: wtdcode/Qwen3.8-Flash-Next-AWQ-W4A16 (1) ·
Hybrid: LibertAI EXL3 2.9 bpw routed experts (layers 0-39), official FP8/FP4 for attention, shared experts, head, draft and Engram; KV fp8_ds_mla (1) ·
Official checkpoint as downloaded: MXFP4 routed experts as Marlin W4A16, MXFP8 dense as Marlin W8A16; KV fp8 (1) ·
W4A16 INT4 g128 with the PLE table repacked INT4 g32: zankich/Qwen3.8-Flash-Next-W4A16-Merlin-INT4PLE-FP8KV; KV BF16 (1)
engine:
Morrowmake/vllm-cmp170hx (bind-mounted sm80 package) plus the author's tensor-core MoE kernels (1) ·
vLLM a5a30471 plus a 13-file downstream patch (native Linux AIO PLE reader) (1) ·
vLLM PR #56201 head (79a7108d) plus a 20-patch sm_80 series; image zanooda/vllm-sm80-ds41f:v41-sm80 (1) ·
vLLM v0.30.0 + zankich INT4-PLE plugin + six hash-guarded patch layers (1) ·
wtdcode/vllm-backport (image lazymio/vllm-backport:latest-sm80) (1)
engine version:
cards:
topology:
context:
decode tps:
prefill tps:
vram per card:
power cap:
driver:
unlock build:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 5 results in range #1 to #5.