Drilldown: Recipe
More actions
Use the filters below to narrow your results.
page:
model:
quant:
AWQ W4A16 g32 (leoncca/Qwen3.8-Flash-Next-Uncensored-AWQ-g32); PLE table converted to INT4 and served from SSD (1) ·
EXL3 5.05 bpw; PLE (n-gram) table read from SSD (1) ·
Mixed INT4 AutoRound (Minachist/Qwen3.8-Flash-Next-INT4-Mixed-AutoRound, about 65 GB) with the full BF16 PLE table on NVMe (1) ·
W4A16 INT4 g128 with the PLE table repacked INT4 g32: zankich/Qwen3.8-Flash-Next-W4A16-Merlin-INT4PLE-FP8KV; KV BF16 (1) ·
W4A16: halt95/Qwen3.8-Flash-Next-W4A16-Merlin (AutoRound INT4 g128 experts, INT8 GDN projections, FP8 n-gram table) (1)
engine:
Morrowmake/vllm-cmp170hx (EXL3 path) (1) ·
Morrowmake/vllm-cmp170hx image (Qwen EXL3 release) with patch files mounted read-only (1) ·
vLLM 0.29.1rc1 nightly plus the checkpoint author's patches (1) ·
vLLM v0.30.0 + zankich INT4-PLE plugin + six hash-guarded patch layers (1) ·
wtdcode/vllm-backport 3142ded1 plus a two-file patch and two tinybeast PLE plugins (venv, no container) (1)
engine version:
cards:
card count:
topology:
context:
decode tps:
prefill tps:
vram per card:
power cap:
driver:
unlock build:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 5 results in range #1 to #5.