Jump to content
Toggle menu
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Page values for "Qwen3.8 Flash Next on 2x 8 GB (mannydelrio PP2)"

From CMP Wiki
More actions

"Recipe" values

1 row is stored for this page
FieldField typeAllowed valuesValue
pagePageQwen3.8 Flash Next on 2x 8 GB (mannydelrio PP2)
modelStringQwen3.8-Flash-Next-Uncensored (refusal-removed, from orcarouter)
quantStringAWQ W4A16 g32 (leoncca/Qwen3.8-Flash-Next-Uncensored-AWQ-g32); PLE table converted to INT4 and served from SSD
engineStringwtdcode/vllm-backport 3142ded1 plus a two-file patch and two tinybeast PLE plugins (venv, no container)
engine_versionStringvllm-backport 3142ded1
cardsString8 GB · 10 GB · both8 GB
card_countInteger2
topologyStringPP2 (layer partition 25,23), no P2P
contextString262,144
decode_tpsFloat177.8
prefill_tpsFloat7,006.0
vram_per_cardString64 GB, --gpu-memory-utilization 0.94, TB_TORCH_MEM_CAP_GIB=61.5
power_capString180 W
driverStringnvidia-open 610.43.02 + cmpunlocker v0.5 or newer
unlock_buildStringcmpunlocker v0.5+ (sudo ./install.sh --profile=8gb --no-iommu)
flagsText'"`UNIQ--nowiki-0000004A-QINU`"'
statusStringProven · Reported · Theory · Contested · WarningReported
tested_byStringmrmannyatx
tested_onDate2026-10-15
sourceStringhttps://github.com/mannydelrio/qwen38-flash-next-2x-cmp170hx
filesWikitext