Page values for "Qwen3.8 27B on 1x 8 GB (W4A16 vLLM)"
From CMP Wiki
More actions
"Recipe" values
1 row is stored for this page| Field | Field type | Allowed values | Value |
|---|---|---|---|
| page | Page | Qwen3.8 27B on 1x 8 GB (W4A16 vLLM) | |
| model | String | Qwen3.8-27B (dense) | |
| quant | String | W4A16 (INT4 weights, Marlin kernels) | |
| engine | String | vLLM | |
| engine_version | String | ||
| cards | String | 8 GB · 10 GB · both | 8 GB |
| card_count | Integer | 1 | |
| topology | String | single card | |
| context | String | 262,144 native (YaRN to about 500k in the recipe's long variant) | |
| decode_tps | Float | 170.0 | |
| prefill_tps | Float | ||
| vram_per_card | String | 64 GB | |
| power_cap | String | ||
| driver | String | ||
| unlock_build | String | ||
| flags | Text | ||
| status | String | Proven · Reported · Theory · Contested · Warning | Reported |
| tested_by | String | kellertreppe123 | |
| tested_on | Date | 2026-10-05 | |
| source | String | https://www.reddit.com/r/LocalLLM/comments/1w2f03e/qwen3827b_w4a16_on_one_64_gb_cmp_170hx_16070/ | |
| files | Wikitext |