Drilldown: Recipe
More actions
Recipe > card count:
8 
& source :
https://github.com/alanoo81/deepseek-v41-flash-4x-cmp170hx or
Other
& source :
https://github.com/alanoo81/deepseek-v41-flash-4x-cmp170hx or
Other Use the filters below to narrow your results.
page:
model:
quant:
GLM-5.3-Int4-Int8Mix (INT4 / INT8 mix); KV fp8_ds_mla (1) ·
GLM-5.3-Int4-Int8Mix-AWQ-g64; drafter incoai/GLM-5.3-DFlash2 (1) ·
LibertAIDAI/GLM-5.3-Flash-NVFP4 (ModelOpt NVFP4, routed experts only, 181 GiB), run through Marlin W4A16 kernels; GLM-5.3-Flash DFlash2 drafter (5 sliding-window layers) (1) ·
Official checkpoint (FP8 dense, FP4 experts); software FP8 on sm_80 (1) ·
Official checkpoint as downloaded: MXFP4 routed experts as Marlin W4A16, MXFP8 dense as Marlin W8A16; KV fp8 (1)
engine:
Morrowmake/vllm-cmp170hx branch ampere-glm53 plus fail-closed source patches (1) ·
vLLM (build not stated) (1) ·
vLLM PR #56201 head (79a7108d) plus a 20-patch sm_80 series; image zanooda/vllm-sm80-ds41f:v41-sm80 (1) ·
vLLM PR #56201 head (79a7108d) plus the two Deepinfer-SM80 patches and 30 drop-in modules (1) ·
vLLM: official vllm/vllm-openai:glm53-flash image plus promisezackr's 24 patches (SM8x base from 344303947/vllm170hx, pipeline parallel for GLM-5.3-Flash, DFlash2 under PP8) (1)
engine version:
cards:
card count:
topology:
context:
decode tps:
vram per card:
power cap:
driver:
unlock build:
status:
tested by:
tested on:
source: (Click arrow to add another value)
Showing below up to 5 results in range #1 to #5.