Drilldown: Recipe
More actions
Recipe > engine 
:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) or
vLLM 0.29.1rc1 nightly plus the checkpoint author's patches
& decode tps:
442.1
:
Morrowmake/vllm-cmp170hx (vLLM fork, container image) or
vLLM 0.29.1rc1 nightly plus the checkpoint author's patches
& decode tps:
442.1 Use the filters below to narrow your results.
quant:
engine: (Click arrow to add another value)
engine version:
cards:
card count:
topology:
context:
decode tps:
prefill tps:
vram per card:
power cap:
status:
tested by:
tested on:
Showing below up to 1 result in range #1 to #1.