Drilldown: Recipe
More actions
Recipe > engine 
:
Custom SM80 vLLM (patched from public commit 79a7108d9) or
ExLlamaV3 1.5.4 (built for SM80) with a small OpenAI-compatible server
& source:
https://github.com/HalfVulpes/Deepinfer-SM80
:
Custom SM80 vLLM (patched from public commit 79a7108d9) or
ExLlamaV3 1.5.4 (built for SM80) with a small OpenAI-compatible server
& source:
https://github.com/HalfVulpes/Deepinfer-SM80 Use the filters below to narrow your results.
page:
(There are no values for this filter)
model:
(There are no values for this filter)
quant:
(There are no values for this filter)
engine: (Click arrow to add another value)
engine version:
(There are no values for this filter)
cards:
(There are no values for this filter)
card count:
(There are no values for this filter)
topology:
(There are no values for this filter)
context:
(There are no values for this filter)
decode tps:
(There are no values for this filter)
prefill tps:
(There are no values for this filter)
vram per card:
(There are no values for this filter)
power cap:
(There are no values for this filter)
driver:
(There are no values for this filter)
unlock build:
(There are no values for this filter)
status:
(There are no values for this filter)
tested by:
(There are no values for this filter)
tested on:
(There are no values for this filter)
source: (Click arrow to add another value)
There are no results for this report.