Drilldown: Recipe
More actions
Recipe > engine 
:
ExLlamaV3 fork (anoane/exllamav3-anemone) + TabbyAPI fork (anoane/tabbyAPI) or
vLLM with a pinned sm_80 patch stack (built locally from source)
& source:
https://github.com/HalfVulpes/Deepinfer-SM80
:
ExLlamaV3 fork (anoane/exllamav3-anemone) + TabbyAPI fork (anoane/tabbyAPI) or
vLLM with a pinned sm_80 patch stack (built locally from source)
& source:
https://github.com/HalfVulpes/Deepinfer-SM80 Use the filters below to narrow your results.
page:
(There are no values for this filter)
model:
(There are no values for this filter)
quant:
(There are no values for this filter)
engine: (Click arrow to add another value)
engine version:
(There are no values for this filter)
cards:
(There are no values for this filter)
card count:
(There are no values for this filter)
topology:
(There are no values for this filter)
context:
(There are no values for this filter)
decode tps:
(There are no values for this filter)
prefill tps:
(There are no values for this filter)
vram per card:
(There are no values for this filter)
power cap:
(There are no values for this filter)
driver:
(There are no values for this filter)
unlock build:
(There are no values for this filter)
status:
(There are no values for this filter)
tested by:
(There are no values for this filter)
tested on:
(There are no values for this filter)
source: (Click arrow to add another value)
There are no results for this report.