Expert-hotness promotion policy (X uses in Y seconds) for a Strata-like engine against vLLM's per-expert counters

Swimlane: Default swimlane
Column: Idea
Position: 18

Description

Reported by / on it: @sojun80, @wakeupmbrc1, @xtj7

Source: https://discord.com/channels/1518634379604136178/1518692084729511967/1557271757809918014

Wiki page: Engines (Strata and Project Maya)

Cards: both

Card D-102, seeded from the cmpunlocker Discord with credit (reference discord:1557271757809918014).

Sub-Tasks

Internal links

Comments