Release turbine's all-reduce compression for TP4 (Qwen3.8-27B 440 tok/s, prefill about 4k)

Swimlane: Default swimlane
Column: Idea
Position: 14

Description

Reported by / on it: @turbine

Source: https://discord.com/channels/1518634379604136178/1518695328008638516/1556907874385662175

Wiki page: Qwen3.8 27B on 1x 8 GB (W4A16 vLLM)

Cards: both

Card D-098, seeded from the cmpunlocker Discord with credit (reference discord:1556907874385662175).

Sub-Tasks

Internal links

Comments