Skip to content

EP: keep attention replicated when tp_size cannot split the KV heads (v5.19 regression) - #49632

Closed
dacorvo wants to merge 1 commit into
mainfrom
ep-replicate-unsplittable-attention
Closed

EP: keep attention replicated when tp_size cannot split the KV heads (v5.19 regression)#49632
dacorvo wants to merge 1 commit into
mainfrom
ep-replicate-unsplittable-attention

fix(distributed): keep attention replicated under EP when tp_size can…

278cd95
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
trufflehog
succeeded Oct 15, 2026 in 1m 22s