Repository navigation

Fix EP + FSDP2: experts silently overwritten by rank-0 broadcast - #45662

Closed

AmineDiro wants to merge 6 commits into

huggingface:mainfrom

AmineDiro:fix-ep-fsdp-ignored-modules

Closed

Fix EP + FSDP2: experts silently overwritten by rank-0 broadcast#45662
AmineDiro wants to merge 6 commits into
huggingface:mainfrom
AmineDiro:fix-ep-fsdp-ignored-modules

Commits on May 13, 2026
- Fix EP+FSDP2: wrap EP-sharded params as DTensors and exclude experts from FSDP
  AmineDiro
  committed
  cd5ba10
- cleanup imports
  AmineDiro
  committed
  a0fa8b9
- Apply _local() to expert biases under EP
  AmineDiro
  committed
  635e88b
- Fix import ordering
  AmineDiro
  committed
  48c7eff
- Refactor EP sharding to apply DTensor wrapping during loading
  AmineDiro
  committed
  efe908e
- Merge branch 'main' into fix-ep-fsdp-ignored-modules
  AmineDiro
  authored
  57fdf6b