Repository navigation

[`SwitchTransformer`] Significant performance improvement on MoE blocks - #31173

Merged

ArthurZucker merged 4 commits into

huggingface:mainfrom

ranggihwang:google_st_model

Jun 6, 2024

Merged

[`SwitchTransformer`] Significant performance improvement on MoE blocks#31173
ArthurZucker merged 4 commits into
huggingface:mainfrom
ranggihwang:google_st_model

Commits on Jun 3, 2024
- SwitchTransformer MoE layer performance improvement
  ranggihwang
  committed
  4965da6
- make fixup
  ranggihwang
  committed
  8e5bb3d
Commits on Jun 4, 2024
- comments about shapes
  ranggihwang
  committed
  3459299
- make fixup
  ranggihwang
  committed
  590cd13