Repository navigation

Add SDPA and FlashAttention support to T5 - #42453

Closed

DuyguA wants to merge 33 commits into

huggingface:mainfrom

DuyguA:refactor/t5-new-attention

Closed

Add SDPA and FlashAttention support to T5#42453
DuyguA wants to merge 33 commits into
huggingface:mainfrom
DuyguA:refactor/t5-new-attention

Commits on Nov 27, 2025
- changes for new attention interface
  DuyguA
  committed
  d678fb2
Commits on Dec 2, 2025
- no support for flash attn
  DuyguA
  committed
  fbe163f
- Merge branch 'main' into refactor/t5-new-attention
  DuyguA
  authored
  ae02420
- Merge branch 'main' into refactor/t5-new-attention
  DuyguA
  authored
  84cfb85
- restrict only eager attention
  DuyguA
  committed
  d93f0c4
- fixed typo
  DuyguA
  committed
  f9f47a4
- minor cosmetics
  DuyguA
  committed
  145b10f
- Merge branch 'main' into refactor/t5-new-attention
  DuyguA
  authored
  d0e14b1
Commits on Dec 9, 2025
- Merge branch 'main' into refactor/t5-new-attention
  DuyguA
  authored
  96beac5
- refactored pos bias into eager attention
  DuyguA
  committed
  56bbceb
- killed scaling
  DuyguA
  committed
  d8575e0
Commits on Dec 10, 2025
- added record hoops
  DuyguA
  committed
  15051a8
- fixed comma
  DuyguA
  committed
  a7bf5cc
Commits on Dec 11, 2025
- decorated forwards with can return tuple
  DuyguA
  committed
  113eab6
- propogated kwargs
  DuyguA
  committed
  617bed9
- style makeup
  DuyguA
  committed
  9f84341
- correction to bias compute
  DuyguA
  committed
  51100d3
Commits on Dec 12, 2025
- make interface structure
  vasqu
  committed
  59383d5
- Merge branch 'main' into refactor/t5-new-attention
  vasqu
  authored
  b4181df
- let's make things recordable
  vasqu
  committed
  c36948a
- style and simplify a bit
  vasqu
  committed
  6a54944
- skip these tests
  vasqu
  committed
  4e1e11c
- typing and proper err
  vasqu
  committed
  943bce3
Commits on Dec 16, 2025
- carried att changes from t5
  DuyguA
  committed
  1dd77a6
- added sdpa mask skip
  DuyguA
  committed
  5285186
- added basic att for longt5
  DuyguA
  committed
  286463a
- longt5 first shot
  DuyguA
  committed
  4af9a46
- fixed typo test
  DuyguA
  committed
  62efa74
- cosmetics
  DuyguA
  committed
  4b9ece7
- cosmetics
  DuyguA
  committed
  7d709c5
- checkout to old for now
  DuyguA
  committed
  232202b
- style fix
  DuyguA
  committed
  9d7cd48
- cosmetics to mt5 test
  DuyguA
  committed
  405a570

Commits

Commits on Nov 27, 2025

Commits on Dec 2, 2025

Commits on Dec 9, 2025

Commits on Dec 10, 2025

Commits on Dec 11, 2025

Commits on Dec 12, 2025

Commits on Dec 16, 2025