Repository navigation

Apply GradientCheckpointingLayer to the whole repo - #38913

Merged

Cyrilvallez merged 148 commits into

huggingface:mainfrom

qubvel:gradient-checkpointing-layer-propagation

Jun 23, 2025

Merged

Apply GradientCheckpointingLayer to the whole repo#38913
Cyrilvallez merged 148 commits into
huggingface:mainfrom
qubvel:gradient-checkpointing-layer-propagation

Commits on Jun 19, 2025
- first batch (4)
  qubvel
  committed
  a97ca9f
- align
  qubvel
  committed
  2627646
- altclip
  qubvel
  committed
  c8926f7
- beit
  qubvel
  committed
  ae1b29a
- bert
  qubvel
  committed
  4dff076
- yolos
  qubvel
  committed
  0d0d8c7
- dino, pvt_v2
  qubvel
  committed
  8b66428
- bark, bart, bert_generation
  qubvel
  committed
  0d387eb
- big_bird, biogpt
  qubvel
  committed
  6faee3f
- blnderbot, bloom
  qubvel
  committed
  3f34606
- bridgetower
  qubvel
  committed
  3bb70d9
- camambert, canine, chameleon
  qubvel
  committed
  5757f3e
- chinese clip, clap, clip
  qubvel
  committed
  c59a7d5
- codegen, conditional detr, convbert
  qubvel
  committed
  d7cb795
- dab_detr, data2vec
  qubvel
  committed
  39784f7
- dbrx, deberta
  qubvel
  committed
  203348d
- deberta, decicion_tranformer, deformable_detr
  qubvel
  committed
  b2719f3
- deit, deta, mctct
  qubvel
  committed
  2ed2c5b
- detr, dinov2, distilbert
  qubvel
  committed
  87704a7
- donut, dpt, electra
  qubvel
  committed
  cd69033
- ernie, esm, falcon
  qubvel
  committed
  9a54ad1
- flava, fnet, falcon_mamba
  qubvel
  committed
  6855515
- focalnet, git, gpt2
  qubvel
  committed
  f4f8319
- gpt - bigcode, neo, neox
  qubvel
  committed
  b8f4ecf
- gptj, groupvit
  qubvel
  committed
  d844b12
- idefics2, idefics3
  qubvel
  committed
  700d20d
- ijepa, imagegpt, internvl
  qubvel
  committed
  0b3ffba
- jetmoe, kosmos2, layoutlm
  qubvel
  committed
  9ed27ef
- layoutlm2-3, led
  qubvel
  committed
  6d3ecbc
- lilt, longformer, longt5, luke
  qubvel
  committed
  e398d8e
- m2m, mamba1-2
  qubvel
  committed
  4363156
- marian, markuplm, mask2former
  qubvel
  committed
  dde58de
- maskformer
  qubvel
  committed
  69b2cf8
- mbart, megatron_bert, mimi
  qubvel
  committed
  d4ccb79
- mixtral, mlcd
  qubvel
  committed
  ab213da
- mobilevit1-2, modernbert
  qubvel
  committed
  cb90916
- moshi, mpt, mra
  qubvel
  committed
  c2d3cbc
- mt5, musicgen
  qubvel
  committed
  80bcd7c
- mvp, nemotron
  qubvel
  committed
  825e2b1
- nllb_moe
  qubvel
  committed
  8f6a8fb
- nystromformer, omdet_turbo
  qubvel
  committed
  6253d78
- opt, owlvit, owlv2
  qubvel
  committed
  ab136ef
- pegasus, pegasus_x, presimmon
  qubvel
  committed
  3fb64a9
- phimoe, pix2struct, pixtral
  qubvel
  committed
  32b2876
- plbart, pop2piano, prophetnet
  qubvel
  committed
  942f7a4
- qwen2*
  qubvel
  committed
  b083c86
- qwen2, qwen3 moe, rec gemma
  qubvel
  committed
  429ba11
- rembert
  qubvel
  committed
  cec0d32
- roberta
  qubvel
  committed
  bec1fcd
- roberta prelayernorm
  qubvel
  committed
  254882f
- roc_bert, roformer, rwkv
  qubvel
  committed
  a1a7fda
- sam, sam_hq
  qubvel
  committed
  d497df9
- seggpt, smolvlm, speech_to_text
  qubvel
  committed
  987a880
- splinter, stablelm, swin
  qubvel
  committed
  6ef90e1
- swin2sr, switch_transformer, t5, table_transformer
  qubvel
  committed
  1b7cc3f
- tapas, time_series_tranformer, timesformer
  qubvel
  committed
  5331bc2
- trocr, tvp, umt5
  qubvel
  committed
  dfe3d8d
- videomae, vilt, visual_bert
  qubvel
  committed
  c001253
- vit, vit_mae, vit_msn
  qubvel
  committed
  76dd7a5
- vitpose_backbone, vits, vivit
  qubvel
  committed
  0bc5335
- whisper. x_clip, xglm
  qubvel
  committed
  43992d9
- xlm_roberta, xmod
  qubvel
  committed
  461961b
- yoso
  qubvel
  committed
  cf470fd
- zamba
  qubvel
  committed
  626dde0
- vitdet, wav2vec2, wav2vec2_bert
  qubvel
  committed
  59f8879
- unispeech, wav2vec_conformer
  qubvel
  committed
  b89a5db
- wavlm
  qubvel
  committed
  db524cb
- speecht5
  qubvel
  committed
  96db85e
- swinv2
  qubvel
  committed
  279041b
- sew / _d
  qubvel
  committed
  5a3b571
- seamless_mt4 / _v2
  qubvel
  committed
  b1d78cd
- deprecated models update
  qubvel
  committed
  9a6d135
- bros
  qubvel
  committed
  a18e257
- gemma2, gemma3
  qubvel
  committed
  66d0a62
- got, hiera, hubert, llama4, mllama, oneformer, phi, olmoe, informer
  qubvel
  committed
  c0e5690
- fixup
  qubvel
  committed
  0942755
- Add use_cache=False and past_key_value=None to GradientCheckpointingLayer
  qubvel
  committed
  fe80395
- fixup
  qubvel
  committed
  d7963dc
Commits on Jun 20, 2025
- fix prophetnet
  qubvel
  committed
  73d5614
- fix bigbird_pegasus
  qubvel
  committed
  cd7a426
- fix blenderbot
  qubvel
  committed
  56cb34b
- fix mbart
  qubvel
  committed
  0347dde
- fix mvp
  qubvel
  committed
  e83086d
- fix zamba2
  qubvel
  committed
  afbfd62
- fix bart
  qubvel
  committed
  68f317c
- fix blenderbot_small
  qubvel
  committed
  98fb670
- fix codegen
  qubvel
  committed
  2fd38a3
- Update gradient checkpointing layer to support more past_key_values arg names
  qubvel
  committed
  5347767
- fix data2vec vision
  qubvel
  committed
  10f5fd1
- fix deformable_detr
  qubvel
  committed
  792cd7d
- fix gptj
  qubvel
  committed
  36415c3
- fix led
  qubvel
  committed
  ff802fe
- fix m2m_100
  qubvel
  committed
  fc14014
- add comment
  qubvel
  committed
  f2cc865
- fix nnlb_moe
  qubvel
  committed
  eab402d
- Fix pegasus_x
  qubvel
  committed
  aa1f574
- fix plbart
  qubvel
  committed
  7c9d17d
- udop
  qubvel
  committed
  5da2216
- fix-copies: beit, wav2vec2
  qubvel
  committed
  999584c
- fix gpt_bigcode
  qubvel
  committed
  ff33682
- fixup
  qubvel
  committed
  c28e913
- fix t5
  qubvel
  committed
  8104bfb
- fix switch_transformers
  qubvel
  committed
  f9a2db8
- fix longt5
  qubvel
  committed
  fe1133e
- fix mt5
  qubvel
  committed
  e51772a
- update tapas
  qubvel
  committed
  69a6a78
- fix blip2
  qubvel
  committed
  eb20826
- update blip
  qubvel
  committed
  eba9a9a
- fix musicgen
  qubvel
  committed
  aa71309
- fix gpt2, trocr
  qubvel
  committed
  c0b3084
- fix copies
  qubvel
  committed
  b6ac147
- !!! Revert zamba, mllama
  qubvel
  committed
  481ae6f
- update autoformer
  qubvel
  committed
  07e0995
- update bros
  qubvel
  committed
  a2c8bd6
- update args / kwargs for BERT and copies
  qubvel
  committed
  3160753
- 2nd round of updates
  qubvel
  committed
  1f3d7b0
- update conditional detr
  qubvel
  committed
  32433aa
- Pass encoder_hidden_states as positional arg
  qubvel
  committed
  95365b1
- Update to pass encoder_decoder_position_bias as positional arg
  qubvel
  committed
  aad2b9e
- fixup
  qubvel
  committed
  d34726d
- biogpt modular
  qubvel
  committed
  55011be
- modular gemma2
  qubvel
  committed
  a71d201
- modular gemma3
  qubvel
  committed
  0d72857
- modular gpt_neox
  qubvel
  committed
  522df43
- modular informer
  qubvel
  committed
  30a9a90
- modular internvl
  qubvel
  committed
  89a2c68
- modular mixtral
  qubvel
  committed
  633378c
- modular mlcd
  qubvel
  committed
  8493bad
- modular modernbert
  qubvel
  committed
  adf5c60
- modular phi
  qubvel
  committed
  6270ff7
- modular qwen2_5_omni
  qubvel
  committed
  3ad1fa9
- modular qwen2_5_vl
  qubvel
  committed
  7626b31
- modular sam_hq
  qubvel
  committed
  e3c61ce
- modular sew
  qubvel
  committed
  01934cf
- wav2vec2_bert
  qubvel
  committed
  62683dc
- modular wav2vec2_conformer
  qubvel
  committed
  28bd09c
- modular wavlm
  qubvel
  committed
  5bc6525
- fixup
  qubvel
  committed
  31dbec4
- Update by modular instructblipvideo
  qubvel
  committed
  b989ba6
- modular data2vec_audio
  qubvel
  committed
  cdb4c70
- nit modular mistral
  qubvel
  committed
  d50dd86
- apply modular minimax
  qubvel
  committed
  4c5aa0b
- fix modular moonshine
  qubvel
  committed
  6585288
- revert zamba2
  qubvel
  committed
  4ac7c96
- fix mask2former
  qubvel
  committed
  58847e7
Commits on Jun 21, 2025
- Merge branch 'main' into gradient-checkpointing-layer-propagation
  qubvel
  authored
  2e4e2b1
Commits on Jun 23, 2025
- refactor idefics
  qubvel
  committed
  9b8e965
- Merge branch 'main' into gradient-checkpointing-layer-propagation
  qubvel
  authored
  8a8898c

Commits

Commits on Jun 19, 2025

Commits on Jun 20, 2025