Repository navigation

Add Music Flamingo - #43538

Merged

ebezzam merged 92 commits into

huggingface:mainfrom

lashahub:modular-mf

Mar 30, 2026

Merged

Add Music Flamingo#43538
ebezzam merged 92 commits into
huggingface:mainfrom
lashahub:modular-mf

Commits on Dec 24, 2025
- Music flamingo
  lashahub
  committed
  caf33f1
Commits on Dec 26, 2025
- Fix pos embeddings
  lashahub
  committed
  b69a9d1
Commits on Jan 6, 2026
- Merge branch 'huggingface:main' into main
  lashahub
  authored
  b4acc17
- Method arg docstrings
  lashahub
  committed
  cf1e9bc
Commits on Jan 8, 2026
- Add tests & docs
  lashahub
  committed
  44e801b
- Merge branch 'huggingface:main' into main
  lashahub
  authored
  f0956e3
Commits on Jan 10, 2026
- Fix AF3 dtype bug
  lashahub
  committed
  c973445
- Fix the MF performance issue
  lashahub
  committed
  e3a17fb
- Fix pos embeddings
  lashahub
  committed
  627dee8
- Merge branch 'main' of https://github.com/lashahub/transformers
  lashahub
  committed
  e9df30d
Commits on Jan 12, 2026
- Fix embeddings & format
  lashahub
  committed
  4c48132
Commits on Jan 23, 2026
- Remove external deps
  lashahub
  committed
  d67c114
- Update processor token names
  lashahub
  committed
  aedd341
Commits on Feb 10, 2026
- Cleanup
  lashahub
  committed
  87d55a9
Commits on Feb 13, 2026
- Simplify RotaryEmbedding to lang-only
  lashahub
  committed
  be22746
Commits on Feb 14, 2026
- Reuse AF3 config classes
  lashahub
  committed
  e5b4677
- Trim+rename rotary embedding
  lashahub
  committed
  d7e0bcb
- Call parent _init_weights first and drop rotary einsum
  lashahub
  committed
  74af4fa
- Precompute rotary cache at init
  lashahub
  committed
  d622368
Commits on Feb 15, 2026
- Use modular processor pattern for MusicFlamingo
  lashahub
  committed
  cab3937
- Remove audio-only inference example
  lashahub
  committed
  9dd94a0
Commits on Feb 16, 2026
- Refactor Audio Feature Casting Path
  lashahub
  committed
  767a1d5
Commits on Feb 21, 2026
- Clarify private source repo
  lashahub
  committed
  9119660
Commits on Feb 22, 2026
- Clean up modular
  lashahub
  committed
  fc8ab3a
- Move config to modular
  lashahub
  committed
  5159745
Commits on Feb 23, 2026
- Formatting
  lashahub
  committed
  4aae4ff
- Remove dummy
  lashahub
  committed
  ffef7db
- Derive musicflamingo timing and rotary config
  lashahub
  committed
  90148ed
- Llama style rotary embeddings
  lashahub
  committed
  87cb03f
- Added reproducer comments
  lashahub
  committed
  5abac95
Commits on Feb 25, 2026
- Expose _init_weights for modular.
  ebezzam
  committed
  f4a1b68
- Satisfy repo checks
  ebezzam
  committed
  3b9290f
- Align MusicFlamingo rotary with Llama style
  lashahub
  committed
  82ab1ef
Commits on Feb 26, 2026
- Move MusicFlamingo _init_weights to encoder
  lashahub
  committed
  e993dea
- Keep old behavior
  lashahub
  committed
  2d88557
- Move MusicFlamingo rotary settings into encoder rope_parameters
  lashahub
  committed
  27024f1
- Use AutoConfig in AF3/MF
  lashahub
  committed
  10797b9
- Align MusicFlamingo RoTE with Llama RoPE conventions
  lashahub
  committed
  f49014f
- Update outdated fixtures
  lashahub
  committed
  f465d3d
Commits on Feb 27, 2026
- init_weights without changing others
  ebezzam
  committed
  4224af5
- FIx import
  ebezzam
  committed
  2cbf219
- Remove backward compat
  lashahub
  committed
  a25c8a6
- Merge branch 'main' into modular-mf
  lashahub
  committed
  3ed73a8
- Regenerate modeling for MF
  lashahub
  committed
  f2e7d3f
Commits on Mar 6, 2026
- Fix AF3 batch inference bug
  lashahub
  committed
  445cd24
Commits on Mar 10, 2026
- Simplify config and nit.
  ebezzam
  committed
  fc25c48
- Conform more to transformers convention, e.g. removing unused code paths.
  ebezzam
  committed
  664e7b1
- Add another possible AF3 prefix.
  ebezzam
  committed
  bbca79a
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  69c9bee
- Use auto_docstring and update docstrings.
  ebezzam
  committed
  17846d9
Commits on Mar 11, 2026
- Nits
  ebezzam
  committed
  24fbaa7
- Nit for review
  ebezzam
  committed
  e25d377
- Shift RoTE to main model so that encoder can be directly used from AF3.
  ebezzam
  committed
  c99fc0a
- Refactoring nit.
  ebezzam
  committed
  9bb0c53
Commits on Mar 17, 2026
- Fix init
  lashahub
  committed
  e9528a6
- Fix some failing tests
  lashahub
  committed
  13af64d
- Fix AF3 & MF and add batching tests
  lashahub
  committed
  a34e981
- Fix audio embedding masking (bad post length)
  ebezzam
  committed
  702eb27
- Nits and remove since same as GLM was bug in post length computation
  ebezzam
  committed
  a32520c
- Simplify MF as AF3, and style checks.
  ebezzam
  committed
  7750bb5
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  74417f6
- New config after merge and modular update.
  ebezzam
  committed
  54bfecc
Commits on Mar 18, 2026
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  2f2b552
- Address music flamingo tests, and some cleanup.
  ebezzam
  committed
  612840f
- style check
  ebezzam
  committed
  2c3e583
- Regenerate config.
  ebezzam
  committed
  a20e163
- Update fixtures.
  ebezzam
  committed
  fdb849a
- Nits
  ebezzam
  committed
  057ad88
- Merge branch 'modular-mf' of github.com:lashahub/transformers into modular-mf
  ebezzam
  committed
  0442a67
- Nit
  ebezzam
  committed
  7f04d2d
Commits on Mar 20, 2026
- Merge branch 'huggingface:main' into modular-mf
  lashahub
  authored
  66ce201
Commits on Mar 22, 2026
- Improve RoTE config
  lashahub
  committed
  7e06d27
Commits on Mar 23, 2026
- Refine MusicFlamingo rotary time handling
  lashahub
  committed
  d423510
- Simplification, and update AF3 processor for better modular
  ebezzam
  committed
  e79475b
- Fix torch export
  ebezzam
  committed
  6a1add4
- Simplify modular, including upstreaming input_ids input to get_audio_features
  ebezzam
  committed
  e05b767
Commits on Mar 24, 2026
- Remove upstreaming of input_ids to get_audio_features, and remove audio_rotary_dim.
  ebezzam
  committed
  edcffef
- Switch to MoonshineRotaryEmbedding, and cleanup.
  ebezzam
  committed
  e986996
- Remove hardcoded MusicFlamingo partial_rotary_factor
  lashahub
  committed
  ad76e28
- Update fixtures
  lashahub
  committed
  8e0dc3b
Commits on Mar 30, 2026
- Compile re.sub
  ebezzam
  committed
  a46aa1c
- Merge branch 'modular-mf' of github.com:lashahub/transformers into modular-mf
  ebezzam
  committed
  836da94
- Update src/transformers/models/musicflamingo/modular_musicflamingo.py
  
  ebezzam
  and
  ArthurZucker
  authored
  1089477
- Update src/transformers/models/musicflamingo/modular_musicflamingo.py
  
  ebezzam
  and
  ArthurZucker
  authored
  2ea5574
- Style
  ebezzam
  committed
  999737e
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  1533bec
- Update fixtures.
  ebezzam
  committed
  6857af9
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  cd693fc
- Conditional torch import for processor.
  ebezzam
  committed
  35fc31f
- Merge branch 'modular-mf' of github.com:lashahub/transformers into modular-mf
  ebezzam
  committed
  a62e7d9
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  d0d18f2
- Merge branch 'main' into modular-mf
  ebezzam
  authored
  47fa938

Commits

Commits on Dec 24, 2025

Commits on Dec 26, 2025

Commits on Jan 6, 2026

Commits on Jan 8, 2026

Commits on Jan 10, 2026

Commits on Jan 12, 2026

Commits on Jan 23, 2026

Commits on Feb 10, 2026

Commits on Feb 13, 2026

Commits on Feb 14, 2026

Commits on Feb 15, 2026

Commits on Feb 16, 2026

Commits on Feb 21, 2026

Commits on Feb 22, 2026

Commits on Feb 23, 2026

Commits on Feb 25, 2026

Commits on Feb 26, 2026

Commits on Feb 27, 2026

Commits on Mar 6, 2026

Commits on Mar 10, 2026

Commits on Mar 11, 2026

Commits on Mar 17, 2026

Commits on Mar 18, 2026

Commits on Mar 20, 2026

Commits on Mar 22, 2026

Commits on Mar 23, 2026

Commits on Mar 24, 2026

Commits on Mar 30, 2026