Repository navigation

Add Beit3 model - #22289

Closed

raghavanone wants to merge 205 commits into

huggingface:mainfrom

raghavanone:fix_issue_22178

Closed

Add Beit3 model#22289
raghavanone wants to merge 205 commits into
huggingface:mainfrom
raghavanone:fix_issue_22178

Commits on Feb 15, 2024
- Beit3 early draft WIP
  raghavanone
  committed
  cef9f72
- Clean up modeling files and config files
  raghavanone
  committed
  04a27a7
- More Clean up
  raghavanone
  committed
  2a9a11a
- Remove refenences of aux loss
  raghavanone
  committed
  5915126
- Make all the classes use pretrainedmodel
  raghavanone
  committed
  686271e
- Add Down stream task models
  raghavanone
  committed
  3934fe0
- Add tokenization class
  raghavanone
  committed
  1fd1182
- Change all the downstream task models to HF style
  raghavanone
  committed
  903f403
- Add tests
  raghavanone
  committed
  571f264
- Add test for captioning class
  raghavanone
  committed
  5873f35
- Fix style and copies
  raghavanone
  committed
  4084f3d
- Fix imports
  raghavanone
  committed
  f58f25f
- Fix imports
  raghavanone
  committed
  dca7b12
- Fix imports
  raghavanone
  committed
  45ea1fb
- Fix imports
  raghavanone
  committed
  69d4939
- Fix check repo failures
  raghavanone
  committed
  8680897
- Fix check repo failures
  raghavanone
  committed
  1a04faa
- Fix check init failures
  raghavanone
  committed
  694e8a0
- Fix config test failure
  raghavanone
  committed
  f7cc3bc
- Fix unused config params
  raghavanone
  committed
  564c1c6
- Fix style failures
  raghavanone
  committed
  acb7e7d
- Rename variables
  raghavanone
  committed
  50b9f33
- Fix code style
  raghavanone
  committed
  0c97729
- Implement Beit Image processor
  raghavanone
  committed
  543c5a3
- Add docs for image processor
  raghavanone
  committed
  31be765
- Fix check inits
  raghavanone
  committed
  b8ac47d
- Fix copies
  raghavanone
  committed
  ae391b6
- Run fix copies
  raghavanone
  committed
  338d37a
- Fix documentation failure
  raghavanone
  committed
  ebaa052
- Fix documentation failure
  raghavanone
  committed
  0bc9937
- Fix documentation failure
  raghavanone
  committed
  fbad686
- Clean up
  raghavanone
  committed
  2c37fa3
- Fix Beit3 readme
  raghavanone
  committed
  3fd9c26
- Fix Bigbird-Pegasu typo
  raghavanone
  committed
  9887a5d
- rename folder
  raghavanone
  committed
  a22f650
- small Change
  raghavanone
  committed
  b089660
- more changes
  raghavanone
  committed
  24bddcc
- more changes
  raghavanone
  committed
  b74d501
- more changes
  raghavanone
  committed
  fad2d89
- more changes
  raghavanone
  committed
  9100b2b
- more changes
  raghavanone
  committed
  3136968
- Fix build
  raghavanone
  committed
  8043da1
- Fix build
  raghavanone
  committed
  c8141ca
- Rename test file name
  raghavanone
  committed
  384581e
- Fix failing tests
  raghavanone
  committed
  cf76290
- PR feedbacks
  raghavanone
  committed
  a128eb9
- more changes
  raghavanone
  committed
  6bdecd9
- fix style
  raghavanone
  committed
  7acbaf5
- fix style
  raghavanone
  committed
  d7f7c13
- fix style
  raghavanone
  committed
  b745ee8
- More changes
  raghavanone
  committed
  b826282
- More changes
  raghavanone
  committed
  a5c453b
- More changes
  raghavanone
  committed
  8d95dfd
- More changes
  raghavanone
  committed
  4dcea0b
- Rebase changes
  raghavanone
  committed
  0a9afcd
- More changes
  raghavanone
  committed
  0d291a9
- Fix style issue
  raghavanone
  committed
  976a116
- More changes
  raghavanone
  committed
  4ccb583
- Fix style
  raghavanone
  committed
  d2584bb
- Add type casting
  raghavanone
  committed
  875946d
- Add pytorch to hf conversion script
  raghavanone
  committed
  775657f
- Add convertion script with asserts
  raghavanone
  committed
  d7589fa
- Fix failing tests
  raghavanone
  committed
  4c80ebb
- PR feedbacks
  raghavanone
  committed
  48932a0
- Fix style
  raghavanone
  committed
  00696f1
- Fix make copies
  raghavanone
  committed
  9f3ea02
- Fix check repo failures
  raghavanone
  committed
  261839b
- Fix ruff error
  raghavanone
  committed
  10dd82a
- Fix imports
  raghavanone
  committed
  c0fa7bc
- Fix failing tests
  raghavanone
  committed
  69e6962
- Fix black issues
  raghavanone
  committed
  8c7d452
- Fix test small model size
  raghavanone
  committed
  e227c09
- Fix image_processing_beit3 errors
  raghavanone
  committed
  6a1a5d7
- fix black issues
  raghavanone
  committed
  385d2bb
- Remove Beit3MultiwayNetwork and replace it with granular modules
  raghavanone
  committed
  1bfaed4
- Remove **kwargs from forward calls
  raghavanone
  committed
  8dac071
- Remove set_split_position usage
  raghavanone
  committed
  76255ba
- Remove **kwargs from forward calls
  raghavanone
  committed
  c25c4d6
- Resolve PR feedbacks
  raghavanone
  committed
  21afc36
- Fix more PR feedbacks
  raghavanone
  committed
  a51c742
- Fix more PR feedbacks
  raghavanone
  committed
  a9e7439
- fix style and fix copies
  raghavanone
  committed
  9959fa7
- Fix check repo failure
  raghavanone
  committed
  39ee0a7
- Fix check repo failure
  raghavanone
  committed
  2dac0d3
- More PR feedback fixes
  raghavanone
  committed
  ab4adce
- More PR feedback fixes
  raghavanone
  committed
  517d30d
- Fix style
  raghavanone
  committed
  ea0c18e
- Incorporate more PR feedbacks
  raghavanone
  committed
  6704fed
- Incorporate more PR feedbacks
  raghavanone
  committed
  75741a6
- Incorporate more PR feedbacks
  raghavanone
  committed
  8953bd6
- Fix failing build
  raghavanone
  committed
  4277fa8
- Fix documentation issues
  raghavanone
  committed
  455baad
- More PR feedback fixes
  raghavanone
  committed
  a2a62e9
- More PR feedback fixes
  raghavanone
  committed
  f2d7063
- Fix build
  raghavanone
  committed
  55ed9f4
- Fix build
  raghavanone
  committed
  4cd460c
- Fix build
  raghavanone
  committed
  decba37
- Incorporate more PR feedbacks
  raghavanone
  committed
  2cadb0f
- Incorporate more PR feedbacks
  raghavanone
  committed
  e8b4633
- Removing Beit3 image processor
  raghavanone
  committed
  f454500
- Removing Beit3 image processor
  raghavanone
  committed
  a550d43
- Add Beit3 integration tests
  raghavanone
  committed
  d6597af
- Incorporate PR Feedbacks
  raghavanone
  committed
  e383943
- Incorporate PR Feedbacks
  raghavanone
  committed
  a5331c0
- WIP change
  raghavanone
  committed
  72d6809
- Fix a bug
  raghavanone
  committed
  49578be
- Fix copies and fix styles
  raghavanone
  committed
  a383aed
- Incorporate PR feedbacks
  raghavanone
  committed
  72b944e
- Fix Doc stings
  raghavanone
  committed
  b5acc67
- Fix build
  raghavanone
  committed
  6ca86a4
- Fix build
  raghavanone
  committed
  6f513bf
- Fix build
  raghavanone
  committed
  adc1b2a
- Fix build
  raghavanone
  committed
  f117a7c
- Fix build
  raghavanone
  committed
  fc58c9a
- Fix build
  raghavanone
  committed
  63ee3d2
- Fix build
  raghavanone
  committed
  998a0bf
- Incorporate PR feedback
  raghavanone
  committed
  707e8ed
- Incorporate PR feedbacks
  raghavanone
  committed
  e288646
- Fix build
  raghavanone
  committed
  fa59cd5
- Fix build
  raghavanone
  committed
  a2ea2bf
- Incorporate PR feedbacks
  raghavanone
  committed
  d825b08
- Incorporate PR feedbacks
  raghavanone
  committed
  b4aa26c
- Incorporate PR feedbacks
  raghavanone
  committed
  82db5b4
- Incorporate PR feedbacks
  raghavanone
  committed
  75db296
- Fix build
  raghavanone
  committed
  38936df
- Incorporate PR feedbacks
  raghavanone
  committed
  9a44bd9
- Fix build
  raghavanone
  committed
  a0381a7
- Incorporate PR feedbacks
  raghavanone
  committed
  e89672d
- Fix build
  raghavanone
  committed
  a4a92e8
- Incorporate PR feedbacks
  raghavanone
  committed
  69aab9c
- Incorporate PR feedbacks
  raghavanone
  committed
  b73fc73
- Fix build
  raghavanone
  committed
  8063e94
- Fix converstion script
  raghavanone
  committed
  24e660f
- Fix Build
  raghavanone
  committed
  e4d6cd0
- Fix build
  raghavanone
  committed
  7fe04cc
- Fix build
  raghavanone
  committed
  60cebcd
- Incorporate PR feedbacks
  raghavanone
  committed
  a39932b
- Fix Build
  raghavanone
  committed
  86f0b5d
- Incorporate PR feedbacks
  raghavanone
  committed
  06191c5
- Fix Build
  raghavanone
  committed
  5549efe
- Incorporate PR feedbacks
  raghavanone
  committed
  4cb84cf
- Fix Build
  raghavanone
  committed
  63955fe
- Fix Build
  raghavanone
  committed
  649d80c
- Fix Build
  raghavanone
  committed
  2c7620a
- Fix Build
  raghavanone
  committed
  c15cee7
- Fix Build
  raghavanone
  committed
  be95cb4
- Improve implementation
  
  NielsRogge
  authored and
  raghavanone
  committed
  8fcf194
- Remove relative position bias, remove print statements
  
  NielsRogge
  authored and
  raghavanone
  committed
  0f126f7
- Rename class
  
  NielsRogge
  authored and
  raghavanone
  committed
  67c3e6f
- Fix incorrect mapping of text and image embeddings
  raghavanone
  committed
  2752293
- Fix rename bug
  raghavanone
  committed
  b9ba1d7
- Fix failing tests
  raghavanone
  committed
  04b60b5
- Fix all failing test
  raghavanone
  committed
  30e2186
- fix build
  raghavanone
  committed
  828f24f
- fix Build
  raghavanone
  committed
  859cd66
- Rename attention mask to image_text_mask
  raghavanone
  committed
  9c913f6
- Incorporate PR feedbacks
  raghavanone
  committed
  a216964
- Rename attention_mask
  
  NielsRogge
  authored and
  raghavanone
  committed
  7b3b7c0
- More improvements
  
  NielsRogge
  authored and
  raghavanone
  committed
  dbd8964
- More improvements
  
  NielsRogge
  authored and
  raghavanone
  committed
  bef7336
- Improve code snippet
  
  NielsRogge
  authored and
  raghavanone
  committed
  0ce0fc4
- Remove file
  
  NielsRogge
  authored and
  raghavanone
  committed
  0d4fa0a
- Fix failing tests
  raghavanone
  committed
  1acbf74
- Fix failing doc tests
  raghavanone
  committed
  51b589f
- Fix style and documenation tests
  raghavanone
  committed
  75e6d7b
- Remove text_end_positions from beit3 model
  raghavanone
  committed
  f8c48da
- Fix documentation tests
  raghavanone
  committed
  4954845
- Fix failing tests
  raghavanone
  committed
  e0a17e8
- Clean up tests
  
  NielsRogge
  authored and
  raghavanone
  committed
  238258d
- More improvements
  
  NielsRogge
  authored and
  raghavanone
  committed
  3e891af
- Update code example
  
  NielsRogge
  authored and
  raghavanone
  committed
  12efa27
- Add tests for Beit3ForVisualReasoning
  
  NielsRogge
  authored and
  raghavanone
  committed
  98b6718
- Fix docstring
  
  NielsRogge
  authored and
  raghavanone
  committed
  420dd08
- Fix more tests
  
  NielsRogge
  authored and
  raghavanone
  committed
  4ee6843
- Fix all tests
  
  NielsRogge
  authored and
  raghavanone
  committed
  f071546
- Rename Beit3ForVisualReasoning
  
  NielsRogge
  authored and
  raghavanone
  committed
  674ad4e
- Add comment
  
  NielsRogge
  authored and
  raghavanone
  committed
  9166b38
- Fix tests
  raghavanone
  committed
  b640959
- Fix attention issue : attention mask is now works similar to other models
  raghavanone
  committed
  4d18082
- Incorporate PR feedbacks
  raghavanone
  committed
  3e1f2f1
- Remove unused config param
  raghavanone
  committed
  29a826b
- Some more cleanup
  raghavanone
  committed
  85a6abe
- Some more cleanups
  raghavanone
  committed
  fa7f172
- Fix build
  raghavanone
  committed
  fb07c1a
- Incorporate PR feedbacks
  raghavanone
  committed
  58cfd73
- fix style
  raghavanone
  committed
  831c69d
- fix style
  raghavanone
  committed
  a96793d
- fix small nit
  raghavanone
  committed
  539fa0b
- Incorporate PR feedbacks
  raghavanone
  committed
  6dc893c
- Incorporate PR Feedbacks
  raghavanone
  committed
  ff8480b
- Add more assertions for Beit3
  raghavanone
  committed
  409386d
- make style
  raghavanone
  committed
  6524f8b
- Fix docstrings
  raghavanone
  committed
  3d9251d
- Incorporate more PR feedbacks
  raghavanone
  committed
  d1feee6
- Incorporate more PR feedbacks
  raghavanone
  committed
  13fbef0
- Fix failing test
  raghavanone
  committed
  036f008
- Incorporate more PR feedbacks
  raghavanone
  committed
  aa72c99
- Incorporate more PR feedbacks
  raghavanone
  committed
  77fcf1d
- Incorporate PR feedbacks
  raghavanone
  committed
  e90d8c6
- Incorporate PR feedbacks
  raghavanone
  committed
  40c822b
- Fix failing test
  raghavanone
  committed
  8f3ab45
- Fix copying
  raghavanone
  committed
  456b7b4
- Fix faling PR tests
  raghavanone
  committed
  2fe0750
- Fix faling PR tests
  raghavanone
  committed
  e70b278
- Fix faling PR tests
  raghavanone
  committed
  ec6bbef

Commits

Commits on Feb 15, 2024