Repository navigation

multiple tokenizers with different filenames can save now - #41837

Closed

aijadugar wants to merge 14 commits into

huggingface:mainfrom

aijadugar:fix-multiple-tokenizers-saved

Closed

multiple tokenizers with different filenames can save now#41837
aijadugar wants to merge 14 commits into
huggingface:mainfrom
aijadugar:fix-multiple-tokenizers-saved

Commits on Oct 24, 2025
- multiple tokenizers with different filenames can save now
  aijadugar
  committed
  73f91c5
- shallow copy to avoid deepcopy errors
  aijadugar
  committed
  c2ab93f
Commits on Oct 25, 2025
- Fix processor save logic for multiple tokenizers and restore original comments and serialization behavior
  aijadugar
  authored
  93731c5
- Merge branch 'main' into fix-multiple-tokenizers-saved
  aijadugar
  authored
  c94405a
Commits on Oct 26, 2025
- Revert unrelated edits and keep only relevant processor save logic
  aijadugar
  authored
  67c3bb7
- Merge branch 'main' into fix-multiple-tokenizers-saved
  aijadugar
  authored
  8aca431
- Restore original comments and docstrings; keep only relevant processor save logic
  aijadugar
  authored
  560067e
- Restore original comments and keep only relevant processor save logic
  aijadugar
  authored
  68caa7d
- Restore original comments
  aijadugar
  authored
  4b2c049
- Restore original comments
  aijadugar
  authored
  9e4b141
- removes trailling whitespaces
  aijadugar
  authored
  1ffb4d3
- import like ruff's isort rule
  aijadugar
  authored
  8203b0e
Commits on Oct 27, 2025
- Merge branch 'main' into fix-multiple-tokenizers-saved
  aijadugar
  authored
  e1ce3e7
Commits on Oct 30, 2025
- Merge branch 'main' into fix-multiple-tokenizers-saved
  aijadugar
  authored
  182ffd2