Skip to content

Small Updates to Padding Free Branch - #2

Merged
fabianlim merged 3 commits into
padding-freefrom
padding-free-updates
Jun 11, 2025
Merged

fabianlim merged 3 commits into
padding-freefrom
padding-free-updates

Conversation

@fabianlim

Copy link
Copy Markdown
Collaborator
  • support parquet data files
  • support additional model args

@garrett361

Copy link
Copy Markdown
Owner

LGTM. Additional args are for NoPE/z_loss?

@garrett361

Copy link
Copy Markdown
Owner

I assume the ArgumentParserPlus is taking care of turning the extra arg string into a list, also? For my own information, should the args be space or comma separated? Does it matter?

--additional_model_arguments "k0:v0, k1:v1"

# or 
--additional_model_arguments "k0:v0 k1:v1"

@fabianlim

Copy link
Copy Markdown
Collaborator Author

good point, i think it should be space delimited, but I need to check

@fabianlim

Copy link
Copy Markdown
Collaborator Author

@garrett361 i tested it takes a space delimited sequence of args

@dangxuanhong dangxuanhong left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @fabianlim

@fabianlim
fabianlim merged commit 74c155a into padding-free Jun 11, 2025
@fabianlim
fabianlim deleted the padding-free-updates branch June 11, 2025 15:15
@fabianlim fabianlim mentioned this pull request Jun 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants