Skip to content

Llama Padding-Free for Finetune - #11

Closed
fabianlim wants to merge 54 commits into
mainfrom
llama-padding-free
Closed

fabianlim wants to merge 54 commits into
mainfrom
llama-padding-free

Conversation

@fabianlim

@fabianlim fabianlim commented Jun 24, 2025 •

Copy link
Copy Markdown
Collaborator

@garrett361 This is the first PR to merge back to main

  • support padding-free for finetune.py
  • suggest we revert all the formatting changes that are not necesary

@fabianlim
fabianlim requested a review from garrett361 June 24, 2025 11:31
Comment thread open_instruct/finetune.py

# DataLoaders creation:
if args.padding_free:
accelerator.print("Using padding-free collation")

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are these accelerator.print statements needed @garrett361 ?

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, just for testing

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i see then we might consider removing them also

@fabianlim

Copy link
Copy Markdown
Collaborator Author

this PR has been depracated in favour of #12

@fabianlim fabianlim closed this Jun 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants