[6/9] sync_each_batch option for grad accumulation - #20

[6/9] sync_each_batch option for grad accumulation#20

fabianlim merged 2 commits into

maingarrett361/open-instruct:mainfrom

padding-free-squashing-6garrett361/open-instruct:padding-free-squashing-6Copy head branch name to clipboard