[distributed] Context parallel module, with Ulysses - #50493

[distributed] Context parallel module, with Ulysses#50493

3outeille wants to merge 9 commits into

mainhuggingface/transformers:mainfrom

cp-1-implementationshuggingface/transformers:cp-1-implementationsCopy head branch name to clipboard