Skip to content

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

6 Commits

Folders and files

Repository files navigation

deepSeedZero

This repository was originally created to set up the environment for reproducing the issue discussed in Hugging Face Transformers Issue #32312. The issue has since been resolved, and you should now be able to run everything successfully.

Environment Information

  • GPU: RTX 3090
  • Python Version: 3.10.14
  • PyTorch Version: 2.4.1+cu121
  • Transformers Version: 4.45.0.dev0
  • DeepSpeed Version: 0.9.3

How to run?

After running setting up the environment, run

deepseed main.py

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages