fix errors when setting zero3 leaf modules with torch.compile - #6564

fix errors when setting zero3 leaf modules with torch.compile#6564

loadams merged 4 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

NirSonnenschein:Fix_errors_when_set_zero3_leaf_modulesNirSonnenschein/DeepSpeed:Fix_errors_when_set_zero3_leaf_modulesCopy head branch name to clipboard