Add APIs to offload states of model, optimizer, and engine - #6011

Add APIs to offload states of model, optimizer, and engine#6011

tohtana merged 28 commits into

masterdeepspeedai/DeepSpeed:masterfrom

tohtana/offload_zero_buffersdeepspeedai/DeepSpeed:tohtana/offload_zero_buffersCopy head branch name to clipboard