Optimize model loading for memory efficiency #35
Description
It can be made more efficient by always loading on CPU and only having FSDP2 handle the placement
{{ message }}
It can be made more efficient by always loading on CPU and only having FSDP2 handle the placement