[Low-bit optim] Improve compile time + Fix PyTorch 2.3 support for 4-bit optim#812

msaroufim merged 7 commits into

pytorch:mainpytorch/ao:mainfrom

gau-nernst:low_bit_optim_fixgau-nernst/ao:low_bit_optim_fixCopy head branch name to clipboard