Skip to content

Add torchao quant (int4/int8/fp8) to llama models#1341

Merged
merrymercy merged 8 commits intosgl-project:mainfrom
jerryzh168:enable-torchao
Sep 9, 2024
Merged

Add torchao quant (int4/int8/fp8) to llama models#1341
merrymercy merged 8 commits intosgl-project:mainfrom
jerryzh168:enable-torchao

Commits

Commits on Sep 6, 2024

Commits on Sep 7, 2024

Commits on Sep 9, 2024