Dynamic scaling + Other stuff (DONT MERGE - SPLIT INTO SMALLER PRS)#737

Open

ajtejankar wants to merge 16 commits intomainfrom

dynamic-scaling

Commits on Jan 9, 2025

fp8 dynamic activation scaling (disable static scaling)
ajtejankar
committed

Commits on Jan 10, 2025

allow channelwise scale factors
ajtejankar
committed

Commits on Jan 20, 2025

Commits on Jan 21, 2025

this kinda works
Magdy Saleh
committed
Add XML tool call parsing by looking <tool_call> tag
Magdy Saleh
committed
Merge branch 'dynamic-scaling' of github.com:predibase/lorax into dynamic-scaling
Magdy Saleh
committed
fix warning
Magdy Saleh
committed

Commits on Jan 22, 2025

Catch parsing errors and return the generated model output
Magdy Saleh
committed
make dynamic scaling work in general case
Magdy Saleh
committed

Commits on Jan 23, 2025

add tool calls to messages
Magdy Saleh
committed
remove warning
Magdy Saleh
committed

Commits on Jan 24, 2025

fix escaping xml tool calls when the input in valid json
Magdy Saleh
committed