Skip to content

MTP: option to use re-quantized output tensor for better TG performance#1809

Merged
ikawrakow merged 3 commits into
mainfrom
ik/mtp_requantize_output
May 16, 2026
Merged

MTP: option to use re-quantized output tensor for better TG performance#1809
ikawrakow merged 3 commits into
mainfrom
ik/mtp_requantize_output

Handle interleaved types

b5da743
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs