nemotron_h: load in-checkpoint MTP head for self-speculation#1533

Open

pierre427 wants to merge 8 commits into

ml-explore:mainfrom

pierre427:pr/nemotron-h-mtp-head

Commits on Jul 2, 2026

Exact speculative rollback for hybrid GDN caches (qwen3_next, qwen3_5)
lBroth
committed
Add cache-reuse and early-close tests for speculative rollback
lBroth
committed
Harden rollback: record stack, strict trim, draft-side speculation
lBroth
committed

Commits on Jul 3, 2026

qwen3_5: load in-checkpoint MTP head + speculative rollback for hybrid caches

authored and
Pierre Lamy
committed
Consolidate: MTP head loading (ours) + GDN exact-replay rollback (lBroth)

committed
RotatingKVCache exact speculative rollback (sibling of the GDN one)

pierre427
and
claude
committed

Commits on Jul 9, 2026

qwen3_5: expose MTP interface through the wrapper Model

authored and
Pierre Lamy
committed

Commits on Jul 10, 2026

nemotron_h: load in-checkpoint MTP head for self-speculation

authored and
Pierre Lamy
committed