Skip to content

[trainer memory] Split Nemotron-3.5-Lightning 64K experts across both GPUs again - #331

Closed
Micah Yong (micahtyong) wants to merge 1 commit into
mainfrom
micah/nemotron-perf/revert-expert-parallel-1
Closed

Micah Yong (micahtyong) wants to merge 1 commit into
mainfrom
micah/nemotron-perf/revert-expert-parallel-1

Split Nemotron-3.5-Lightning 64K experts across both GPUs again

c4ad295
Select commit
Loading
Failed to load commit list.