Skip to content

fix(peft): sum multi-LoRA gradients across tensor-parallel ranks - #6513

Open
micahtyong wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
micahtyong:fix/multi-lora-tp-grad-allreduce
Open

micahtyong wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
micahtyong:fix/multi-lora-tp-grad-allreduce

chore(peft): trim multi-LoRA gradient comments

5fc678a
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 16, 2026 in 1s

DCO

All commits are signed off!