Skip to content

Apply packed sequence params change for fused rope compatibility#11506

Merged
ananthsub merged 5 commits intoNVIDIA-NeMo:mainfrom
ananthsub:fix-packed-attention-2201
Dec 9, 2024
Merged

Apply packed sequence params change for fused rope compatibility#11506
ananthsub merged 5 commits intoNVIDIA-NeMo:mainfrom
ananthsub:fix-packed-attention-2201

Commits

Commits on Dec 7, 2024

Commits on Dec 9, 2024