Skip to content

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling#11394

Merged
WoosukKwon merged 17 commits intomainfrom
v1-topk-top
Dec 27, 2024
Merged

[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling#11394
WoosukKwon merged 17 commits intomainfrom
v1-topk-top

Commits

Commits on Dec 21, 2024

Commits on Dec 26, 2024

Commits on Dec 27, 2024