[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling#11394
Merged
WoosukKwon merged 17 commits intomainfrom v1-topk-topDec 27, 2024
+355-190
Commits
Commits on Dec 21, 2024
Commits on Dec 26, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Dec 27, 2024
- committed
- committed