benchmark decoding attention kernel with cudnn#2467

Merged

merrymercy merged 3 commits intosgl-project:mainfrom bjmsong:decoding

Dec 17, 2024

+405-172

Commits on Dec 12, 2024

benchmark decoding attention kernel with cudnn
mdattack
committed

Commits on Dec 16, 2024

perf kernel
mdattack
committed

Commits on Dec 17, 2024

add warmup, gqa
mdattack
committed