Skip to content

feat(attention): cuDNN FROST attention backend for head_dim in (256, 512], with context parallelism - #3527

Open
nvegesna-netizen wants to merge 81 commits into
NVIDIA:mainfrom
nvegesna-netizen:nvegesna/te-frost-d512-cp
Open

nvegesna-netizen wants to merge 81 commits into
NVIDIA:mainfrom
nvegesna-netizen:nvegesna/te-frost-d512-cp

Revert "refactor(attention): move the diagonal-band translation to cu…

639cdad
Select commit
Loading
Failed to load commit list.