Repository navigation

feat(attention): cuDNN FROST attention backend for head_dim in (256, 512], with context parallelism - #3527

Open

nvegesna-netizen wants to merge 65 commits into

NVIDIA:mainfrom

nvegesna-netizen:nvegesna/te-frost-d512-cp

Commits on Sep 16, 2026

feat(attention): cuDNN FROST kernel wrapper for head_dim in (256, 512]

nvegesna-netizen
and
claude
committed
7765b76
feat(attention): select and dispatch FrostAttention from DotProductAttention

nvegesna-netizen
and
claude
committed
3319826
feat(attention): context parallelism for FROST across p2p, all_gather and a2a

nvegesna-netizen
and
claude
committed
d60b3fd
test(attention): CP coverage for FrostAttention at head_dim 512

nvegesna-netizen
and
claude
committed
62ffe39
[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot]
authored and
nvegesna-netizen
committed
fe72e4a
test(attention): run the FrostAttention CP configs from pytest

nvegesna-netizen
and
claude
committed
a8957ae
fix(attention): gate FROST on the cuDNN Frontend version and key plans by device

nvegesna-netizen
and
claude
committed
bdbb36a
fix(attention): repair the FROST plan-cache key arity and harden the version gate

nvegesna-netizen
and
claude
committed
e30ea42
fix(attention): reject a v that does not match k, and refine the version probe

nvegesna-netizen
and
claude
committed
0957f71
fix(attention): update the mixed-THD backend unpack for the new return value

nvegesna-netizen
and
claude
committed
438b4da
fix(attention): bind a cuDNN stream and close the remaining silent-wrong-answer paths

nvegesna-netizen
and
claude
committed
c0d0713
fix(attention): JIT-compile FROST plans under the device their handle names

nvegesna-netizen
and
claude
committed
7504bff
test(attention): anchor FROST numerics to an fp32 reference, not to itself

nvegesna-netizen
and
claude
committed
85a0f51
feat(attention): honour deterministic on the FROST path, and document the backend

nvegesna-netizen
and
claude
committed
c5f9cd2
docs(attention): scope the FROST exclusivity claim to context parallelism

nvegesna-netizen
and
claude
committed
a97496e
fix(attention): drop a duplicate deterministic parameter on the fused p2p wrapper

nvegesna-netizen
and
claude
committed
5a675c2
fix(attention): decline FROST when determinism is required

nvegesna-netizen
and
claude
committed
e82981f
test(attention): make the FROST oracle float64, since an fp32 one is not a reference

nvegesna-netizen
and
claude
committed
3edba85
feat(attention): express FROST masking as a diagonal band, adding sliding window

nvegesna-netizen
and
claude
committed
064396e
fix(attention): carry the sliding window through a2a, and decline it for p2p

nvegesna-netizen
and
claude
committed
441dee4
test(attention): cover the sliding window in backward, at its boundary, and per cp_comm_type

nvegesna-netizen
and
claude
committed
9770ca5
fix(attention): let the CP sliding-window asserts know FROST exists

nvegesna-netizen
and
claude
committed
ad9dfdc
docs(attention): correct the claimed cuDNN import-ordering hazard

nvegesna-netizen
and
claude
committed
3eea2f9
test(attention): apply the window for every mask type in the reference

nvegesna-netizen
and
claude
committed
e062e8d
docs(attention): justify the p2p sliding-window decline from the ring, not precedent

nvegesna-netizen
and
claude
committed
dd0033c
fix(attention): bind the FROST flag on the ONNX path, decline what was silently ignored

nvegesna-netizen
and
claude
committed
a82903b
fix(attention): read qkv_type from attention_params, not the rebound local

nvegesna-netizen
and
claude
committed
591955d
test(attention): cover the ONNX-export branch on hardware that can run it
nvegesna-netizen
committed
6832a9b

Commits on Sep 17, 2026

Commits on Sep 21, 2026

Commits

Commits on Sep 16, 2026

Commits on Sep 17, 2026

Commits on Sep 21, 2026

Commits on Sep 22, 2026

Commits on Oct 1, 2026

Commits on Oct 4, 2026

Commits on Oct 6, 2026