You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
FLEX attention silently ignores is_causal=True when no mask is supplied #15195
The FLEX attention backend silently ignores is_causal=True when no attention mask is supplied. _native_flex_attention first matches attn_mask is None, leaving block_mask=None; its subsequent causal-mask branch is unreachable for this supported argument combination.
Reproduced on upstream d3d8af8 with PyTorch 2.15.0+cpu and Diffusers 0.42.0.dev0. No model download is needed.
Observed maximum error: 2.117769241333008. The FLEX result instead matches noncausal SDPA within 3.5762786865234375e-07. Expected: causal output matching causal SDPA within floating-point tolerance.
Proposed scope and coordination
Build the causal block mask before accepting a missing mask as the noncausal case; preserve the existing explicit-mask validation. A focused fix is already proposed in #15188, which was opened without the required coordination issue. This report supplies the missing reproducible tracking; it does not claim prior maintainer acknowledgment. Please confirm whether this scope is appropriate before further contribution work proceeds.
AI assistance was used to reproduce and investigate this report. Verification here is CPU eager execution, not compiled CUDA coverage.
Activity