Skip to content

Issues: Dao-AILab/flash-attention

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

583 Open 535 Closed
583 Open 535 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

where can i download the whl for torch2.5 win10?
#1339 opened Nov 16, 2024 by czcz1024
v2.6.3's flash_attn_varlen_func runs faster than v2.7.0.post2's flash_Attn_varlen_func on H100
#1338 opened Nov 16, 2024 by complexfilter
3
FileNotFoundError: [Errno 2] No such file or directory: 'ldconfig' for flash_attn.layers.rotary.apply_rotary_emb_qkv_(qkv, cos, sin)
#1336 opened Nov 14, 2024 by albertotono
1
2.6.3 is faster than 2.7.0 for flash-attn v2 CUDA fwd/bwd
#1335 opened Nov 14, 2024 by ds-kczerski
3
how to disable flash atten in python?
#1334 opened Nov 14, 2024 by hiyyg
1
Not possible to script flash_attn_2_cuda.varlen_fwd function
#1332 opened Nov 13, 2024 by ArtyoMKos
Prebuild flash attention wheels for linux!
#1330 opened Nov 12, 2024 by kunibald413
CUDA 12.1 Python 3.10 PyTorch 2.5.1 安装版本
#1327 opened Nov 11, 2024 by wuxi-dixi
1
Question about flashdecoding with appendKV
#1325 opened Nov 10, 2024 by DD-DuDa
In FA3, which specific Layout_K SW is used for smemO?
#1324 opened Nov 10, 2024 by ziyuhuang123
1
CUDA 12.6 Performance Issue
#1323 opened Nov 9, 2024 by rchardx
1
调用flash attn内核的sdpa失败
#1321 opened Nov 7, 2024 by czydfj
when I use layer_norm, it reports a segment error
#1320 opened Nov 7, 2024 by huangjch526
Is try_wait on barrier_Q Similar to barrier_O? Is an Additional Wait Needed?
#1319 opened Nov 6, 2024 by ziyuhuang123
2
Why is barrier_O Necessary, and What is it Waiting For?
#1318 opened Nov 6, 2024 by ziyuhuang123
6
In the FlashAttention 3 (FA3) code, where is the barrier_O phase specified as 1 or 0?
#1317 opened Nov 5, 2024 by ziyuhuang123
6
Why we iteratively arrive at barrier_O??
#1315 opened Nov 5, 2024 by ziyuhuang123
4
Package is uninstallable
#1313 opened Nov 4, 2024 by chrisspen
1
Operation Error: /usr/bin/ld: cannot find -lcuda
#1312 opened Nov 2, 2024 by ying123ww
Varlen flash attention: CUDA illegal memory access
#1311 opened Nov 1, 2024 by clessig
10
flash attention 3 benchmark for H20 hopper
#1310 opened Nov 1, 2024 by aftersnow
5
Looking for compatible version
#1309 opened Oct 31, 2024 by mahmoodn
ROCm compilation error with PyTorch 2.5.1
#1307 opened Oct 31, 2024 by calebthomas259
4
Result mismatch with headdim=256 bwd
#1306 opened Oct 31, 2024 by zidanehuang001
5
whl for torch 2.5.0
#1302 opened Oct 28, 2024 by Galaxy-Husky
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.