FlashAttention does not work for Batch size > 1 #29

Open

Labels

opened

on Mar 28, 2024

Thanks to @dwzhu-pku for pointing this out.

Metadata

Assignees

No one assigned

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests