Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[Feature] 2080ti and how to unable flash-atte #171

Open
nigelaga opened this issue Feb 1, 2025 · 1 comment
Open

[Feature] 2080ti and how to unable flash-atte #171

nigelaga opened this issue Feb 1, 2025 · 1 comment
Assignees
@foreverpiano

Comments

@nigelaga
Copy link

nigelaga commented Feb 1, 2025

Motivation

as title

Related resources

No response
@foreverpiano
Copy link
Collaborator

Do you use a 2080Ti GPU but find that it doesn't support flash attention? Are you getting any error logs? Do you mean to use the non-flash attention version for inference?

@foreverpiano foreverpiano self-assigned this Feb 3, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@foreverpiano foreverpiano

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@foreverpiano @nigelaga