Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Hi, will it have a CPU version impl? #59

Closed
lucasjinreal opened this issue Oct 17, 2022 · 3 comments
Closed

Hi, will it have a CPU version impl? #59

lucasjinreal opened this issue Oct 17, 2022 · 3 comments

Comments

@lucasjinreal
Copy link

Hi, will it have a CPU version impl?
@tridao
Copy link
Member

tridao commented Oct 17, 2022

We focus on reducing GPU memory reads/writes to speed up attention & save memory. The bottlenecks on CPUs are likely to be different.

@tridao tridao closed this as completed Oct 19, 2022
@jon-chuang jon-chuang mentioned this issue Apr 12, 2023
Closed
@RahulSChand RahulSChand mentioned this issue Aug 16, 2023
Open
@edmondja
Copy link

Could have been great for the sake of having uniform code and only change the device...

@tridao
Copy link
Member

tridao commented Apr 24, 2024

Sure would have been great, someone just needs to write the code

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tridao @edmondja @lucasjinreal