Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: add use_tensor_cores option to decode kernels to accelerate GQA #317

Merged
merged 2 commits into from
Jun 20, 2024

upd

7ce0604
Select commit
Loading
Failed to load commit list.
Merged

feat: add use_tensor_cores option to decode kernels to accelerate GQA #317

upd
7ce0604
Select commit
Loading
Failed to load commit list.

There are no checks for this commit