Skip to content

feat: add use_tensor_cores option to decode kernels to accelerate GQA#317

Merged
yzh119 merged 2 commits intomainfrom enable-tensor-core-decodeJun 20, 2024

Commits

Commits on Jun 20, 2024