You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
feat: add use_tensor_cores option to decode kernels to accelerate GQA#317
Merged
yzh119 merged 2 commits intomainflashinfer-ai/flashinfer:mainfrom enable-tensor-core-decodeflashinfer-ai/flashinfer:enable-tensor-core-decodeCopy head branch name to clipboardJun 20, 2024