Skip to content

Release v0.0.2
Compare
Choose a tag to compare
@yzh119 yzh119 released this 16 Feb 11:38
· 348 commits to main since this release
v0.0.2
1b75874
This commit was created on github.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Changelog

  • Support RoPE position info in batch prefill/decode kernels #69 (C++ API only)
  • Use Torch's current stream for ops #111
  • Add pre-built wheels for different pytorch versions. #110
  • Add pre-built wheels for py39 #114
Assets 15
Loading