Skip to content

v0.1.0

Compare
Choose a tag to compare
@github-actions github-actions released this 17 Jul 08:29
58b68d0

0.1.0 (2024-07-17)

Features

  • Add mask to merge_state_in_place (#372) (e14fa81)
  • expose pytorch api for block sparse attention (#375) (4bba6fa)
  • Fused GPU sampling kernel for joint top-k & top-p sampling (#374) (6e028eb)