Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: mma rowsum for fp8 #180

Merged
merged 1 commit into from
Mar 13, 2024
Merged

feat: mma rowsum for fp8 #180

merged 1 commit into from
Mar 13, 2024

Conversation

yzh119
Copy link
Collaborator

@yzh119 yzh119 commented Mar 13, 2024

Both e4m3 and e5m2.

@yzh119 yzh119 merged commit 5af935c into main Mar 13, 2024
@MasterJH5574 MasterJH5574 deleted the fp8-rowsum branch March 21, 2024 14:10
yzh119 added a commit that referenced this pull request May 2, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.0.4](v0.0.3...v0.0.4)
(2024-05-01)


### Features

* pytorch 2.3 support
* more gqa group sizes
* add mma instructions for fp8
([#179](#179))
([d305798](d305798))
* mma rowsum for fp8
([#180](#180))
([5af935c](5af935c))
* support any num_heads for get_alibi_slope
([#200](#200))
([b217a6f](b217a6f))


### Bug Fixes

* fix python package dispatch error message
([#182](#182))
([8eed01c](8eed01c))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zihao Ye <expye@outlook.com>
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant