Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[example] Add support for DBRX #174

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

[example] Add support for DBRX #174

wants to merge 9 commits into from

Conversation

yanboliang
Copy link
Contributor

Support dbrx from databricks.
Initial perf numbers:

|                  |   1 GPU |    2 GPU  | 4 GPU  |    8 GPU   |
|------------------|---------|-----------|--------|------------|
|baseline(bfloat16)|    OOM  |     OOM   | 59.53  |  100.51    |
|        int8      |    OOM  |    66.72  | 91.21  |  146.86    |

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 7, 2024
@yanboliang yanboliang requested a review from Chillee May 7, 2024 05:21
@Chillee Chillee changed the title Add support for DBRX [example] Add support for DBRX May 15, 2024
@yanboliang yanboliang closed this Sep 9, 2024
@yanboliang yanboliang deleted the dbrx branch September 9, 2024 03:53
@yanboliang yanboliang restored the dbrx branch September 9, 2024 03:54
@yanboliang yanboliang reopened this Sep 9, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Reviewers

@Chillee Chillee

Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@yanboliang @facebook-github-bot