Skip to content

Integrate TensorRT-LLM #358

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Merged
merged 16 commits into from
Nov 15, 2023
Merged

Integrate TensorRT-LLM #358

merged 16 commits into from
Nov 15, 2023

Conversation

yunfeng-scale
Copy link
Contributor

@yunfeng-scale yunfeng-scale commented Nov 1, 2023

Integrating TensorRT-LLM with LLM engine. there are lots of caveats in this integration:

fixes #363

@yunfeng-scale yunfeng-scale requested a review from a team November 1, 2023 20:59
Copy link
Member

@yixu34 yixu34 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor comments.

Can we create a github issue for visibility and link it to this PR?

@yunfeng-scale yunfeng-scale enabled auto-merge (squash) November 13, 2023 22:56
@yunfeng-scale yunfeng-scale merged commit 4e2ea6c into main Nov 15, 2023
@yunfeng-scale yunfeng-scale deleted the yunfeng-trt-llm branch November 15, 2023 05:05
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Integrate TensorRT-LLM
2 participants