Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

feat: llama3.1 (TensorRT-LLM) #27

Closed
2 tasks
freelerobot opened this issue Sep 6, 2024 · 2 comments
Closed
2 tasks

feat: llama3.1 (TensorRT-LLM) #27

freelerobot opened this issue Sep 6, 2024 · 2 comments
Labels
type: model request

Comments

@freelerobot
Copy link
Contributor

Goal

  • Support llama3.1 in main TensorRT-LLM engine formats
  • Upload to HF

User Requests

image
@dan-menlo dan-menlo changed the title feat: support llama3.1 in TensorRT-LLM feat: TensorRT-LLM llama3.1 support Sep 8, 2024
@dan-menlo dan-menlo changed the title feat: TensorRT-LLM llama3.1 support feat: llama3.1 (TensorRT-LLM) Sep 29, 2024
@dan-menlo dan-menlo transferred this issue from menloresearch/cortex.cpp Sep 29, 2024
@Desmond819
Copy link

any update on this?

@hahuyhoang411 hahuyhoang411 moved this to Planning in Menlo Oct 22, 2024
@ramonpzg ramonpzg added this to Cortex Mar 13, 2025
@ramonpzg
Copy link

Closing this issue as we have deprecated tensorrt-llm

@github-project-automation github-project-automation bot moved this from Planning to QA in Menlo Mar 17, 2025
@github-project-automation github-project-automation bot moved this to Done in Cortex Mar 17, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
type: model request
Projects
Cortex
Archived in project
Menlo
Status: QA
Models
Status: Requested
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Desmond819 @ramonpzg @freelerobot