New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

feat: MobileLLM #51

Open

1 of 6 tasks

hahuyhoang411 opened this issue Nov 1, 2024 · 1 comment

Assignees

Labels

type: model request

Collaborator

hahuyhoang411 commented Nov 1, 2024

Model Name

mobilellm

Model Source

facebook/MobileLLM-1B

Model Cortexso HuggingFace Repo

https://huggingface.co/cortexso/mobilellm

Model Description

MobileLLM is introduced: "MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases", published in ICML 2024.

Requested Formats

GGUF (llama.cpp)
TensorRT (TensorRT-LLM)
ONNX (Onnx Runtime)

Additional Information

No response

Confirmation

I have created model.yml and metadata.yml files on cortex.so HugginFace repo
I have run the model through the model conversion pipeline
I have tested the model

hahuyhoang411 added the type: model request label

Collaborator Author

hahuyhoang411 commented Nov 1, 2024

Error: #52

dan-menlo added this to Menlo

github-project-automation bot moved this to Investigating in Menlo

hahuyhoang411 moved this from Investigating to In Progress in Menlo

hahuyhoang411 self-assigned this

Minh141120 moved this from In Progress to Discontinued in Menlo

# for free to join this conversation on GitHub. Already have an account? # to comment