Skip to content

How to convert LLMA with hugging face format to ggml model? #892

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Closed
xiejibing opened this issue Apr 11, 2023 · 2 comments
Closed

How to convert LLMA with hugging face format to ggml model? #892

xiejibing opened this issue Apr 11, 2023 · 2 comments

Comments

@xiejibing
Copy link

the script convert-pth-to-ggml.py provides the ability to convert llama model (faire scale format) to ggml model,but how to convert a llama model with hugging face format to the ggml model?

@prusnak
Copy link
Collaborator

prusnak commented Apr 11, 2023

What do you mean by hugging face format? Do you mean safetensors?

There is a universal convert script brewing here - you might want to try it: #545

@prusnak
Copy link
Collaborator

prusnak commented Apr 14, 2023

try the new convert.py script that is now in master

@prusnak prusnak closed this as not planned Won't fix, can't repro, duplicate, stale Apr 14, 2023
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants