Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

GGUF support #1209

Open
2 tasks
lutzroeder opened this issue Dec 31, 2023 · 1 comment
Open
2 tasks

GGUF support #1209

lutzroeder opened this issue Dec 31, 2023 · 1 comment
Labels
feature

Comments

@lutzroeder
Copy link
Owner

lutzroeder commented Dec 31, 2023 •
edited
Loading

Tasks:

  • Quantization
  • Architecture generation

Source:
gguf_init_from_file

Examples:
mixtral-8x7b-v0.1.Q4_K_M.gguf.zip
phi-2.Q2_K.gguf.zip
vicuna-33b.Q2_K.gguf.zip
@lutzroeder lutzroeder changed the title GGML support GGUF support Dec 31, 2023
lutzroeder added a commit that referenced this issue Dec 31, 2023
@lutzroeder
Add GGUF support (#1209)
626a9c7
lutzroeder added a commit that referenced this issue Dec 31, 2023
@lutzroeder
Add GGUF support (#1209)
0c78c64
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
c676e09
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
c4ee314
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add GGUF support (#1209)
46de617
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Update ggml.js (#1209)
998c4dd
lutzroeder added a commit that referenced this issue Jan 1, 2024
@lutzroeder
Add .gguf extension (#1209)
adb9f19
lutzroeder added a commit that referenced this issue Jan 3, 2024
@lutzroeder
Update ggml.js (#1209)
bb123d3
lutzroeder added a commit that referenced this issue Jan 4, 2024
@lutzroeder
Rename ggml.js to gguf.js (#1209)
ab63f81
lutzroeder added a commit that referenced this issue Jan 4, 2024
@lutzroeder
Add GGUF test files (#1209)
09e5327
lutzroeder added a commit that referenced this issue Jan 12, 2024
@lutzroeder
Update gguf.js (#1209)
a89846a
@charmandercha
Copy link

I met this project now, how is this PR? I am still in the process of understanding everything

# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lutzroeder @charmandercha