-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Add support for XTC and DRY samplers #1843
New issue
Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? # to your account
base: main
Are you sure you want to change the base?
Conversation
This is a nice addition, as those parameters are present in llama.cpp but missing in the bindings. @abetlen |
I would also love to see this merged! |
Patiently waiting for the merge |
Updated for llama.cpp changes |
The sampler order was wrong, causing crashes when using XTC. Fixed now. |
Hi, should Also, should the default value be changed from 0 to -1? |
Good suggestions, thank you. Updated the PR. |
@abetlen Hi, is it possible for you to merge this? |
Seems to work, but someone who knows this project better please check the order in
apply_func()
.