Skip to content

Vicuna works sometimes strange #757

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Closed
4eJIoBek1 opened this issue Apr 4, 2023 · 1 comment
Closed

Vicuna works sometimes strange #757

4eJIoBek1 opened this issue Apr 4, 2023 · 1 comment

Comments

@4eJIoBek1
Copy link

The quantized weights is here https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/tree/main
But when you rin this in instructions mode, it will add the training dataset artifacts such as ###Instruction: in discussion. Is it possible to control these markers or add special mode that will stop the answer when ###
@4eJIoBek1
Copy link
Author

Aw, found another one #302

@Bearsaerker Bearsaerker mentioned this issue Mar 12, 2025
Open
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@4eJIoBek1