Skip to content

GGML_ASSERT: ggml.c:4014: false zsh: abort ./main -m ./models/65B/ggml-model-q4_0.bin -t 16 -n 256 --repeat_penalty 1.0 #400

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Closed
nazthelizard122 opened this issue Mar 22, 2023 · 5 comments
Closed

GGML_ASSERT: ggml.c:4014: false zsh: abort ./main -m ./models/65B/ggml-model-q4_0.bin -t 16 -n 256 --repeat_penalty 1.0 #400

nazthelizard122 opened this issue Mar 22, 2023 · 5 comments
Labels
need more info The OP should provide more details about the issue

Comments

@nazthelizard122
Copy link

Not sure why this happens, I am on the latest commit and I am up-to-date on everything
I did some tests and it seems like it breaks after 500~ tokens
Is this a model limitation or can I fix this by increasing some value?
@gjmulder gjmulder added the question Further information is requested label Mar 22, 2023
@gjmulder
Copy link
Collaborator

Please review and use our issue template to provide more details so we can better understand your problem and answer you.

@gjmulder gjmulder added need more info The OP should provide more details about the issue and removed question Further information is requested labels Mar 22, 2023
@nazthelizard122
Copy link
Author

Idk how to use it

@gjmulder
Copy link
Collaborator

Sorry, better link

Copy everything from line 10 and try to complete as requested.

@nazthelizard122
Copy link
Author

idk how to get the check mark

@nazthelizard122
Copy link
Author

now I'm running into another error, it segfaults with the regular script

@sw sw closed this as not planned Won't fix, can't repro, duplicate, stale Apr 19, 2023
@Bearsaerker Bearsaerker mentioned this issue Mar 12, 2025
Open
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
need more info The OP should provide more details about the issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sw @gjmulder @nazthelizard122