Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Limiting input length to prevent out of memory issues #76

Open
Ciaranwuk opened this issue Sep 11, 2023 · 0 comments
Open

Limiting input length to prevent out of memory issues #76

Ciaranwuk opened this issue Sep 11, 2023 · 0 comments

Comments

@Ciaranwuk
Copy link

If the user gives too long a prompt the GPU will throw a CUDA out of memory error and the whole PC/server requires rebooting. Does anyone have any suggestions for how to limit the length of the user input to prevent this?
I believe the easiest way to do this would be to add a character limit to the input box on the UI but that wouldn't cover the CLI option, and I can't find info on how to do this.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant