New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Make threads daemons #215

Open

db0 opened this issue May 22, 2023 · 0 comments

Labels

Member

db0 commented May 22, 2023

thread executor opens non-demon threads, so when an inference jobs gets stuck, the whole process is stuck.

tazlin added the enhancement label

# for free to join this conversation on GitHub. Already have an account? # to comment