New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

make a better use of resources during indexing #43

Open

nbittich opened this issue Jul 28, 2022 · 0 comments

Labels

enhancement needs discussion

Contributor

nbittich commented Jul 28, 2022

From my understanding, number of threads configurable are linked to number of virtuoso connections.

If I have 32 threads and 1500 jobs, I would expect that 32 jobs run concurrently, and batches within the job runs sequentially.

I think that could make a better usage of resources.

e.g:

job number 1 has 11 batches => seems that 21 threads doesn't do anything during that time (could run other jobs but doesn't seem so)

nvdk added enhancement needs discussion labels

# for free to join this conversation on GitHub. Already have an account? # to comment