Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Execution load balancing #692

Merged
merged 2 commits into from
Mar 10, 2020

Conversation

andreygolev
Copy link
Contributor

serf.Members() seems to usually return same order of nodes.

When we have job definition with tag "label:1", the job is executed usually on the same worker agent .
This PR adds shuffling, before returning a node for execution.

After shuffling is added, we see good load distribution among worker pool with matching tag.

Screenshot 2020-03-05 at 13 44 06

Copy link
Member

@vcastellm vcastellm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM after fixing tests

@andreygolev
Copy link
Contributor Author

tests didn't work by unknown reason

@vcastellm
Copy link
Member

It should work if you rebase master here

missing import added
@andreygolev
Copy link
Contributor Author

It should work if you rebase master here

Rebase didn't help

@vcastellm
Copy link
Member

Check the tests, it's failing in Test_processFilteredNodes

@andreygolev
Copy link
Contributor Author

There was a bug, indeed. Very bad one :) Now fixed.

@vcastellm
Copy link
Member

There was a bug, indeed. Very bad one :) Now fixed.

Good to have tests then 👍

@vcastellm vcastellm merged commit 5cfd9fc into distribworks:master Mar 10, 2020
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants