Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

MetaPartition dispatch contains the dataset metadata #139

Closed
fjetter opened this issue Sep 25, 2019 · 1 comment
Closed

MetaPartition dispatch contains the dataset metadata #139

fjetter opened this issue Sep 25, 2019 · 1 comment
Labels
bug Something isn't working good first issue Good for newcomers
Milestone
v4.0.0

Comments

@fjetter
Copy link
Collaborator

fjetter commented Sep 25, 2019

Problem description

Currently dispatch_metapartitions_from_factory yields MetaPartitions holding the entire user metadata of the dataset for every MP. For large customer metadata this slows down scheduling significantly and should be avoided
@fjetter fjetter added bug Something isn't working good first issue Good for newcomers labels Sep 25, 2019
@fjetter fjetter added this to the v4.0.0 milestone Sep 26, 2019
@fjetter
Copy link
Collaborator Author

fjetter commented Mar 16, 2021

Closed by #434

@fjetter fjetter closed this as completed Mar 16, 2021
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
bug Something isn't working good first issue Good for newcomers
Milestone
v4.0.0
Development

No branches or pull requests
1 participant
@fjetter