Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

DeepLCFeatureGenerator multiprocessing issue when number of processes is more than 1 #151

Open
vrkosk opened this issue May 23, 2024 · 2 comments

Comments

@vrkosk
Copy link

vrkosk commented May 23, 2024

When I run DeepLCFeatureGenerator with processes=8, it takes a long time, much longer than processes=1. Python correctly starts 8 python.exe multiprocesses, but often the execution just hangs (I've waited more than 30 minutes -- using processes=1, it took less than 5 minutes). It's actually faster to run DeepLCFeatureGenerator with just processes=1 and it seems to work every time.

I can provide a test case if this isn't a known issue already.

@RobbinBouwmeester
Copy link
Member

Hi, there have been some significant updates lately. Can you confirm for the latest versions this is still an issue.

@vrkosk
Copy link
Author

vrkosk commented Aug 5, 2024

It will be a while before I can test the latest version, sorry.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants