Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Parallel execution of uptodate-properties #201

Merged
merged 1 commit into from
Apr 3, 2024

Conversation

mkarg
Copy link
Contributor

@mkarg mkarg commented Mar 22, 2024

As File::exists, just like obtaining a file's modification date, both are potentially blocking operations, huge file sets can slow down the uptodate-property and uptodate-properties Mojos.

A potential solution is to use several threads, so while the first thread is still blocked, another thread can take over the next uptodate-check. With multi-core CPUs being ubiquitous these days, such a rather small change can improve the build time considerably, in particular for huge projects with thousands of files and / or slows disks (like typically on NTFS). For single-core CPUs the drawback is neglectable.

@mkarg
Copy link
Contributor Author

mkarg commented Mar 22, 2024

@slachiewicz @slawekjaranowski @khmarbaise Kindly requesting your review. :-)

@slawekjaranowski slawekjaranowski merged commit 3185dbb into mojohaus:master Apr 3, 2024
19 checks passed
@mkarg mkarg deleted the parallel-uptodate branch April 3, 2024 17:03
# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants