Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

CPUs Parlallelization available? #132

Open
rolivella opened this issue Feb 21, 2022 · 2 comments
Open

CPUs Parlallelization available? #132

rolivella opened this issue Feb 21, 2022 · 2 comments
Labels
duplicate This issue or pull request already exists

Comments

@rolivella
Copy link

Hi all, is there a way to use more CPUs while running the TRFP? Or are you planning to add this option?

Thanks!

@caetera caetera added the duplicate This issue or pull request already exists label Feb 21, 2022
@caetera
Copy link
Collaborator

caetera commented Feb 21, 2022

Hi @rolivella,
that is an long lasting issue, see #23 and #95
In short, the bottleneck is writing the mzML file (and index); this process essentially has to be single-threaded. Multithreaded processing of a single file is not on the list for any near future. It is possible, however, to run several instances of TRFP working on different files (for example, to process a folder faster). I have old and ugly python script that I can share.

@rolivella
Copy link
Author

Ah yes, it makes sense. Thanks for the python script but I'm developping a single-file pipeline so I don't need it yet. I'm trying to optimize every single step but I see that, at least, regarding the TRFP I can't do nothing (or little) more.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
duplicate This issue or pull request already exists
Projects
None yet
Development

No branches or pull requests

2 participants