Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

how to use multiple threads with using this library for better speed of reading fastq files ? #137

Open
lidd77 opened this issue Jan 22, 2020 · 1 comment

Comments

@lidd77
Copy link

lidd77 commented Jan 22, 2020

Hi,
In order to improve the speed of reading fastq files and doing some quality control statistics , wanna
use multiple threads to complete some statistics of every four fastq lines from the FASTQ files .
so could you recommend some methods/codes to realize that goal ?
it's very slow to read fastq files in the way line by line .

Best!

@ahcm
Copy link

ahcm commented Jan 22, 2020

Read in big chunks in main thread. Process in memory in parallel.

Probably not worth optimization: let main thread distribute the chunks to the fitting numa nodes.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants