Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Feature Request] - Please add a setting option to limit how many finished files can join file chunks and how many files can be verified at a single time. #643

Open
extremebs opened this issue Dec 31, 2023 · 2 comments

Comments

@extremebs
Copy link

Right now, since all my downloads have managed to finish downloading (about 20 1–5 GB files), they are all joining chunk files and verifying the file's integrity. Unfortunately, this is causing my hard drive to lag and slow down since all files are being read or written at the same time. It is making a task that should take about an hour into a four-hour task. If I could control the number of files with chunks being joined and verified, then I could set an amount that would make this drive not lag as much and possibly be done quicker.

@extremebs extremebs changed the title Please add a setting option to limit how many finished files can join file chunks and how many files can be verified at a single time. [Feature Request] - Please add a setting option to limit how many finished files can join file chunks and how many files can be verified at a single time. Dec 31, 2023
@Linden10
Copy link

Linden10 commented Feb 9, 2024

Same! Whenever I download many files that are over 100 or so in various sizes, the program runs to a crawl when combining and then checking the file integrity of each file! It can take a day or more just to finish everything depending on the number of files and their file size! (E.g. 12 files that are >1GB each).

The only solution I found is to repetitively download one (or more if the files are a bit small, otherwise only one) file at a time which quickly finishes up the file integrity check!

The only thing that's working fine is the files downloading quickly, but when finishing that's when everything runs to a crawl and even worse is when it slows down the bandwidth of the hard-drive/ssd too!

Please do look into this, either providing a option, an internal limit or a proper fix for this! Thank you!

tonikelope pushed a commit that referenced this issue Aug 6, 2024
tonikelope pushed a commit that referenced this issue Aug 6, 2024
@tonikelope
Copy link
Owner

I have implemented (experimental) that only chunks of a file are put together at the same time (with a mutex). Let's see if it works better.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants