Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Limit Request: ctranslate2 - 20 GB #1480

Closed
2 tasks done
guillaumekln opened this issue Nov 18, 2021 · 4 comments
Closed
2 tasks done

Limit Request: ctranslate2 - 20 GB #1480

guillaumekln opened this issue Nov 18, 2021 · 4 comments

Comments

@guillaumekln
Copy link

guillaumekln commented Nov 18, 2021

Project URL

https://pypi.org/project/ctranslate2/

Does this project already exist?

  • Yes

Which limit do you want increased?

total project size

New limit

20000 MB

Which indexes

PyPI

Reasons for the request

CTranslate2 is a C++ inference engine for neural machine translation models. We publish wheels for all supported Python versions on Linux, macOS, and Windows. The library supports execution on GPU and includes compiled CUDA kernels for multiple architectures.

The project is close to the 10GB limit and we'd like to double this limit to 20GB.

The current size of a release is 430MB, but we recently re-worked how we link against a dependency and the future release size should be about 160MB. With a rate of 2 releases per month, the additional 10GB would last more than 30 months. After that, we first plan to delete old versions that are no longer relevant.

Thanks!

Code of Conduct

  • I agree to follow the PSF Code of Conduct
@pradyunsg pradyunsg changed the title Limit Request: ctranslate2 - 20000 MB Limit Request: ctranslate2 - 20 GB Dec 5, 2021
@guillaumekln
Copy link
Author

guillaumekln commented Dec 8, 2021

I updated the description to include the current release size, the future release size (following a recent improvement), and our deletion policy if the project reaches the 20GB limit.

@guillaumekln
Copy link
Author

Recent releases have a total size of 170MB, down from 430MB.

In the meantime, we had to move some wheels to a S3 bucket to make room for recent releases. Bumping the total project size to 20GB would allow us to keep a larger release history on PyPI.

Thanks!

@pradyunsg
Copy link
Contributor

Increased the limit to 20 GB. :)

@guillaumekln
Copy link
Author

Thanks!

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

No branches or pull requests

2 participants