New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Try configuring NameRes to have no CPU limit on Sterling #166

Open

gaurav opened this issue Oct 15, 2024 · 1 comment

Milestone

NameRes November ...

Contributor

gaurav commented Oct 15, 2024

Why? Because it bursts when it gets a lot of requests, and goes to 100% CPU usage.
The requests limit will then get more important: https://renci.atlassian.net/wiki/spaces/RENCI/pages/260833283/Sterling#Request-an-exemption-from-CPU-limits
Request goes here: https://renci.atlassian.net/wiki/spaces/RENCI/pages/260964443/Things+You+Can+Request#Removing-CPU-Limits

Contributor Author

gaurav commented Oct 15, 2024

If the problem is that we are getting overwhelmed/Solr needs 100% CPU to rearrange/rebuild its indexes or something, maybe we can use rate-limiting (https://solr.apache.org/guide/solr/latest/deployment-guide/rate-limiters.html) to cause Solr to send back 429s when it needs to focus on indexing.

gaurav added this to the NameRes November 2024 milestone

# for free to join this conversation on GitHub. Already have an account? # to comment