Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Allow scheduling of more than 10k jobs on CC #2

Open
dantp-ai opened this issue Dec 4, 2019 · 1 comment
Open

Allow scheduling of more than 10k jobs on CC #2

dantp-ai opened this issue Dec 4, 2019 · 1 comment

Comments

@dantp-ai
Copy link
Member

dantp-ai commented Dec 4, 2019

One approach is to have an extra parameter offset for the original index:

my index = (OFFSET-1)*10000 + job array index

@yiwan-rl
Copy link
Collaborator

yiwan-rl commented Dec 5, 2019

Agree, the offset should be passed into sbatch script by submitter through --export. And the user can then use

my index = (OFFSET-1)*10000 + job array index

in the sbatch script.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants