New SixDesk script, after an intense year of development #18
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- removing .zip result files if they are older that 40d (previous value: 30d), to allow people safely retrieving very first results from 2017 BOINC pentathlon, even if they do it not immediately; - zipping of results is performed every 8h (old value was 4h), to try to save namespace in download dir;
…ed, and a message is printed on terminal In addition, -i action and -S option are declared as incompatible
Conflicts: utilities/bash/run_six.sh
- -R <jobName> results in submitting that jobname, whereas -R LAST results in submitting the job after the last one submitted; - echo name of last submitted job from taskids;
Conflicts: utilities/bash/run_six.sh
…o submission is found
Conflicts: utilities/bash/run_results
- fix to bug introduced by IT; - search through spooldir on AFS is totally skipped; - results are stored in dirs parallel to all, one per study; - trashbin mechanism still kept, even though no results are expected to go there
- logs of scripts are stored in logs/<study_name>.log (dir is automatically created in case it is not there) - default commands are stored in variables - improved a bit how_to_use - removed log of calls - tmpCommand is built once forever at option parsing, including SCRIPTDIR var - start / end date of processing is dumped in log file, along with time of processing
crontab list of boincai08.cern.ch updated accordingly
…day and last release For reference: 94597a0...20d0be6
…${Runnam} " taksids; checking only missing tasks in taskids when crosschecking with platform tasks;
… existing backup dir
In particular: * on NFS path only cp to /tmp (and from assimilator) and rm will insist; * /tmp has sub-folders, one per study, with same name as .zip archive; * /tmp is cleared out by exit via trap; Moreover: * logging to log_<serverName> - same functions/calls as cron.submit-sixtrack-simo3; * a bit of code re-factoring, especially introduced treatStudy function + improvement of comments; * improved some output on terminal; * introduced an lTest flag;
* script stays in /data/boinc/project/sixtrack/bin * logging in /data/boinc/project/sixtrack/log_<serverName> was already committed
* added handling of turnx; * added log files to parse; * lsummary flag at plotting;
…onitor-boinc-server/submissions/retrieveData.sh
…/plotData_restart.gnu to retrieve data from both 2017 and 2018
…c-server/submissions/archive/plotData_period.gnu
…er_status.php instead of http://lhcathomeclassic.cern.ch/sixtrack/server_status.php The main problem lied on the fact that table headers marking the table name were not in <tr> tags but in <h4> and <h3> tags; Additional modifications to parseHTML.py: * added several comments on format of .php file downloaded, html tags, internal representation of info; * cleaner parsing of .php file; * cleaner output of tables;
… trigger a max number of jobs per study, and targeting a specific study
…o avoid filling max number of files in AFS dirs
…ion of dirs in /tmp
Actually, the version comparison is coded in a bash function, based on string comparison by awk. Then, in sixdb.sh and in run_six.sh python versions are checked, against different requirements, treated independently, to be as flexible as possible.
…ity on track folder
…ailure of submission to BOINC due to work.boinc volume being filled
…icular: * mail is sent only if occupancy is >0.5GB; * occupancy reported in GB in the main body of the email; * proper /tmp path on lxplus node; * updated text of email;
…ine argument to call to listDeleteStudies.sh
Merge commit '1e523e52465cfe46874f7b7d0d1bae8b341a8881'
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.