Connecting to Compute Resources made Simple(r)
pip install crimpl
IMPORTANT: crimpl is currently still under development, is not yet well-tested, and is subject to significant API changes. Please keep posted until an official release is ready.
Read the latest documentation on readthedocs or browse the current documentation.
crimpl provides high-level python object-oriented interfaces to manage running scripts within conda environments on remote compute resources.
Each type of server implements a run_script which runs a given set of commands remotely on the server, showing the output, and waiting for completion, and submit_script which starts the script running on the server and detaches while allowing for monitoring its progress remotely. They also each include a s.check_output for copying expected output files back to the local machine.
The configuration, options, and capabilities of each type of server are explored in more detail:
Local Thread:
RemoteThread:
Remote Slurm:
Contributions are welcome! Feel free to file an issue or fork and create a pull-request.