Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Autodeploy script for a complete pipeline in scale #1905

Open
Fizz11 opened this issue Jul 31, 2020 · 0 comments
Open

Autodeploy script for a complete pipeline in scale #1905

Fizz11 opened this issue Jul 31, 2020 · 0 comments

Comments

@Fizz11
Copy link
Contributor

Fizz11 commented Jul 31, 2020

We should have a simple script that can deploy a complete set of objects needed for a file processing pipeline in scale, including a workspace, job-type, recipe, and strike. This script can form the base for rapid deployment of the pieces needed for processing to other clusters, and will also be useful in testing environments.

The script should utilize variables when possible to allow using the script for a variety of algorithms.

a fresh database should be assumed.

the script should make the following items:

  1. a workspace that points to the data to be processed
    2a. add the job-type to seed-Silo
    2b. a job-type that will process the data
  2. a recipe that runs the job-type
  3. a strike that calls said recipe and is tied to the created workspace.
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant