Home: http://airflow.apache.org
Package license: Apache-2.0
Feedstock license: BSD-3-Clause
Summary: Airflow is a platform to programmatically author, schedule and monitor workflows
Use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.
When workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.
| Azure |
|
||||||||||||||
| Windows |
|
||||||||||||||
| Linux_ppc64le |
|
| Name | Downloads | Version | Platforms |
|---|---|---|---|
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
Installing airflow-split from the conda-forge channel can be achieved by adding conda-forge to your channels with:
conda config --add channels conda-forge
Once the conda-forge channel has been enabled, airflow, airflow-with-async, airflow-with-atlas, airflow-with-aws, airflow-with-azure-mgmt-containerinstance, airflow-with-azure_blob_storage, airflow-with-azure_cosmos, airflow-with-azure_data_lake, airflow-with-cassandra, airflow-with-celery, airflow-with-cgroups, airflow-with-cloudant, airflow-with-crypto, airflow-with-dask, airflow-with-databricks, airflow-with-datadog, airflow-with-docker, airflow-with-druid, airflow-with-elasticsearch, airflow-with-emr, airflow-with-flask_oauth, airflow-with-grpc, airflow-with-hashicorp, airflow-with-hdfs, airflow-with-hive, airflow-with-jdbc, airflow-with-jenkins, airflow-with-jira, airflow-with-kerberos, airflow-with-kubernetes, airflow-with-ldap, airflow-with-mongo, airflow-with-mssql, airflow-with-mysql, airflow-with-oracle, airflow-with-pagerduty, airflow-with-papermill, airflow-with-password, airflow-with-postgres, airflow-with-qds, airflow-with-rabbitmq, airflow-with-redis, airflow-with-salesforce, airflow-with-samba, airflow-with-segment, airflow-with-sendgrid, airflow-with-sentry, airflow-with-slack, airflow-with-snowflake, airflow-with-ssh, airflow-with-statsd, airflow-with-vertica, airflow-with-virtualenv, airflow-with-webhdfs, airflow-with-winrm can be installed with:
conda install airflow airflow-with-async airflow-with-atlas airflow-with-aws airflow-with-azure-mgmt-containerinstance airflow-with-azure_blob_storage airflow-with-azure_cosmos airflow-with-azure_data_lake airflow-with-cassandra airflow-with-celery airflow-with-cgroups airflow-with-cloudant airflow-with-crypto airflow-with-dask airflow-with-databricks airflow-with-datadog airflow-with-docker airflow-with-druid airflow-with-elasticsearch airflow-with-emr airflow-with-flask_oauth airflow-with-grpc airflow-with-hashicorp airflow-with-hdfs airflow-with-hive airflow-with-jdbc airflow-with-jenkins airflow-with-jira airflow-with-kerberos airflow-with-kubernetes airflow-with-ldap airflow-with-mongo airflow-with-mssql airflow-with-mysql airflow-with-oracle airflow-with-pagerduty airflow-with-papermill airflow-with-password airflow-with-postgres airflow-with-qds airflow-with-rabbitmq airflow-with-redis airflow-with-salesforce airflow-with-samba airflow-with-segment airflow-with-sendgrid airflow-with-sentry airflow-with-slack airflow-with-snowflake airflow-with-ssh airflow-with-statsd airflow-with-vertica airflow-with-virtualenv airflow-with-webhdfs airflow-with-winrm
It is possible to list all of the versions of airflow available on your platform with:
conda search airflow --channel conda-forge
conda-forge is a community-led conda channel of installable packages. In order to provide high-quality builds, the process has been automated into the conda-forge GitHub organization. The conda-forge organization contains one repository for each of the installable packages. Such a repository is known as a feedstock.
A feedstock is made up of a conda recipe (the instructions on what and how to build the package) and the necessary configurations for automatic building using freely available continuous integration services. Thanks to the awesome service provided by CircleCI, AppVeyor and TravisCI it is possible to build and upload installable packages to the conda-forge Anaconda-Cloud channel for Linux, Windows and OSX respectively.
To manage the continuous integration and simplify feedstock maintenance
conda-smithy has been developed.
Using the conda-forge.yml within this repository, it is possible to re-render all of
this feedstock's supporting files (e.g. the CI configuration files) with conda smithy rerender.
For more information please check the conda-forge documentation.
feedstock - the conda recipe (raw material), supporting scripts and CI configuration.
conda-smithy - the tool which helps orchestrate the feedstock.
Its primary use is in the construction of the CI .yml files
and simplify the management of many feedstocks.
conda-forge - the place where the feedstock and smithy live and work to produce the finished article (built conda distributions)
If you would like to improve the airflow-split recipe or build a new
package version, please fork this repository and submit a PR. Upon submission,
your changes will be run on the appropriate platforms to give the reviewer an
opportunity to confirm that the changes result in a successful build. Once
merged, the recipe will be re-built and uploaded automatically to the
conda-forge channel, whereupon the built conda packages will be available for
everybody to install and use from the conda-forge channel.
Note that all branches in the conda-forge/airflow-split-feedstock are
immediately built and any created packages are uploaded, so PRs should be based
on branches in forks and branches in the main repository should only be used to
build distinct package versions.
In order to produce a uniquely identifiable distribution:
- If the version of a package is not being increased, please add or increase
the
build/number. - If the version of a package is being increased, please remember to return
the
build/numberback to 0.