This is the documentation for the Apache Airflow developer version.
For documentation for stable versions, see: airflow.apache.org.
Apache Airflow Documentation
apache-airflow
Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation.
Providers packages
Providers packages include integrations with third party integrations. They are updated independently of the Apache Airflow core.
AirbyteAlibabaAmazonApache BeamApache CassandraApache DrillApache DruidApache FlinkApache HDFSApache HiveApache ImpalaApache KafkaApache KylinApache LivyApache PigApache PinotApache SparkApache SqoopAppriseArangoDBAsanaAtlassian JiraCeleryIBM CloudantKubernetesCommon SQLDask ExecutorDatabricksDatadogdbt CloudDingdingDiscordDockerElasticsearchExasolFacebookFile Transfer Protocol (FTP)GithubGooglegRPCHashicorpHypertext Transfer Protocol (HTTP)Internet Message Access Protocol (IMAP)InfluxdbJava Database Connectivity (JDBC)JenkinsMicrosoft AzureMicrosoft SQL Server (MSSQL)PowerShell Remoting Protocol (PSRP)Windows Remote Management (WinRM)MongoDBMySQLNeo4jODBCOpenFaaSOpenLineage AirflowOpsgenieOraclePagerdutyPapermillPlexusPostgreSQLPrestoQuboleRedisSalesforceSambaSegmentSendgridSFTPSingularitySlackSimple Mail Transfer Protocol (SMTP)SnowflakeSQLiteSSHTableauTabularTelegramTrinoVerticaZendesk
Docker image
It makes efficient, lightweight, self-contained environment and guarantees that software will always run the same no matter of where it's deployed.
Helm Chart
It will help you set up your own Airflow on a cloud/on-prem k8s environment and leverage its scalable nature to support a large group of users. Thanks to Kubernetes, we are not tied to a specific cloud provider.