10/8/2017 - 6:39 AM

Steps to set up airflow

Steps to set up airflow

1. Setting up virtualenv 
virtualenv env

2. activate it using:
source ./env/bin/activate

3. pip install airflow # will install airflow version 1.8 to use latest one use: pip install apache-airflow

4. Add "export AIRFLOW_HOME=~/<directory>" to your bashrc/zshrc
echo "export AIRFLOW_HOME=/home/mahendra/pyconf/app_airflow" >> .zshrc

5. initialize the database
airflow initdb

6. start the web server
airflow webserver -p 8080

7. Start the scheduler
airflow scheduler

8. Add the dag 

Dag link:

Download script Link:

Enjoy :)