Skip to content

Airflow DAGs and Plugins to Support Data Pipelines

Notifications You must be signed in to change notification settings

USACE/airflow-config

Repository files navigation

Airflow Configuration and DAGS

start up using docker compose up

Configuration is set to log to both locally and to minio (to mock logging to S3).

To start minio using docker compose -f docker-compose.minio.yml up or ./minio.sh up

Connection configuration

  • config found in airflow.env

Notes:

  • You may need to adjust the network or remove it completely.
  • Linux Users - You may need to chmod 777 the logs dir for local testing with Docker.

Airflow Web UI: http://localhost:8000

  • user: admin
  • pw: admin

About

Airflow DAGs and Plugins to Support Data Pipelines

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published