An local setup for Airflow v2 with docker-compose (future Lakehouse)
- Docker (started) and docker-compose (just install Docker for Desktop if you are on laptop)
- Clone repo
git clone https://github.com/datafuel/lakehouse_docker.git
- Run
cd lakehouse_docker
- Rename .env.example to .env and replace dummy values with yours
- Run
docker-compose up
then access the services
- Run
docker network create datafuel-local-network
- Run
docker-compose -f datafuel.docker-compose.yml
Make sure to wait at least 30 seconds before launching any service !