PlanetTiler OSM job

Download and process OSM pbfs from Geofabrik for a given area and upload the resulting mbtiles to S3.

Variables

There are two variables that can be changed in this project:

Variable	Description	Default Value
AREA	This variable defines the area to download and process. The default value is planet.	planet
S3_PATH	This variable specifies the S3 path to upload the mbtiles file. The default value is ovh:kargo/data/MBTiles.	ovh:kargo/data/MBTiles
WEBHOOK_URL	This variable specifies the webhook URL for the project. The default value is in the secrets file and can be overridden.	Secrets file value
SOPS_AGE_KEY	This variable specifies the SOPS age key. It will be prompted during the program execution if the secrets files are encrypted. To avoid waiting for the prompt, you can directly set this variable in the environment.	None
SHUTDOWN	This variable specifies if the instance should be shut down after the job is done. The default value is true.	true
KEEP_DATA	This variable specifies if the data should be kept after the job is done. The default value is false.	false

Running the Project

This project should be run in a Linux environment as root (NOT as sudo as this will cause issues with the environment variables). This project is intended to be used by the Kalisio company, with their specific development environment.

⚠️ Requirements ⚠️

You will need a AGE SOPS key to decrypt the secrets file in case they are still encrypted.

Wait for the prompt to enter the key or set the SOPS_AGE_KEY variable in the environment.

Your SOPS key should be in $DEVELOPMENT_DIR/age/keys.txt on your local machine.

The key should look like this:

AGE-SECRET-KEY-XXXXX...

To start the job, you can run the following commands:

git clone https://github.com/kalisio-nicolas/planetilerJob
cd planetilerJob
# change the variables if needed
# export AREA=planet
# export S3_PATH=ovh:kargo/data/MBTiles
# export WEBHOOK_URL=https://hooks.slack.com/services/no-webhooks
# export SHUTDOWN=true
# export KEEP_DATA=false

# Run the project
./run.sh

Fast one-liner (if no need to change the variables):

git clone https://github.com/kalisio-nicolas/planetilerJob && cd planetilerJob && ./run.sh