Valeria

Valeria

Useful links

Home page

Documentation

Setup

Start by signing in using your IDUL at Créer un compte VALERIA.

You might need to email Valeria for collaborator status if you get errors.

Upload data using rclone

Install rclone, then add the following to .config/rclone/rclone.conf

[valeria]
type = s3
provider = Ceph
env_auth = false
access_key_id = <access key from valeria>
secret_access_key = <secret key from valeria>
endpoint = s3.valeria.science
acl = private

Validate it can access Valeria using rclone size valeria:

bash:

# Single file 
rclone copy my/local/file valeria:my/remote/folder
# Complete folder
rclone sync my/local/dataset valeria:my/remote/dataset

SSH to Valerian ssh <user>@login.valeria.science, run val-generate-s3-config, and use rclone to move the data to the data storage most adapted to your use case, see Résumé des caractéristiques du stockage Lustre et Objet (s3) de VALERIA.