adding some missing targets into rclone.conf #5042
Conversation
|
|
||
| Examples of how to run this program: | ||
|
|
||
| # download everything for tgo |
There was a problem hiding this comment.
download everything for the tgo cassis mission
There was a problem hiding this comment.
Just TGO for the mission name. CaSSIS is the sensor.
| args = create_rclone_arguments(dest, remote, dry_run, ntransfers) | ||
| rclone(command="sync", extra_args=args, config=cfg_path, redirect_stdout=False, redirect_stderr=False) | ||
| args = create_rclone_arguments(dest, remote, ntransfers, kwargs) | ||
| rclone(command="copy", extra_args=args, config=cfg_path, redirect_stdout=False, redirect_stderr=False) |
There was a problem hiding this comment.
This swap will cause existing files to be re-downloaded? In essence, is the rclone sync vs. copy the same different from the aws s3 sync vs. copy?
There was a problem hiding this comment.
copy checks if the file exists before re-copying. It should only re-copy if 1. the same file exists on different sources and 2. the file is newer. I would say re-download if another source has a newer version of the same file is probably desired? Shouldn't happen too much after we sanitize the USGS sources.
There was a problem hiding this comment.
Agreed, we want to take newer files, but it shouldn't happen too often. The kernels are always versioned as separate files
* adding some missing targets * added kwargs to download scripts * removed unused code * address comments
Description
rlcone.conf had some module missing for some reason, this adds them back in.
Related Issue
#5038
Motivation and Context
How Has This Been Tested?
Screenshots (if appropriate):
Types of changes
Checklist:
Licensing
This project is mostly composed of free and unencumbered software released into the public domain, and we are unlikely to accept contributions that are not also released into the public domain. Somewhere near the top of each file should have these words: