Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloudize-workflow.py - Script should start from last-upload if it fails and re-runs #3

Open
johnmaruska opened this issue May 10, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@johnmaruska
Copy link
Contributor

In the event of script failure, subsequent runs will start from the beginning and double-upload any progress that had already been made. The resource consumption is probably not a concern but the time lost to a lengthy upload failure may be.

The script should have some approach in place for handling restarts. Either tracking progress and skipping any already-uploaded files, or choosing to skip files that already exist in the bucket. Both approaches could take a flag to ignore them and do a full upload again.

@johnmaruska johnmaruska added the enhancement New feature or request label May 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant