added functionality to remove successfully ploaded files; additionaly…

[vlerkin]

Cherry-picked changes (1 last commit from 668-joblogs branch):

Added logic to remove files:

After file was successfully uploaded to the S3-like-storage the file in the volume will be removed;
When code receives events from other existing jobs on the cluster it checks if files with its logs are present in the S3-like-storage, if not the code will attempt to collect logs, if the stdout is still available, if the file exists the code now checks if that file also still present in the volume and removes it since it is present in the S3-like-storage.
I think this functionality addresses your concerns.

[vlerkin]

Hi Willem, instead of rebasing 20 commits I decided to create a new branch deriving from main and apply one commit that actually matters, since all other commits have already been merged into main.

[wvengen]

Clear, thanks!

[wvengen]

Thanks for merging!
Please prefix the PR number with "PR", and include an issue if possible in the commit line as well when merging, and keep the first line short when possible (additional details can be present on later lines). So somethine like this would have been appropriate:

Remove already uploaded files (#28, PR #44)

after they have been uploaded, and also when old jobs are present on the cluste the files of those jobs already exist on container storage

Otherwise 👍

[vlerkin]

Sorry, got it