Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrong size of remote backup reported if upload was resumed #526

Closed
mmolinac opened this issue Oct 3, 2022 · 0 comments
Closed

Wrong size of remote backup reported if upload was resumed #526

mmolinac opened this issue Oct 3, 2022 · 0 comments
Assignees
Milestone

Comments

@mmolinac
Copy link

mmolinac commented Oct 3, 2022

I uploaded a full backup to a remote location (GCS). Size is about 2.5 TB.
I use the --resumable option to be able to retry if a communication error or other kind arises.
That was the case, and after four attempts, it succeeded.
However, the reported size of the remote backup is wrong:

# /usr/bin/clickhouse-backup --config /etc/clickhouse-backup/config.gcs.yml list remote | tail -1
reporting-shard_01-full-20221002-0312   2.60GiB    03/10/2022 16:23:21   remote             gzip, regular

However, we can clearly see that this is not the case:

$ gsutil du -hc gs://mybucket/reporting_shard_01/reporting-shard_01-full-20221002-0312 | tail -2
2.49 TiB     gs://mybucket/reporting_shard_01/reporting-shard_01-full-20221002-0312/
2.49 TiB     total

Product version is:

# clickhouse-backup --version
Version:	 2.0.0
Git Commit:	 93f6c2f168b63db4ab7c8cd51fcc317884752b84
Build Date:	 2022-09-04

I understand that maybe the last uploaded piece of data is being computed for the total size, instead of the whole sum.

@Slach Slach self-assigned this Oct 20, 2022
@Slach Slach added this to the 2.2.0 milestone Oct 20, 2022
@Slach Slach closed this as completed in a9adf95 Jan 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants