Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only partial uploads .. #163

Closed
vamsiikrishna opened this issue Mar 10, 2021 · 5 comments
Closed

Only partial uploads .. #163

vamsiikrishna opened this issue Mar 10, 2021 · 5 comments
Milestone

Comments

@vamsiikrishna
Copy link

vamsiikrishna commented Mar 10, 2021

Hi !

I was trying clickhouse-backup ( latest alpa release ) and I am having some issues with S3 Upload.

Here are the steps I am following to perform the backup:

backup

BACKUP_NAME=my_backup_$(date -u +%Y-%m-%dT%H-%M-%S)
clickhouse-backup create $BACKUP_NAME
clickhouse-backup upload $BACKUP_NAME

while uploading , I am able to see the progress bar.

158.87 MiB / 5.94 GiB [===>-------------------------------------------------------------------------------------------- 
2.61% 3s

After it completes around 2.61 % , the program stops and prints

2021/03/10 11:24:40  info done                      backup=my_backup_2021-03-10T11-16-26 operation=upload

and in S3 only 158.87 MiB is uploaded.

EDIT :

CH Server Version: 21.1.2

@ElPeque
Copy link
Contributor

ElPeque commented Mar 16, 2021

Is it working at all?

It looks to me like with gzip compression it is only uploading metadata but no real data. With none compression it seems to be uploading data.

Maybe I should stick to the v0.6.4 branch but it would suck to leave behind table filtered download/upload/restore and the 'none' compression. What is the overall stability of the alpha? Thank you!

@AlexAkulov
Copy link
Collaborator

Fixed in 1.0.0-beta2

@mastertheknife
Copy link

This looks like the issue i am seeing, with version 1.0.0-beta2: #203

@AlexAkulov
Copy link
Collaborator

I have improved error handling on upload in aadce0b. Please try again with version from master.

@AlexAkulov AlexAkulov reopened this Jun 8, 2021
@AlexAkulov AlexAkulov added this to the 1.0.0 milestone Jun 13, 2021
@AlexAkulov
Copy link
Collaborator

Fixed v1.0.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants