Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backing up Docker Desktop Volume via Windows network share runs forever #1174

Open
douglasparker opened this issue Jul 8, 2024 · 3 comments
Labels
C-question Category: Further information is requested

Comments

@douglasparker
Copy link

Backing up a Docker Desktop Volume (Windows Share) results in the backup going on forever and not working as expected.

Backup Directory: \\wsl.localhost\docker-desktop-data\data\docker\volumes
Output:

[00:56:29] backing up...                  ████████████████████████████████████████ 458.17 GiB/62.55 GiB  127.48 MiB/s (ETA -)

Rclone had this same problem, but disabling preallocation of disk space fixed it. This will not fix rustic however, even when using the rclone backend with the environmental variable set.

@github-actions github-actions bot added the S-triage Status: Waiting for a maintainer to triage this issue/PR label Jul 8, 2024
@aawsome
Copy link
Member

aawsome commented Aug 11, 2024

@douglasparker Can you please give more information? What backend are you using? Can you give the full output of the backup command, maybe using higher --log-level?

What was the rclone issue and why do you thing this disabling of preallocation fixed it? Note that rustic doesn't do any kind of such preallocation...

@aawsome aawsome added C-question Category: Further information is requested and removed S-triage Status: Waiting for a maintainer to triage this issue/PR labels Aug 11, 2024
@douglasparker
Copy link
Author

@douglasparker Can you please give more information? What backend are you using? Can you give the full output of the backup command, maybe using higher --log-level?

I was using the rclone backend with S3 compatible storage.

I couldn't test with opendal because of #1162

Unfortunately, I did not like some of the tradeoffs with Docker Desktop so I no longer have any of that enabled for my workstation so I cannot get better logging for you.

What was the rclone issue and why do you thing this disabling of preallocation fixed it? Note that rustic doesn't do any kind of such preallocation...

I believe the maintainer of rclone thinks that the WSL driver is implementing preallocations wrong. See his reply here: https://forum.rclone.org/t/rclone-copy-fails-to-wsl2-dos-copy-works/38351/4

I have no idea if these issues are related- I just know I had a similar with rclone. Copy and sync went on forever and similarly had the progress in GB being way higher than the total transfer size. Also, files were corrupted with rclone for the destination. Disabling preallocations in rclone fixed that issue for me.

@aawsome
Copy link
Member

aawsome commented Aug 11, 2024

As this cannot be reproduced I can only give some hints about how to get more information:

  • Use rustic --log-level=debug or --log-level=trace to get more information from rustic.
  • Set RCLONE_VERBOSE=2 or RCLONE_VERBOSE=3 to get more output from rclone. Note that rustic also outputs such rclone output.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-question Category: Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants