Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Issues with OneDrive #37

Closed
akumiszcza opened this issue Nov 10, 2022 · 11 comments
Closed

Issues with OneDrive #37

akumiszcza opened this issue Nov 10, 2022 · 11 comments

Comments

@akumiszcza
Copy link

Hi.
I'm having problems archiving anything from OneDrive. The only way around it is to copy it to another directory and then archive it. The same problem was with original zpaq.

C:\Users\akumi
λ dir %OneDrive%\test
 Volume in drive C has no label.
 Volume Serial Number is 1AEE-DAA3

 Directory of C:\Users\akumi\OneDrive\test

2022-11-10  14:37    <DIR>          .
2022-11-10  14:37    <DIR>          ..
2022-10-10  02:10             7 690 _R9A8517.xmp
2022-01-07  11:14        45 299 798 _R9A8518.CR3
               2 File(s)     45 307 488 bytes
               2 Dir(s)  1 450 850 488 320 bytes free

C:\Users\akumi
λ xcopy %OneDrive%\test z:
C:\Users\akumi\OneDrive\test\_R9A8517.xmp
C:\Users\akumi\OneDrive\test\_R9A8518.CR3
2 File(s) copied

C:\Users\akumi
λ zpaqfranzhw.exe a z:\test.zpaq %OneDrive%\test
zpaqfranz v55.15q-experimental-JIT-L (HW BLAKE3,SHA1), SFX64 v55.1, (Sep 19 2022)

QUIT: total size,file/folder count == zero. Already archived/wrong/inaccessible source?

0.016 seconds (00:00:00)  (with warnings)

C:\Users\akumi
λ zpaqfranzhw.exe a z:\test.zpaq "%OneDrive%\test"
zpaqfranz v55.15q-experimental-JIT-L (HW BLAKE3,SHA1), SFX64 v55.1, (Sep 19 2022)

QUIT: total size,file/folder count == zero. Already archived/wrong/inaccessible source?

0.016 seconds (00:00:00)  (with warnings)

Same thing happens if I access OneDrive directly (c:\Users\akumi\OneDrive).
@fcorbelli
Copy link
Owner

fcorbelli commented Nov 10, 2022 •
edited
Loading

Thank you
I do not have OneDrive at all (first thing I uninstall)

  • Can you please post the result of a -debug run?
  • Do you have some kind of application running on this folder (aka: onedrive client)?
  • Please try a -touch run

I suspect that "something" is interfering

@akumiszcza
Copy link
Author

  • -debug run:
C:\Users\akumi
λ zpaqfranzhw.exe a z:\test.zpaq "%OneDrive%\test" -debug
zpaqfranz v55.15q-experimental-JIT-L (HW BLAKE3,SHA1), SFX64 v55.1, (Sep 19 2022)
franz:DEBUG very verbose (-debug)
21026: check_if_password of z:/test.zpaq
FATTR 00000430 RES0 9000E01A C:/Users/akumi/OneDrive/test
ARCHIVE;DIRECTORY;REPARSE_POINT;
30908: discard REPARSE POINT & DIRECTORY
Default sort

QUIT: total size,file/folder count == zero. Already archived/wrong/inaccessible source?

0.032 seconds (00:00:00)  (with warnings)
33033: call xcommand on errorcode==1
Entering xcommand()
i_command   ||
i_parameter ||
Exit because empty i_command
  • OneDrive client is running, of course. One thing to add, I use Total Commander with a plugin for zpaq and it works fine there. Maybe it accesses the folder using other method (passes file list?).
  • -touch run:
C:\Users\akumi
λ zpaqfranzhw.exe a z:\test.zpaq "%OneDrive%\test" -touch
zpaqfranz v55.15q-experimental-JIT-L (HW BLAKE3,SHA1), SFX64 v55.1, (Sep 19 2022)
franz:-touch

QUIT: total size,file/folder count == zero. Already archived/wrong/inaccessible source?

0.015 seconds (00:00:00)  (with warnings)

C:\Users\akumi
λ zpaqfranzhw.exe a z:\test.zpaq "%OneDrive%\test" -touch -debug
zpaqfranz v55.15q-experimental-JIT-L (HW BLAKE3,SHA1), SFX64 v55.1, (Sep 19 2022)
franz:-touch DEBUG very verbose (-debug)
21026: check_if_password of z:/test.zpaq
FATTR 00000430 RES0 9000E01A C:/Users/akumi/OneDrive/test
ARCHIVE;DIRECTORY;REPARSE_POINT;
30908: discard REPARSE POINT & DIRECTORY
Default sort

QUIT: total size,file/folder count == zero. Already archived/wrong/inaccessible source?

0.016 seconds (00:00:00)  (with warnings)
33033: call xcommand on errorcode==1
Entering xcommand()
i_command   ||
i_parameter ||
Exit because empty i_command

@fcorbelli
Copy link
Owner

fcorbelli commented Nov 10, 2022 •
edited
Loading

Here it is

30908: discard REPARSE POINT & DIRECTORY

The test folder is not a "folder", but a junction or (maybe) a reparse point

@fcorbelli
Copy link
Owner

Please try the attached pre-release (with -debug)
56_1i.zip

@akumiszcza
Copy link
Author

It's a folder I created manually (just before making this post), but maybe OneDrive changes it to junction.
I think it works with the pre-release :) 🥇

λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test" -debug                                            
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)                                     
franz:DEBUG very verbose (-debug)                                                                  
21026: check_if_password of z:/test.zpaq                                                           
FATTR 00000430 RES0 9000E01A C:/Users/akumi/OneDrive/test                                          
ARCHIVE;DIRECTORY;REPARSE_POINT;                                                                   
31184: this seems a ONEDRIVE-something, try to keep                                                
FATTR 00000430 RES0 9000E01A C:/Users/akumi/OneDrive/test/.                                        
ARCHIVE;DIRECTORY;REPARSE_POINT;                                                                   
31184: this seems a ONEDRIVE-something, try to keep                                                
FATTR 00000431 RES0 9000701A C:/Users/akumi/OneDrive/test/..                                       
ARCHIVE;DIRECTORY;READONY;REPARSE_POINT;                                                           
31184: this seems a ONEDRIVE-something, try to keep                                                
FATTR 00000420 RES0 9000601A C:/Users/akumi/OneDrive/test/_R9A8517.xmp                             
ARCHIVE;REPARSE_POINT;                                                                             
Verbose: found something strange (VHDX?) _R9A8517.xmp                                              
FATTR 00000420 RES0 9000601A C:/Users/akumi/OneDrive/test/_R9A8518.CR3                             
ARCHIVE;REPARSE_POINT;                                                                             
Verbose: found something strange (VHDX?) _R9A8518.CR3                                              
Default sort                                                                                       
k3                                                                                                 
000  first C:/Users/akumi/OneDrive/test/                                                           
000  date  20.221.110.133.748                                                                      
000  size  0                                                                                       
000  attr  274.551                                                                                 
000  data  0                                                                                       
000  writ  -1                                                                                      
000  ptrsi 0                                                                                       
000  dtv   0                                                                                       
001  first C:/Users/akumi/OneDrive/test/_R9A8517.xmp                                               
001  date  20.221.010.011.013                                                                      
001  size  7.690                                                                                   
001  attr  270.455                                                                                 
001  data  8.677.715.202.331.901.951                                                               
001  writ  -1                                                                                      
001  ptrsi 0                                                                                       
001  dtv   0                                                                                       
002  first C:/Users/akumi/OneDrive/test/_R9A8518.CR3                                               
002  date  20.220.107.101.451                                                                      
002  size  45.299.798                                                                              
002  attr  270.455                                                                                 
002  data  7.165.846.032.209.671.475                                                               
002  writ  -1                                                                                      
002  ptrsi 0                                                                                       
002  dtv   0                                                                                       
Creating z:/test.zpaq at offset 0 + 0                                                              
Adding 45.307.488 (43.21 MB) in 2 files (1 dirs), 24 threads                                       
20006: converting to localtime 2022-11-10 16:36:56                                                 
20028: localtime is 2022-11-10 17:36:56                                                            
@ 2022-11-10 17:36:56                                                                              
Real write                                                                                         
39481: g_cdatasize  0                                                                              
39482: g_htsize     0                                                                              
39431 writeJidacheader -1                                                                          
39864: out.tell   45.313.346                                                                       
39865: header_end 104                                                                              
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/                                    
Mode2: XXHASH64: <<EF46DB3751D8E999>> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/             
Model2: XXHASH64 E833A862501BB935 C:/Users/akumi/OneDrive/test/_R9A8517.xmp                        
Mode2: XXHASH64: <<E833A862501BB935>> CRC32 <<1521A3A8>> C:/Users/akumi/OneDrive/test/_R9A8517.xmp 
Model2: XXHASH64 0A445CF7549508FC C:/Users/akumi/OneDrive/test/_R9A8518.CR3                        
Mode2: XXHASH64: <<0A445CF7549508FC>> CRC32 <<4915C08E>> C:/Users/akumi/OneDrive/test/_R9A8518.CR3 
3 +added, 0 -removed.                                                                              
**** 40036 calculated **** 45.313.242 1                                                            
40045 writeJidacHeader 45.313.242 1                                                                
                                                                                                   
0 + (45.307.488 -> 45.307.488 -> 45.332.755) = 45.332.755 @ 46.06 MB/s                             
                                                                                                   
0.938 seconds (00:00:00) (all OK)                                                                  
33040: call xcommand with a different errorcode (not 1, not 2) 0                                   
33047: g_archive not null, setting g_exec_text to z:/test.zpaq

@fcorbelli
Copy link
Owner

So leave a star or a review on sourceforge :)

Short version: Microsoft's level of amateurism is incredible. They add functions at random, completely incompatible, just because they make completely useless programs work. There are an astonishing number of combinations of "weird" things in the file system.

Do your tests, as mentioned I don't have a OneDrive to test. Can I put you in the greetings of zpaqfranz?

@akumiszcza
Copy link
Author

I will :)
I use OneDrive all the time – it's useful when I have several computers with the same account and Microsoft 365 gives me 1TB for each family members. But it has its issues, I know. Especially the way it removes the file from drive and then re-downloads it if necessary (unless you explicitly set it otherwise folder-wise) makes it hard for some software.
I will test it, sure. I use paq and zpaq compressors for a long time (I browse encode.ru/su from time to time) and I'm glad the software is still developed. Sure you can put me in greetings :)
Thanks for your quick response! 👍

@akumiszcza
Copy link
Author

I've made some tests.
Here I put some photos in test dir, then archived it, then made the photos accessible only online (they were downloaded from the cloud while accessing them). I removed test.zpaq and archived again. Everything was fine. It took longer, of course. Then I archived everything again without any changes and as you can see it failed first time, and it was OK the next time. No changes between these runs. I've noticed it on other folders, too. Sometimes it just fails and running it again works fine. In rare occasions it's a single file, but most often it fails for all files.

C:\Users\akumi                                                                                                              
λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test"                                                                            
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)                                                              
Creating z:/test.zpaq at offset 0 + 0                                                                                       
Adding 1.180.514.888 (1.10 GB) in 15 files (1 dirs), 24 threads @ 2022-11-11 16:53:15                                       
16 +added, 0 -removed.                                                                                                      
                                                                                                                            
0 + (1.180.514.888 -> 1.180.390.859 -> 1.153.415.953) = 1.153.415.953 @ 59.30 MB/s                                          
                                                                                                                            
19.016 seconds (000:00:19) (all OK)                                                                                         
                                                                                                                            
C:\Users\akumi                                                                                                              
λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test"                                                                            
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)                                                              
Creating z:/test.zpaq at offset 0 + 0                                                                                       
Adding 1.180.514.888 (1.10 GB) in 15 files (1 dirs), 24 threads @ 2022-11-11 17:03:20                                       
16 +added, 0 -removed.                                                                                                      
                                                                                                                            
0 + (1.180.514.888 -> 1.180.390.859 -> 1.153.415.940) = 1.153.415.940 @ 17.87 MB/s                                          
                                                                                                                            
63.031 seconds (000:01:03) (all OK)                                                                                         
                                                                                                                            
C:\Users\akumi                                                                                                              
λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test"                                                                            
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)                                                              
z:/test.zpaq:                                                                                                               
1 versions, 16 files, 16.791 fragments, 82 blocks, 1.153.415.940 bytes (1.07 GB)                                            
Updating z:/test.zpaq at offset 1.153.415.940 + 0                                                                           
Adding 0 (0.00 B) in 0 files (1 dirs), 24 threads @ 2022-11-11 17:04:25                                                     
38383: ERROR expected          25.451.220 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG          
38383: ERROR expected          27.292.020 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG          
38383: ERROR expected          32.475.912 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG          
38383: ERROR expected          30.137.306 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG          
38383: ERROR expected          60.739.670 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3          
38383: ERROR expected          60.700.758 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3          
38383: ERROR expected          60.682.326 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3          
38383: ERROR expected          60.806.742 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3          
38383: ERROR expected          60.784.726 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3          
38383: ERROR expected          60.682.838 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3          
38383: ERROR expected         353.222.606 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif 
38383: ERROR expected         239.063.393 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng      
38383: ERROR expected          51.422.294 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3          
38383: ERROR expected          57.051.734 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3          
38383: ERROR expected               1.343 getted 0 bytes  C:/Users/akumi/OneDrive/test/test.sha256                          
15 +added, 0 -removed.                                                                                                      
                                                                                                                            
1.153.415.940 + (0 -> 0 -> 69.537) = 1.153.485.477 @ 0.00 B/s                                                               
                                                                                                                            
0.188 seconds (00:00:00) (all OK)                                                                                           
                                                                                                                            
C:\Users\akumi                                                                                                              
λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test"                                                                            
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)                                                              
z:/test.zpaq:                                                                                                               
2 versions, 31 files, 16.791 fragments, 87 blocks, 1.153.485.477 bytes (1.07 GB)                                            
Updating z:/test.zpaq at offset 1.153.485.477 + 0                                                                           
Adding 0 (0.00 B) in 0 files (1 dirs), 24 threads @ 2022-11-11 17:04:33                                                     
0 +added, 0 -removed.                                                                                                       
                                                                                                                            
1.153.485.477 + (0 -> 0 -> 0) = 1.153.485.477 @ 0.00 B/s                                                                    
                                                                                                                            
0.094 seconds (00:00:00) (all OK)

@akumiszcza
Copy link
Author

akumiszcza commented Nov 11, 2022 •
edited
Loading

Here is a failed run with -debug (this time it was shortly after I made the files accessible only offline – https://support.microsoft.com/en-us/office/save-disk-space-with-onedrive-files-on-demand-for-windows-0e6860d3-d9f3-4971-b321-7092438fb38e)

C:\Users\akumi
λ zpaqfranz.exe a z:\test.zpaq "%OneDrive%\test" -debug
zpaqfranz v56.1i-JIT-L (HW BLAKE3), SFX64 v55.1, (10 Nov 2022)
franz:DEBUG very verbose (-debug)
21026: check_if_password of z:/test.zpaq
z:/test.zpaq:
1 versions, 16 files, 16.791 fragments, 82 blocks, 1.153.415.948 bytes (1.07 GB)
FATTR 00100430 RES0 9000E01A C:/Users/akumi/OneDrive/test
ARCHIVE;DIRECTORY;REPARSE_POINT;
31184: this seems a ONEDRIVE-something, try to keep
FATTR 00100430 RES0 9000E01A C:/Users/akumi/OneDrive/test/.
ARCHIVE;DIRECTORY;REPARSE_POINT;
31184: this seems a ONEDRIVE-something, try to keep
FATTR 00000431 RES0 9000701A C:/Users/akumi/OneDrive/test/..
ARCHIVE;DIRECTORY;READONY;REPARSE_POINT;
31184: this seems a ONEDRIVE-something, try to keep
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T065344IMG_6933.DNG
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T065348IMG_6934.DNG
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T065448IMG_6935.DNG
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T065458IMG_6936.DNG
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181650_R9A9952.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181650_R9A9953.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181650_R9A9954.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181651_R9A9955.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181651_R9A9956.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181651_R9A9957.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181738_R9A9958-HDR-Edit.tif
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181738_R9A9958-HDR.dng
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181738_R9A9958.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) 20221101T181738_R9A9959.CR3
FATTR 00501620 RES0 9000401A C:/Users/akumi/OneDrive/test/test.sha256
ARCHIVE;OFFLINE;RECALL_ON_DATA_ACCESS;REPARSE_POINT;SPARSE_FILE;
Verbose: found something strange (VHDX?) test.sha256
Default sort
k3
000  first C:/Users/akumi/OneDrive/test/
000  date  20.221.111.155.254
000  size  0
000  attr  268.710.007
000  data  0
000  writ  -1
000  ptrsi 0
000  dtv   0
001  first C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG
001  date  20.221.102.130.308
001  size  25.451.220
001  attr  1.343.627.383
001  data  0
001  writ  -1
001  ptrsi 0
001  dtv   0
002  first C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG
002  date  20.221.102.130.308
002  size  27.292.020
002  attr  1.343.627.383
002  data  0
002  writ  -1
002  ptrsi 0
002  dtv   0
003  first C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG
003  date  20.221.102.130.309
003  size  32.475.912
003  attr  1.343.627.383
003  data  0
003  writ  -1
003  ptrsi 0
003  dtv   0
004  first C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG
004  date  20.221.102.130.309
004  size  30.137.306
004  attr  1.343.627.383
004  data  0
004  writ  -1
004  ptrsi 0
004  dtv   0
005  first C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3
005  date  20.221.101.171.651
005  size  60.739.670
005  attr  1.343.627.383
005  data  0
005  writ  -1
005  ptrsi 0
005  dtv   0
006  first C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3
006  date  20.221.101.171.651
006  size  60.700.758
006  attr  1.343.627.383
006  data  0
006  writ  -1
006  ptrsi 0
006  dtv   0
007  first C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3
007  date  20.221.101.171.652
007  size  60.682.326
007  attr  1.343.627.383
007  data  0
007  writ  -1
007  ptrsi 0
007  dtv   0
008  first C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3
008  date  20.221.101.171.652
008  size  60.806.742
008  attr  1.343.627.383
008  data  0
008  writ  -1
008  ptrsi 0
008  dtv   0
009  first C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3
009  date  20.221.101.171.652
009  size  60.784.726
009  attr  1.343.627.383
009  data  0
009  writ  -1
009  ptrsi 0
009  dtv   0
010  first C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3
010  date  20.221.101.171.652
010  size  60.682.838
010  attr  1.343.627.383
010  data  0
010  writ  -1
010  ptrsi 0
010  dtv   0
011  first C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif
011  date  20.221.101.222.121
011  size  353.222.606
011  attr  1.343.627.383
011  data  0
011  writ  -1
011  ptrsi 0
011  dtv   0
012  first C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng
012  date  20.221.101.221.120
012  size  239.063.393
012  attr  1.343.627.383
012  data  0
012  writ  -1
012  ptrsi 0
012  dtv   0
013  first C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3
013  date  20.221.101.171.739
013  size  51.422.294
013  attr  1.343.627.383
013  data  0
013  writ  -1
013  ptrsi 0
013  dtv   0
014  first C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3
014  date  20.221.101.171.739
014  size  57.051.734
014  attr  1.343.627.383
014  data  0
014  writ  -1
014  ptrsi 0
014  dtv   0
015  first C:/Users/akumi/OneDrive/test/test.sha256
015  date  20.221.111.155.254
015  size  1.343
015  attr  1.343.627.383
015  data  0
015  writ  -1
015  ptrsi 0
015  dtv   0
Updating z:/test.zpaq at offset 1.153.415.948 + 0
Adding 0 (0.00 B) in 0 files (1 dirs), 24 threads
20006: converting to localtime 2022-11-11 16:20:24
20028: localtime is 2022-11-11 17:20:24
@ 2022-11-11 17:20:24
Real write
39481: g_cdatasize  0
39482: g_htsize     0
39431 writeJidacheader -1
39864: out.tell   1.153.416.052
39865: header_end 1.153.416.052
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG
38383: ERROR expected          25.451.220 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T065344IMG_6933.DNG
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG
38383: ERROR expected          27.292.020 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T065348IMG_6934.DNG
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG
38383: ERROR expected          32.475.912 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T065448IMG_6935.DNG
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG
38383: ERROR expected          30.137.306 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T065458IMG_6936.DNG
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3
38383: ERROR expected          60.739.670 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181650_R9A9952.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3
38383: ERROR expected          60.700.758 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181650_R9A9953.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3
38383: ERROR expected          60.682.326 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181650_R9A9954.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3
38383: ERROR expected          60.806.742 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181651_R9A9955.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3
38383: ERROR expected          60.784.726 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181651_R9A9956.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3
38383: ERROR expected          60.682.838 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181651_R9A9957.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif
38383: ERROR expected         353.222.606 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR-Edit.tif
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng
38383: ERROR expected         239.063.393 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958-HDR.dng
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3
38383: ERROR expected          51.422.294 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181738_R9A9958.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3
38383: ERROR expected          57.051.734 getted 0 bytes  C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/20221101T181738_R9A9959.CR3
Model2: XXHASH64 EF46DB3751D8E999 C:/Users/akumi/OneDrive/test/test.sha256
38383: ERROR expected               1.343 getted 0 bytes  C:/Users/akumi/OneDrive/test/test.sha256
Mode2: XXHASH64: <<!ERROR!         >> CRC32 <<00000000>> C:/Users/akumi/OneDrive/test/test.sha256
15 +added, 0 -removed.
**** 40036 calculated **** 0 16.792
40045 writeJidacHeader 0 16.792

1.153.415.948 + (0 -> 0 -> 69.530) = 1.153.485.478 @ 0.00 B/s

0.625 seconds (00:00:00) (all OK)
33040: call xcommand with a different errorcode (not 1, not 2) 0
33047: g_archive not null, setting g_exec_text to z:/test.zpaq

After more tests I think I can confirm that zpaqfranz fails after the state of files is changed from downloaded to online or back (which can happen automatically if OneDrive decides to free up some space). The second run is fine. For me personally it doesn't matter now that I know of this.

Here I found some info about this issue from Total Commander's author: https://www.ghisler.ch/board/viewtopic.php?t=48132

@fcorbelli
Copy link
Owner

I don't know exactly how OneDrive works
Microsoft documentation is sparse and difficult to understand
I don't think I will develop ad hoc support for OneDrive, until now you are the only user in the world with this request
Maybe it will become more common
The behavior is

  1. Make a list of the files do be archived (with filesize)
  2. Read-and-archive
  3. If the expected size is != readed size, shows a warning
  4. If the total expected size (total bytes to be archived) does not match total size readed, show a warning

Therefore if "something" change (ex. first show a file as existent, then delete it, or whatever) during the run, by OneDrive or a regular user, or via network etc, I cannot guarantee anything

zpaqfranz is made to run on zfs' snapshots, on FreeBSD

Maybe you can try a VSS backup of the OneDrive folder, I really do not know what will happens :)

@akumiszcza
Copy link
Author

As I wrote, for me personally current snapshot version (v56.1i-JIT-L) works fine, especially now that I know its limitations. Thank you again and I'm closing the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@akumiszcza @fcorbelli