Simultaneous replication and restoration & Rclone support

[irsyadpage]

I plan to do periodic checkup (e.g. every hour or minute) on external server to ensure the backup is working correctly and do some processing. So the process is similar to the @wobbet suggestion on #311:

Writer => Litestream=> Storage => Litestream=> Reader (external server)

Would it be bad or prone to data corruption if the Litestream replication and restoration occur at the S3 simultaneously? I don't mind if the restoration does not get the latest data immediately as eventually it will.

What happen if replication and restoration occur simultaneously on local file? Is there any consequence?

Lastly, is there any ways to combine Litestream with Rclone? As example: Litestream replicates on local file and then Rclone will upload it to somewhere else. Or is it Litestream require direct access to the storage system to ensure safe and reliable data replication?

[benbjohnson]

Would it be bad or prone to data corruption if the Litestream replication and restoration occur at the S3 simultaneously?

It shouldn't be a problem to restore while active replication is occuring.

What happen if replication and restoration occur simultaneously on local file? Is there any consequence?

You should restore to a separate file from the one you're replicating from. litestream restore will even show an error if the file already exists.

Lastly, is there any ways to combine Litestream with Rclone?

Not that I can think of. Litestream needs to maintain incremental changes and it'll reap old files so it needs direct access to the storage system.

[irsyadpage]

You should restore to a separate file from the one you're replicating from. litestream restore will even show an error if the file already exists.

So if replication and restoration occur simultaneously on local file (the restoration is to a separate file), there should be no problem right?