-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SSE-C support in S3 via External Storage #33283
Comments
a workaround is to use s3fs which does support sse_C. Lets not take time away from these developers with feature requests when their product is barely functional as is. |
fuse implementations of S3 are inherently lacking in many ways. geesefs is a gigantic improvement but fails to work with Wasabi as required in my environment. Beyond all that, even under cgroupsv2, my environment's security requirements do not support this option. Implementing the required headers for this feature seems like a reasonable request, and one that I would be happy to place a bounty on once when/if this issue is accepted/triaged. |
Just to comment on using s3fs for this: this solution isn't ideal, and possibly very detrimental depending on the terms of your S3 provider. I've noticed that when I upload a file through Nextcloud it seems to make 3 different operations on the file system. My provider has a minimum time of storage, and because of that, a file upload occupies the used space equal to the file size and deleted space equal to 2*file size, which is somewhat unsustainable with such a service. What I think is happening is that when you upload a file, it stores the upload chunks on the primary drive, and then rebuilds the full file onto the s3fs, and then renames the file, and maybe does something with permissions? In any case, from my S3 provider, it looks like I've copied the file 3 times and deleted it twice, and I'm guessing for some users that's going to be a serious problem. |
This is supported now, yeah? Maybe this issue can be closed? |
No, it's supported for Primary Storage, not External Storage at the moment. |
Is your feature request related to a problem? Please describe.
SSE-C will soon be supported in primary storage.
It would be really great to be able to use this feature with external storage's implementation of S3 as well.
Describe the solution you'd like
I would like to be able to mount an S3 bucket with this option enabled in the standard settings as with any other S3 external storage configuration. Providing the option in the GUI is ideal, but not necessary for my use case--though I'm not sure if there's a way to add external mounts through nextcloud configuration files at this time.
Describe alternatives you've considered
I wrestled with various fuse implementations such as s3fs and geesefs which provide the SSE-C feature, and mounting as a local volume in external storage, but this proved a permissions nightmare and unstable in my container environment.
Additional context
None
The text was updated successfully, but these errors were encountered: