Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

questioning about : HTTP storage backend #1171

Closed
Lambourl opened this issue May 6, 2022 · 9 comments · Fixed by #1597
Closed

questioning about : HTTP storage backend #1171

Lambourl opened this issue May 6, 2022 · 9 comments · Fixed by #1597

Comments

@Lambourl
Copy link

Lambourl commented May 6, 2022

Hello everyone,

I have a question, I can't find the information.
Is it possible with sccache to have an HTTP storage backend?
I know that in ccache it is possible (see: https://ccache.dev/manual/4.6.html#_http_storage_backend ).
And if it is possible, could you explain it to me or add it to the documentation.
And if it is possible, would it also work with an HTTPS storage backend?

If none of this is possible, you can of course close my issue.

Thank you in advance for your help

@nmattia
Copy link

nmattia commented Oct 18, 2022

edit: just looked at the implementation and the http s3 interface looks very straightforward

Hi,

Any update on this? I'd be quite interested in an http storage backend.

@dtretyakov
Copy link
Contributor

It will be great to support an HTTP backend with ability to configure HTTP request authentication.

And It looks like it could be implemented on top of opendal library (#1483).

@Xuanwo maybe it could be the next storage implemented on top of it?

@Xuanwo
Copy link
Collaborator

Xuanwo commented Jan 27, 2023

The HTTP Storage Backend mentioned here is WebDAV. OpenDAL will implement WebDAV support in apache/opendal#370 ❤️

@dtretyakov
Copy link
Contributor

dtretyakov commented Jan 27, 2023

@Xuanwo could not existing "http" service in opendal cover these needs? Or works differently with HTTP request paths/methods?

https://opendal.databend.rs/opendal/services/http/index.html

@Xuanwo
Copy link
Collaborator

Xuanwo commented Jan 27, 2023

could not existing "http" service in opendal cover these needs? Or works differently with HTTP request paths/methods?

No. http backend is a read-only service that works on any HTTP server. To make sccache work, we should support PUT, DELETE and other methods that supported by WebDAV protocol.

@Xuanwo
Copy link
Collaborator

Xuanwo commented Jan 27, 2023

https://opendal.databend.rs/opendal/services/http/index.html

And sorry for the misleading comments of HTTP backend, I will fix them in apache/opendal#1238

@Xuanwo
Copy link
Collaborator

Xuanwo commented Jan 30, 2023

Good news here, OpenDAL has implemented webdav support: https://docs.rs/opendal/0.25.2/opendal/services/webdav/index.html

We can start implement webdav(aka, HTTP) support now.

@Xuanwo
Copy link
Collaborator

Xuanwo commented Feb 12, 2023

cc @Lambourl @dtretyakov @nmattia, #1597 will add this feature, would you like to try it and give us feedback?

@nmattia
Copy link

nmattia commented Feb 13, 2023

@Xuanwo thanks for the ping! I won't be able to test this any time soon unfortunately

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants