Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hadoop file streaming #16

Open
robertogiachetta opened this issue Feb 11, 2017 · 0 comments
Open

Hadoop file streaming #16

robertogiachetta opened this issue Feb 11, 2017 · 0 comments
Labels
Kind: Feature New feature or request Target: Storage Issues related to the Storage module of AEGIS

Comments

@robertogiachetta
Copy link
Collaborator

The Hadoop Distributed File System (HDFS) is supported by the HadoopFileSystem type using HTTP requests. However, the file system also offers operations which return an open stream to the file allocated on the file system, which is not supported by the build-in HTTP handlers.

To simulate the open stream in the HTTP environment, add a custom Stream type named HadoopStream, which utilizes the already available file system operation types to perform read/write queries on the remote files. The type should hide all limitations of Hadoop, and should support standard exceptions.

@robertogiachetta robertogiachetta added Kind: Feature New feature or request Target: Storage Issues related to the Storage module of AEGIS labels Feb 11, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Kind: Feature New feature or request Target: Storage Issues related to the Storage module of AEGIS
Projects
None yet
Development

No branches or pull requests

1 participant