You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Hadoop Distributed File System (HDFS) is supported by the HadoopFileSystem type using HTTP requests. However, the file system also offers operations which return an open stream to the file allocated on the file system, which is not supported by the build-in HTTP handlers.
To simulate the open stream in the HTTP environment, add a custom Stream type named HadoopStream, which utilizes the already available file system operation types to perform read/write queries on the remote files. The type should hide all limitations of Hadoop, and should support standard exceptions.
The text was updated successfully, but these errors were encountered:
The Hadoop Distributed File System (HDFS) is supported by the
HadoopFileSystem
type using HTTP requests. However, the file system also offers operations which return an open stream to the file allocated on the file system, which is not supported by the build-in HTTP handlers.To simulate the open stream in the HTTP environment, add a custom
Stream
type namedHadoopStream
, which utilizes the already available file system operation types to perform read/write queries on the remote files. The type should hide all limitations of Hadoop, and should support standard exceptions.The text was updated successfully, but these errors were encountered: