Using Ray Streaming Execution on the RayTaskRunner

[joreeves]

Ray Data uses what they call streaming execution, is it possible to leverage this type of execution when running with a RayTaskRunner? Looking under the hood of the RayTaskRunner, it looks like it's taking each task and create a @ray.remote call. The ray.data mapping seems to be more efficient with processing however.

More info here ray-data-internals