Support Docker containers in the spark client

[pschorf]

No description provided.

[PerilousApricot]

Is it possible that the (undocumented) option spark.executor.cook.container [1] could be used to emulate "native" docker support?

https://github.com/twosigma/spark/blob/a72488df9e89d2570a0dbbb80767b398a87e1d8d/resource-managers/cook/src/main/scala/org/apache/spark/scheduler/cluster/cook/CookSchedulerContext.scala#L47

[PerilousApricot]

Okay, I started work on this, my goal is to wire the existing mesos/docker config options into Cook as opposed to making cook-specific keys for the ame functinality. Is that acceptable?

[pschorf]

Sounds good to me.