Run CI tests on multiple Docker versions

[bfirsh]

Our CI tests should run on several recent versions of Docker. The best way to do that would probably be to use Docker's Jenkins instance, managed by @jfrazelle I think.

[jessfraz]

I have ideas!!! I was telling @aanand lol but I might just try something out with a Dockerfile and multiple ADD lines pulling the binaries from get.docker.com, then running some scripts or something

[thaJeztah]

Wouldn't the storage of those versions interfere with each other? Or is a full cleanup needed between starting each version?

Liking the creativity :)

[jessfraz]

well if you run the daemon in a container much like the integration-cli tests in docker you cna have setup and tear down and all that mumbo jumbo :D

[thaJeztah]

mumbo jumbo. My favorite!

[bfirsh]

@jfrazelle If we test on the same infrastructure as the engine do we get testing on Windows and OS X for free? :D

[jessfraz]

not osx and windows is still experimentally testing

[dnephin]

PRs #858, #958, #848 are all blocked on being able to run tests against a newer docker than the one available from wercker.

[aanand]

Update: see #1005, which uses Docker-in-Docker to test against multiple versions.

[bfirsh]

Put this back on the backlog because with #1066 we may only need to test against Docker 1.6. :)

[aanand]

Closed by #1005.