Manage log.dir in the EmbeddedKafkaBroker

[garyrussell]

Resolves #194

Create the temporary directory in EKB instead of the broker to avoid
NoSuchFileExceptions during shutdown.

cherry-pick to 2.4.x, 2.3.x, 2.2.x

[artembilan]

Gary, any ideas about Travis failure:

KafkaAdminTests > alreadyExists() FAILED

    java.lang.IllegalStateException at DefaultCacheAwareContextLoaderDelegate.java:132

        Caused by: org.springframework.beans.factory.BeanCreationException at AbstractAutowireCapableBeanFactory.java:1796

            Caused by: kafka.common.InconsistentBrokerIdException at KafkaServer.scala:767

KafkaAdminTests > testTopicConfigs() FAILED

    java.lang.IllegalStateException at DefaultCacheAwareContextLoaderDelegate.java:132

        Caused by: org.springframework.beans.factory.BeanCreationException at AbstractAutowireCapableBeanFactory.java:1796

            Caused by: kafka.common.InconsistentBrokerIdException at KafkaServer.scala:767

KafkaAdminTests > toggleBootstraps() FAILED

    java.lang.IllegalStateException at DefaultCacheAwareContextLoaderDelegate.java:132

        Caused by: org.springframework.beans.factory.BeanCreationException at AbstractAutowireCapableBeanFactory.java:1796

            Caused by: kafka.common.InconsistentBrokerIdException at KafkaServer.scala:767

KafkaAdminTests > testAddTopicsAndAddPartitions() FAILED

    java.lang.IllegalStateException at DefaultCacheAwareContextLoaderDelegate.java:132

        Caused by: org.springframework.beans.factory.BeanCreationException at AbstractAutowireCapableBeanFactory.java:1796

            Caused by: kafka.common.InconsistentBrokerIdException at KafkaServer.scala:767

?

[garyrussell]

No; but I realize there is a problem with this if there are multiple broker instances.

[artembilan]

but I realize there is a problem with this if there are multiple broker instances.

I think you mean that every broker instance we start with Embedded Kafka has to have its own unique logDir?

[garyrussell]

Exactly, yes; and it is the cause of this problem because this test uses 3 brokers.

[garyrussell]

Force-pushed and travis is green.

[artembilan]

Cherry-picked to 2.4.x & 2.3.x.
Back-ported to 2.2.x as a21fdeb after fixing conflicts.