[Streaming][Kafka] cleanup tests from SPARK-2808 #5921

koeninger · 2015-05-05T21:16:55Z

see if requiring producer acks eliminates the need for waitUntilLeaderOffset calls in tests

… for waitUntilLeaderOffset calls in tests

AmplabJenkins · 2015-05-05T21:17:10Z

Can one of the admins verify this patch?

tdas · 2015-05-05T21:18:39Z

This is ok to test

tdas · 2015-05-05T21:19:31Z

Ok to test

AmplabJenkins · 2015-05-05T21:22:10Z

Merged build triggered.

AmplabJenkins · 2015-05-05T21:22:20Z

Merged build started.

SparkQA · 2015-05-05T21:24:33Z

Test build #31904 has started for PR 5921 at commit 1274afb.

SparkQA · 2015-05-05T21:26:41Z

Test build #31904 has finished for PR 5921 at commit 1274afb.

This patch fails to build.
This patch merges cleanly.
This patch adds the following public classes (experimental):
- public class EnumUtil
- class BinaryClassificationEvaluator(JavaEvaluator, HasLabelCol, HasRawPredictionCol):
- class HasRawPredictionCol(Params):
- class Evaluator(object):
- class JavaEvaluator(Evaluator, JavaWrapper):

AmplabJenkins · 2015-05-05T21:26:42Z

Merged build finished. Test FAILed.

AmplabJenkins · 2015-05-05T21:26:42Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31904/
Test FAILed.

koeninger · 2015-05-05T21:31:30Z

Pretty sure this error

[error] oro#oro;2.0.8!oro.jar origin location must be absolute:

isn't related to the commit

AmplabJenkins · 2015-05-06T00:17:11Z

Merged build triggered.

AmplabJenkins · 2015-05-06T00:17:20Z

Merged build started.

SparkQA · 2015-05-06T00:18:59Z

Test build #31926 has started for PR 5921 at commit 4298ac2.

SparkQA · 2015-05-06T02:02:56Z

Test build #31926 has finished for PR 5921 at commit 4298ac2.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-05-06T02:03:01Z

Merged build finished. Test PASSed.

AmplabJenkins · 2015-05-06T02:03:01Z

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/31926/
Test PASSed.

koeninger · 2015-05-13T20:16:25Z

@tdas just pinging on this to make sure it doesn't get lost in the shuffle, lmk if there's more explanation needed.

tdas · 2015-05-18T23:47:16Z

I havent forgotten about this. I will pull it in.

koeninger · 2015-06-04T03:51:27Z

Another ping on this, even if it misses 1.4

Seeing waitUntilLeaderOffset all over the place in test code I'm working on right now made me sad :(

srowen · 2015-06-04T12:07:23Z

Just to double check: Jenkins, retest this please

srowen · 2015-06-04T12:10:23Z

Jenkins, retest this please

AmplabJenkins · 2015-06-04T12:12:12Z

Merged build triggered.

AmplabJenkins · 2015-06-04T12:12:21Z

Merged build started.

SparkQA · 2015-06-04T12:15:04Z

Test build #34183 has started for PR 5921 at commit 4298ac2.

SparkQA · 2015-06-04T12:27:44Z

Test build #34183 has finished for PR 5921 at commit 4298ac2.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-06-04T12:27:47Z

Merged build finished. Test FAILed.

koeninger · 2015-06-04T13:48:25Z

The only thing I can think of mima complaining about is that this patch is removing a method... even though it's a method in a private class that is only used for testing. Don't know why it didn't complain the first time around.

AmplabJenkins · 2015-06-04T13:57:13Z

Merged build triggered.

AmplabJenkins · 2015-06-04T13:57:22Z

Merged build started.

SparkQA · 2015-06-04T13:58:20Z

Test build #34186 has started for PR 5921 at commit af1e083.

…te test class

AmplabJenkins · 2015-06-04T14:02:13Z

Merged build triggered.

AmplabJenkins · 2015-06-04T14:02:22Z

Merged build started.

SparkQA · 2015-06-04T14:04:52Z

Test build #34187 has started for PR 5921 at commit 4662828.

SparkQA · 2015-06-04T14:13:32Z

Test build #34186 has finished for PR 5921 at commit af1e083.

This patch fails MiMa tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-06-04T14:13:36Z

Merged build finished. Test FAILed.

SparkQA · 2015-06-04T15:57:25Z

Test build #34187 has finished for PR 5921 at commit 4662828.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-06-04T15:57:31Z

Merged build finished. Test PASSed.

srowen · 2015-06-05T05:56:11Z

Looks like it's passing now but needs a rebase

AmplabJenkins · 2015-06-05T14:12:11Z

Merged build triggered.

AmplabJenkins · 2015-06-05T14:12:17Z

Merged build started.

SparkQA · 2015-06-05T14:14:37Z

Test build #34278 has started for PR 5921 at commit 1e89dc8.

SparkQA · 2015-06-05T17:09:38Z

Test build #34278 timed out for PR 5921 at commit 1e89dc8 after a configured wait of 175m.

AmplabJenkins · 2015-06-05T17:09:42Z

Merged build finished. Test FAILed.

koeninger · 2015-06-05T17:52:52Z

I sort of doubt that wait timeout was related to the merge, the only conflict was the single line of MimaExcludes

srowen · 2015-06-05T22:47:24Z

Jenkins, retest this please

AmplabJenkins · 2015-06-05T22:52:12Z

Merged build triggered.

AmplabJenkins · 2015-06-05T22:52:19Z

Merged build started.

SparkQA · 2015-06-05T22:52:43Z

Test build #34330 has started for PR 5921 at commit 1e89dc8.

SparkQA · 2015-06-06T00:39:48Z

Test build #34330 has finished for PR 5921 at commit 1e89dc8.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

AmplabJenkins · 2015-06-06T00:39:53Z

Merged build finished. Test PASSed.

srowen · 2015-06-06T08:38:20Z

@tdas are you OK with this change?

see if requiring producer acks eliminates the need for waitUntilLeaderOffset calls in tests Author: cody koeninger <cody@koeninger.org> Closes apache#5921 from koeninger/kafka-0.8.2-test-cleanup and squashes the following commits: 1e89dc8 [cody koeninger] Merge branch 'master' into kafka-0.8.2-test-cleanup 4662828 [cody koeninger] [Streaming][Kafka] filter mima issue for removal of method from private test class af1e083 [cody koeninger] Merge branch 'master' into kafka-0.8.2-test-cleanup 4298ac2 [cody koeninger] [Streaming][Kafka] update comment to trigger jenkins attempt 1274afb [cody koeninger] [Streaming][Kafka] see if requiring producer acks eliminates the need for waitUntilLeaderOffset calls in tests

[Streaming][Kafka] see if requiring producer acks eliminates the need…

1274afb

… for waitUntilLeaderOffset calls in tests

[Streaming][Kafka] update comment to trigger jenkins attempt

4298ac2

Merge branch 'master' into kafka-0.8.2-test-cleanup

af1e083

[Streaming][Kafka] filter mima issue for removal of method from priva…

4662828

…te test class

Merge branch 'master' into kafka-0.8.2-test-cleanup

1e89dc8

asfgit closed this in b127ff8 Jun 8, 2015

[Streaming][Kafka] cleanup tests from SPARK-2808 #5921

[Streaming][Kafka] cleanup tests from SPARK-2808 #5921

Conversation

koeninger commented May 5, 2015

AmplabJenkins commented May 5, 2015

tdas commented May 5, 2015

tdas commented May 5, 2015

AmplabJenkins commented May 5, 2015

AmplabJenkins commented May 5, 2015

SparkQA commented May 5, 2015

SparkQA commented May 5, 2015

AmplabJenkins commented May 5, 2015

AmplabJenkins commented May 5, 2015

koeninger commented May 5, 2015

AmplabJenkins commented May 6, 2015

AmplabJenkins commented May 6, 2015

SparkQA commented May 6, 2015

SparkQA commented May 6, 2015

AmplabJenkins commented May 6, 2015

AmplabJenkins commented May 6, 2015

koeninger commented May 13, 2015

tdas commented May 18, 2015

koeninger commented Jun 4, 2015

srowen commented Jun 4, 2015

srowen commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

SparkQA commented Jun 4, 2015

SparkQA commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

koeninger commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

SparkQA commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

SparkQA commented Jun 4, 2015

SparkQA commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

SparkQA commented Jun 4, 2015

AmplabJenkins commented Jun 4, 2015

srowen commented Jun 5, 2015

AmplabJenkins commented Jun 5, 2015

AmplabJenkins commented Jun 5, 2015

SparkQA commented Jun 5, 2015

SparkQA commented Jun 5, 2015

AmplabJenkins commented Jun 5, 2015

koeninger commented Jun 5, 2015

srowen commented Jun 5, 2015

AmplabJenkins commented Jun 5, 2015

AmplabJenkins commented Jun 5, 2015

SparkQA commented Jun 5, 2015

SparkQA commented Jun 6, 2015

AmplabJenkins commented Jun 6, 2015

srowen commented Jun 6, 2015