Skip to content
This repository has been archived by the owner on Jan 9, 2020. It is now read-only.

Explicitly disable "waiting for app completion" behavior for the integration tests #84

Conversation

lins05
Copy link

@lins05 lins05 commented Feb 3, 2017

What changes were proposed in this pull request?

In this PR the we explicitly disable "waiting for app completion" behavior for the integration tests.

The spark example job in the integration tests is patched to never get finished, so the test code could have enough time to inspect the running job status. But in #53 we changed the default submit behavior to be blocking waiting for the app to finish. This leads to the integration tests getting stuck infinitely.

How was this patch tested?

Running the integration tests.

Since the example job are patched to never finish.
@lins05 lins05 changed the title Do not wait for pod finishing in integration tests. Explicitly disable "waiting for app completion" behavior for the integration tests Feb 3, 2017
Copy link

@ash211 ash211 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops yes, this blocking submit does have this unintended side effect.

@mccheah is this the way you'd fix this interaction?

@mccheah
Copy link

mccheah commented Feb 3, 2017

Yep - the alternative is to run SparkSubmit on a separate thread and to check the conditions on the main thread, but this is a better alternative to multi-threading tests.

@ash211
Copy link

ash211 commented Feb 3, 2017

Great, merging then!

@ash211 ash211 merged commit a175f7a into apache-spark-on-k8s:k8s-support-alternate-incremental Feb 3, 2017
@ash211
Copy link

ash211 commented Feb 3, 2017

Thanks @lins05 for the fix!

ash211 pushed a commit that referenced this pull request Feb 8, 2017
Since the example job are patched to never finish.
ash211 pushed a commit that referenced this pull request Mar 8, 2017
Since the example job are patched to never finish.
@lins05 lins05 deleted the fix-integration-tests branch May 1, 2017 03:41
foxish pushed a commit that referenced this pull request Jul 24, 2017
Since the example job are patched to never finish.
ifilonenko pushed a commit to ifilonenko/spark that referenced this pull request Feb 25, 2019
puneetloya pushed a commit to puneetloya/spark that referenced this pull request Mar 11, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants