Skip to content

Commit

Permalink
SPARK-1689: Spark application should die when removed by Master
Browse files Browse the repository at this point in the history
scheduler.error() will mask the error if there are active tasks. Being removed is a cataclysmic event for Spark applications, and should probably be treated as such.

Author: Aaron Davidson <aaron@databricks.com>

Closes apache#832 from aarondav/i-love-u and squashes the following commits:

9f1200f [Aaron Davidson] SPARK-1689: Spark application should die when removed by Master
  • Loading branch information
aarondav authored and pdeyhim committed Jun 25, 2014
1 parent e712265 commit ad2dcf3
Showing 1 changed file with 2 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,8 @@ private[spark] class SparkDeploySchedulerBackend(
if (!stopping) {
logError("Application has been killed. Reason: " + reason)
scheduler.error(reason)
// Ensure the application terminates, as we can no longer run jobs.
sc.stop()
}
}

Expand Down

0 comments on commit ad2dcf3

Please sign in to comment.