Skip to content

Commit

Permalink
Removed intentionally undocumented properties.
Browse files Browse the repository at this point in the history
  • Loading branch information
tsudukim committed Dec 2, 2014
1 parent 88cac9b commit 21cf624
Showing 1 changed file with 0 additions and 21 deletions.
21 changes: 0 additions & 21 deletions docs/running-on-yarn.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,34 +42,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes
Set to true to preserve the staged files (Spark jar, app jar, distributed cache files) at the end of the job rather than delete them.
</td>
</tr>
<tr>
<td><code>spark.yarn.user.classpath.first</code></td>
<td>false</td>
<td>
Set to true to make the users app.jar in first order. It is normally last in case conflicts with spark jars.
</td>
</tr>
<tr>
<td><code>spark.yarn.scheduler.heartbeat.interval-ms</code></td>
<td>5000</td>
<td>
The interval in ms in which the Spark application master heartbeats into the YARN ResourceManager.
</td>
</tr>
<tr>
<td><code>spark.yarn.scheduler.reporterThread.maxFailures</code></td>
<td>5</td>
<td>
The number of failures in a row until the Spark application master gives up heartbeating into the YARN ResourceManager.
</td>
</tr>
<tr>
<td><code>spark.yarn.report.interval</code></td>
<td>1000</td>
<td>
The interval in ms in which the YARN client monitors the application status after submits it to the YARN ResourceManager.
</td>
</tr>
<tr>
<td><code>spark.yarn.max.executor.failures</code></td>
<td>numExecutors * 2, with minimum of 3</td>
Expand Down

0 comments on commit 21cf624

Please sign in to comment.