[SPARK-26324][DOCS] Add Spark docs for Running in Mesos with SSL #23342
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
-Added documentation for loading csv files into Dataframes
- Some examples on how to create a dataframe with a csv file (cherry picked from commit e8ca1dc)
-Added documentation for loading csv files into Dataframes
- Some examples on how to create a dataframe with a csv file (cherry picked from commit a546421)
# Conflicts: # docs/sql-programming-guide.md # examples/src/main/java/org/apache/spark/examples/sql/JavaSQLDataSourceExample.java # examples/src/main/r/RSparkSQLExample.R
- Some examples on how to create a dataframe with a csv file
- PR comments
- PR comments
- PR comments
* Added full docs for reading csv files
* Added full docs for reading csv files
- remove old json line from chapter
- update links
# Conflicts: # docs/sql-programming-guide.md
* added documentation for SSL with Mesos
felixcheung
reviewed
Dec 18, 2018
docs/running-on-mesos.md
Outdated
| @@ -108,6 +108,19 @@ Please note that if you specify multiple ways to obtain the credentials then the | |||
|
|
|||
| An equivalent order applies for the secret. Essentially we prefer the configuration to be specified directly rather than indirectly by files, and we prefer that configuration settings are used over environment variables. | |||
|
|
|||
| ### Deploy to a Mesos running on Secure Sockets | |||
|
|
|||
| If you want to deploy a Spark Application into a Mesos cluster that is running in a secure mode there are some environment's variables that need to be set. | |||
docs/running-on-mesos.md
Outdated
|
|
||
| all options can be found at http://mesos.apache.org/documentation/latest/ssl/ | ||
|
|
||
| Then submit as usual or as described below |
There was a problem hiding this comment.
perhaps say as described in Client mode or Cluster mode below
srowen
requested changes
Dec 18, 2018
docs/running-on-mesos.md
Outdated
| - `LIBPROCESS_SSL_KEY_FILE=pathToKeyFile.key` path to key | ||
| - `LIBPROCESS_SSL_CERT_FILE=pathToCRTFile.crt` the certificate file to be used | ||
|
|
||
| all options can be found at http://mesos.apache.org/documentation/latest/ssl/ |
* PR comments
|
@srowen @felixcheung pr updated |
srowen
approved these changes
Dec 19, 2018
|
It is merged to master. I missed running the tests so those are running now, but it's a doc change and shouldn't be a problem |
|
I saw it. I was just confused about the git symbol. Thx |
|
Test build #4482 has finished for PR 23342 at commit
|
|
That error can be ignored; this didn't cause functional changes in Python |
holdenk
pushed a commit
to holdenk/spark
that referenced
this pull request
Jan 5, 2019
## What changes were proposed in this pull request? Added docs for running spark jobs with Mesos on SSL Closes apache#23342 from jomach/master. Lead-authored-by: Jorge Machado <jorge.w.machado@hotmail.com> Co-authored-by: Jorge Machado <dxc.machado@extaccount.com> Co-authored-by: Jorge Machado <jorge.machado.ext@kiwigrid.com> Co-authored-by: Jorge Machado <JorgeWilson.Machado@ext.gfk.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
jackylee-ch
pushed a commit
to jackylee-ch/spark
that referenced
this pull request
Feb 18, 2019
## What changes were proposed in this pull request? Added docs for running spark jobs with Mesos on SSL Closes apache#23342 from jomach/master. Lead-authored-by: Jorge Machado <jorge.w.machado@hotmail.com> Co-authored-by: Jorge Machado <dxc.machado@extaccount.com> Co-authored-by: Jorge Machado <jorge.machado.ext@kiwigrid.com> Co-authored-by: Jorge Machado <JorgeWilson.Machado@ext.gfk.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
Added docs for running spark jobs with Mesos on SSL