Skip to content

Commit

Permalink
new directory name for services (apache#236)
Browse files Browse the repository at this point in the history
  • Loading branch information
Suzanne Scala authored Dec 15, 2017
1 parent 233af26 commit 9be6d18
Show file tree
Hide file tree
Showing 8 changed files with 11 additions and 11 deletions.
2 changes: 1 addition & 1 deletion docs/hdfs.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,4 +35,4 @@ That hdfs directory will be automatically created on hdfs and spark streaming ap


[8]: http://spark.apache.org/docs/latest/configuration.html#inheriting-hadoop-cluster-configuration
[9]: https://docs.mesosphere.com/service-docs/spark/2.1.0-2.2.0-1/limitations/
[9]: https://docs.mesosphere.com/services/spark/2.1.0-2.2.0-1/limitations/
4 changes: 2 additions & 2 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,8 +50,8 @@ DC/OS Apache Spark includes:
[1]: http://spark.apache.org/documentation.html
[2]: http://spark.apache.org/docs/latest/running-on-mesos.html#cluster-mode
[3]: http://spark.apache.org/docs/latest/monitoring.html#viewing-after-the-fact
[4]: https://docs.mesosphere.com/service-docs/hdfs/
[5]: https://docs.mesosphere.com/service-docs/kafka/
[4]: https://docs.mesosphere.com/services/hdfs/
[5]: https://docs.mesosphere.com/services/kafka/
[6]: https://zeppelin.incubator.apache.org/
[17]: https://github.com/mesosphere/spark
[18]: https://github.com/mesosphere/spark-build
2 changes: 1 addition & 1 deletion docs/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Spark is available in the Universe and can be installed by using either the GUI
**Prerequisites:**

- [DC/OS and DC/OS CLI installed](https://docs.mesosphere.com/1.9/installing/).
- Depending on your [security mode](https://docs.mesosphere.com/1.9/overview/security/security-modes/), Spark requires service authentication for access to DC/OS. For more information, see [Configuring DC/OS Access for Spark](https://docs.mesosphere.com/service-docs/spark/spark-auth/).
- Depending on your [security mode](https://docs.mesosphere.com/1.9/overview/security/security-modes/), Spark requires service authentication for access to DC/OS. For more information, see [Configuring DC/OS Access for Spark](https://docs.mesosphere.com/services/spark/spark-auth/).

| Security mode | Service Account |
|---------------|-----------------------|
Expand Down
2 changes: 1 addition & 1 deletion docs/kerberos.md
Original file line number Diff line number Diff line change
Expand Up @@ -123,4 +123,4 @@ Finally, you'll likely need to tell Spark to use the JAAS file:
--conf spark.executor.extraJavaOptions=-Djava.security.auth.login.config=/mnt/mesos/sandbox/<jaas_file>


It is important that the filename is the same for the driver and executor keytab file (`<keytab_file_name>` above) and that this file is properly addressed in your JAAS file. For a worked example of a Spark consumer from secure Kafka see the [advanced examples][https://docs.mesosphere.com/service-docs/spark/2.1.1-2.2.0-2/usage-examples/]
It is important that the filename is the same for the driver and executor keytab file (`<keytab_file_name>` above) and that this file is properly addressed in your JAAS file. For a worked example of a Spark consumer from secure Kafka see the [advanced examples][https://docs.mesosphere.com/services/spark/2.1.1-2.2.0-2/usage-examples/]
6 changes: 3 additions & 3 deletions docs/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ This tutorial will get you up and running in minutes with Spark. You will instal
**Prerequisites:**

- [DC/OS and DC/OS CLI installed](https://docs.mesosphere.com/1.9/installing/) with a minimum of three agent nodes with eight GB of memory and ten GB of disk available on each agent.
- Depending on your [security mode](https://docs.mesosphere.com/1.9/overview/security/security-modes/), Spark requires service authentication for access to DC/OS. For more information, see [Configuring DC/OS Access for Spark](https://docs.mesosphere.com/service-docs/spark/spark-auth/).
- Depending on your [security mode](https://docs.mesosphere.com/1.9/overview/security/security-modes/), Spark requires service authentication for access to DC/OS. For more information, see [Configuring DC/OS Access for Spark](https://docs.mesosphere.com/services/spark/spark-auth/).

| Security mode | Service Account |
|---------------|-----------------------|
Expand All @@ -19,7 +19,7 @@ This tutorial will get you up and running in minutes with Spark. You will instal
| Strict | Required |


1. Install the Spark package. This may take a few minutes. This installs the Spark DC/OS service, Spark CLI, dispatcher, and, optionally, the history server. See [Custom Installation](/service-docs/spark/v1.0.9-2.1.0-1/install/#custom) to install the history server.
1. Install the Spark package. This may take a few minutes. This installs the Spark DC/OS service, Spark CLI, dispatcher, and, optionally, the history server. See [Custom Installation](/services/spark/v1.0.9-2.1.0-1/install/#custom) to install the history server.

```bash
dcos package install spark
Expand All @@ -33,7 +33,7 @@ This tutorial will get you up and running in minutes with Spark. You will instal
New command available: dcos spark
DC/OS Spark is being installed!
Documentation: https://docs.mesosphere.com/service-docs/spark/
Documentation: https://docs.mesosphere.com/services/spark/
Issues: https://docs.mesosphere.com/support/
```

Expand Down
2 changes: 1 addition & 1 deletion docs/run-job.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,4 +167,4 @@ The default DC/OS Apache Spark distribution is compiled against Hadoop 2.6 libra
[16]: https://dcos.io/docs/overview/design/overlay/
[17]: https://dcos.io/docs/1.9/deploying-services/containerizers/ucr/
[18]: http://mesos.apache.org/documentation/latest/endpoints/master/teardown/
[19]: https://docs.mesosphere.com/service-docs/spark/v2.2.0-2.2.0-1/hdfs/
[19]: https://docs.mesosphere.com/services/spark/v2.2.0-2.2.0-1/hdfs/
2 changes: 1 addition & 1 deletion docs/security.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ This topic describes how to configure DC/OS service accounts for Spark.

When running in [DC/OS strict security mode](https://docs.mesosphere.com/1.9/security/), both the dispatcher and jobs must authenticate to Mesos using a [DC/OS Service Account](https://docs.mesosphere.com/1.9/security/service-auth/).

Follow these instructions to [authenticate in strict mode](https://docs.mesosphere.com/service-docs/spark/spark-auth/).
Follow these instructions to [authenticate in strict mode](https://docs.mesosphere.com/services/spark/spark-auth/).

# Spark SSL

Expand Down
2 changes: 1 addition & 1 deletion docs/usage-examples.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ Visit the Spark cluster dispatcher at `http://<dcos-url>/service/spark/` to view

## Advanced

* Run an Spark Streaming job with Kafka: Examples of Spark Streaming applications that connect to a secure Kafka cluster can be found at [spark-build][https://github.com/mesosphere/spark-build/blob/beta-2.1.1-2.2.0-2/tests/jobs/scala/src/main/scala/KafkaJobs.scala]. As mentioned in the [kerberos][https://docs.mesosphere.com/service-docs/spark/2.1.0-2.2.0-2/kerberos/] section, Spark requires a JAAS file, the `krb5.conf`, and the keytab. An example of the JAAS file is:
* Run an Spark Streaming job with Kafka: Examples of Spark Streaming applications that connect to a secure Kafka cluster can be found at [spark-build][https://github.com/mesosphere/spark-build/blob/beta-2.1.1-2.2.0-2/tests/jobs/scala/src/main/scala/KafkaJobs.scala]. As mentioned in the [kerberos][https://docs.mesosphere.com/services/spark/2.1.0-2.2.0-2/kerberos/] section, Spark requires a JAAS file, the `krb5.conf`, and the keytab. An example of the JAAS file is:

KafkaClient {
com.sun.security.auth.module.Krb5LoginModule required
Expand Down

0 comments on commit 9be6d18

Please sign in to comment.