Skip to content

Latest commit

 

History

History
36 lines (25 loc) · 1.26 KB

README.md

File metadata and controls

36 lines (25 loc) · 1.26 KB

spark-eventhubs

This is the source code of EventHubsReceiver for Spark Streaming.

Here is an example project that uses EventHubsReceiver to count and persist messages from Azure Eventhubs.

Project References

Maven Dependency

<!-- https://mvnrepository.com/artifact/com.microsoft.azure/spark-streaming-eventhubs_2.11 -->
<dependency>
    <groupId>com.microsoft.azure</groupId>
    <artifactId>spark-streaming-eventhubs_2.11</artifactId>
    <version>2.0.0</version>
</dependency>

SBT Dependency

// https://mvnrepository.com/artifact/com.microsoft.azure/spark-streaming-eventhubs_2.11
libraryDependencies += "com.microsoft.azure" % "spark-streaming-eventhubs_2.11" % "2.0.0"

Maven Central for other dependency co-ordinates

https://mvnrepository.com/artifact/com.microsoft.azure/spark-streaming-eventhubs_2.11/2.0.0

Build Prerequisites

In order to build and run the examples, you need to have:

  1. Java 1.8 SDK.
  2. Maven 3.x
  3. Scala 2.11

Build Command

mvn clean
mvn package

This command builds and installs EventHubsReceiver jar to local maven cache. Subsequently you can build any Spark Streaming application that references this jar.