0.4.0 Release (#189)

dotnet · Jul 29, 2019 · e2c1ae1 · e2c1ae1
1 parent b0d6f33
commit e2c1ae1
Show file tree

Hide file tree

Showing 8 changed files with 59 additions and 8 deletions.
diff --git a/README.md b/README.md
@@ -39,7 +39,7 @@
     <tbody align="center">
         <tr>
             <td >2.3.*</td>
-            <td rowspan=4><a href="https://github.com/dotnet/spark/releases/tag/v0.3.0">v0.3.0</a></td>
+            <td rowspan=4><a href="https://github.com/dotnet/spark/releases/tag/v0.4.0">v0.4.0</a></td>
         </tr>
         <tr>
             <td>2.4.0</td>

diff --git a/benchmark/scala/pom.xml b/benchmark/scala/pom.xml
@@ -3,7 +3,7 @@
   <modelVersion>4.0.0</modelVersion>
   <groupId>com.microsoft.spark</groupId>
   <artifactId>microsoft-spark-benchmark</artifactId>
-  <version>0.3.0</version>
+  <version>0.4.0</version>
   <inceptionYear>2019</inceptionYear>
   <properties>
     <encoding>UTF-8</encoding>

diff --git a/docs/release-notes/0.3/release-0.3.md b/docs/release-notes/0.3/release-0.3.md
@@ -26,11 +26,11 @@ The following table outlines the supported Spark versions along with the microso
     <tbody align="center">
         <tr>
             <td>2.3.*</td>
-            <td>microsoft-spark-2.3.x-0.2.0.jar</td>
+            <td>microsoft-spark-2.3.x-0.3.0.jar</td>
         </tr>
         <tr>
             <td>2.4.0</td>
-            <td rowspan=3>microsoft-spark-2.4.x-0.2.0.jar</td>
+            <td rowspan=3>microsoft-spark-2.4.x-0.3.0.jar</td>
         </tr>
         <tr>
             <td>2.4.1</td>

diff --git a/docs/release-notes/0.4/release-0.4.md b/docs/release-notes/0.4/release-0.4.md
@@ -0,0 +1,51 @@
+# .NET for Apache Spark 0.4 Release Notes
+
+### New Features and Improvements
+
+* Revamped loading assemblies used inside UDFs ([#180](https://github.com/dotnet/spark/pull/180))
+* Support for Vector UDFs ([#127](https://github.com/dotnet/spark/pull/127))
+* Support for Grouped Map UDFs ([#143](https://github.com/dotnet/spark/pull/143))
+* Resolve the signer mismatch issue ([#186](https://github.com/dotnet/spark/pull/186))
+* Ability to launch a debugger from the worker ([#150](https://github.com/dotnet/spark/pull/150))
+* Compatibility check for Microsoft.Spark.dll in the worker ([#170](https://github.com/dotnet/spark/pull/170))
+* Update Apache.Arrow to v0.14.1 ([#167](https://github.com/dotnet/spark/pull/167))
+* Support for RuntimeConfig in SparkSession ([#184](https://github.com/dotnet/spark/pull/184))
+* Support for `Trigger` in `DataStreamWriter` ([#153](https://github.com/dotnet/spark/pull/153))
+* The ability to use `--archives` option to deploy the worker binaries and assemblies that UDFs depend on ([#187](https://github.com/dotnet/spark/pull/187))
+
+### Breaking Changes
+* Due to the changes in loading assemblies ([#180](https://github.com/dotnet/spark/pull/180)), the Microsoft.Spark.Worker executable is no longer compatible with the previous versions.
+* The `--class org.apache.spark.deploy.DotnetRunner` option in `spark-submit` is changed to **`--class org.apache.spark.deploy.dotnet.DotnetRunner`** to resolve the signer mismatch issue ([#186](https://github.com/dotnet/spark/pull/186)).
+
+### Supported Spark Versions
+
+The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
+
+<table>
+    <thead>
+        <tr>
+            <th>Spark Version</th>
+            <th>microsoft-spark JAR</th>
+        </tr>
+    </thead>
+    <tbody align="center">
+        <tr>
+            <td>2.3.*</td>
+            <td>microsoft-spark-2.3.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.0</td>
+            <td rowspan=3>microsoft-spark-2.4.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.1</td>
+        </tr>
+        <tr>
+            <td>2.4.3</td>
+        </tr>
+        <tr>
+            <td>2.4.2</td>
+            <td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
+        </tr>
+    </tbody>
+</table>
diff --git a/eng/Versions.props b/eng/Versions.props
@@ -1,7 +1,7 @@
 <?xml version="1.0" encoding="utf-8"?>
 <Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
   <PropertyGroup>
-    <VersionPrefix>0.3.0</VersionPrefix>
+    <VersionPrefix>0.4.0</VersionPrefix>
     <PreReleaseVersionLabel>prerelease</PreReleaseVersionLabel>
     <RestoreSources>
       $(RestoreSources);

diff --git a/src/scala/microsoft-spark-2.3.x/pom.xml b/src/scala/microsoft-spark-2.3.x/pom.xml
@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.3.0</version>
+    <version>0.4.0</version>
   </parent>
   <artifactId>microsoft-spark-2.3.x</artifactId>
   <inceptionYear>2019</inceptionYear>

diff --git a/src/scala/microsoft-spark-2.4.x/pom.xml b/src/scala/microsoft-spark-2.4.x/pom.xml
@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.3.0</version>
+    <version>0.4.0</version>
   </parent>
   <artifactId>microsoft-spark-2.4.x</artifactId>
   <inceptionYear>2019</inceptionYear>

diff --git a/src/scala/pom.xml b/src/scala/pom.xml
@@ -4,7 +4,7 @@
   <groupId>com.microsoft.scala</groupId>
   <artifactId>microsoft-spark</artifactId>
   <packaging>pom</packaging>
-  <version>0.3.0</version>
+  <version>0.4.0</version>
   <properties>
     <encoding>UTF-8</encoding>
   </properties>