Release version 1.2.0

BUILDING.md

@@ -6,7 +6,7 @@ is installed on the build machine.
 ### Prerequisites
 
 You need the following tools installed on your machine:
-* JDK 11 or later - but not too new (Java 16 is currently not supported)
+* JDK 11 or later — but not too new (Java 16 is currently not supported)
 * Apache Maven (install via package manager download from https://maven.apache.org/download.cgi)
 * npm (install via package manager or download from https://www.npmjs.com/get-npm)
 * Docker (the creation of the Docker image can be skipped via `-Ddockerfile.skip`)

CHANGELOG.md

@@ -18,7 +18,7 @@ Breaking changes will be documented in this changelog file for each version.
 
 # Changelog
 
-## Version 1.2.0 - Upcoming
+## Version 1.2.0 - 2024-04-03
 
 * github-464: Upgrade Cloudera CDP 7.1 to Hotfix 16
 * github-465: Fix parsing of Swagger schema files

INSTALLING.md

@@ -24,13 +24,13 @@ packages being provided, for different Spark and Hadoop versions. The naming is
 flowman-dist-<version>-oss-spark<spark-version>-hadoop<hadoop-version>-bin.tar.gz
 ```
 You simply have to use the package which fits to the Spark and Hadoop versions of your environment. For example, the
-package of Flowman 1.0.0 and for Spark 3.3 and Hadoop 3.3 would be
+package of Flowman 1.2.0 and for Spark 3.3 and Hadoop 3.3 would be
 ```
-flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+flowman-dist-1.2.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 and the full URL then would be
 ```
-https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.0.0-oss-spark3.3-hadoop3.3-bin.tar.gz
+https://github.com/dimajix/flowman/releases/download/1.0.0/flowman-dist-1.2.0-oss-spark3.3-hadoop3.3-bin.tar.gz
 ```
 
 ## Supported Spark Environments
@@ -48,9 +48,9 @@ Flowman is available for many different Spark/Hadoop environments. The following
 | Open Source      | 3.2.3 | 3.3    | 11   | 2.12  | oss-spark3.2-hadoop3.3     |
 | Open Source      | 3.3.2 | 2.7    | 11   | 2.12  | oss-spark3.3-hadoop2.7     |
 | Open Source      | 3.3.2 | 3.3    | 11   | 2.12  | oss-spark3.3-hadoop3.3     |
-| Open Source      | 3.4.0 | 3.3    | 11   | 2.12  | oss-spark3.4-hadoop3.3     |
-| AWS EMR 6.10     | 3.3.1 | 3.3    | 1.8  | 2.12  | emr-spark3.3-hadoop3.3     |
-| AWS EMR 6.12     | 3.4.0 | 3.3    | 1.8  | 2.12  | emr-spark3.4-hadoop3.3     |
+| Open Source      | 3.4.1 | 3.3    | 11   | 2.12  | oss-spark3.4-hadoop3.3     |
+| Open Source      | 3.5.1 | 3.3    | 11   | 2.12  | oss-spark3.5-hadoop3.3     |
+| AWS EMR 6.12     | 3.4.0 | 3.3    | 1.8  | 2.12  | emr6.12-spark3.4-hadoop3.3 |
 | Azure Synapse    | 3.3.1 | 3.3    | 1.8  | 2.12  | synapse-spark3.3-hadoop3.3 |
 | Cloudera CDH 6.3 | 2.4.0 | 3.0    | 1.8  | 2.11  | cdh6-spark2.4-hadoop3.0    |
 | Cloudera CDP 7.1 | 2.4.8 | 3.1    | 1.8  | 2.11  | cdp7-spark2.4-hadoop3.1    |

devtools/build-release.sh

@@ -47,6 +47,7 @@ build_profile -Phadoop-3.3 -Pspark-3.2 -Dhadoop.version=3.3.1
 build_profile -Phadoop-2.7 -Pspark-3.3
 build_profile -Phadoop-3.3 -Pspark-3.3 -Dhadoop.version=3.3.2
 build_profile -Phadoop-3.3 -Pspark-3.4 -Dhadoop.version=3.3.4
+build_profile -Phadoop-3.3 -Pspark-3.5 -Dhadoop.version=3.3.4
 
 build_profile -PEMR-6.12
 build_profile -Psynapse-3.3

docker/pom.xml

@@ -12,7 +12,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

docs/quickstart.md

@@ -14,7 +14,7 @@ Of course, you need a working Docker installation, which should be quite easy. T
 containing Flowman via the following command:
 
 ```shell
-docker run --rm -ti dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3 bash   
+docker run --rm -ti dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3 bash   
 ```
 
 Note that this simply starts a bash shell, but Flowman is only away some fingertips. 
@@ -26,7 +26,7 @@ may want to make local data accessible to Flowman or you may simply want to exec
 on your local machine. This can be easily achieved as follows:
 
 ```shell
-docker run --rm -ti -v /home/kaya/flowman/example/weather:/home/flowman/local dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3 bash   
+docker run --rm -ti -v /home/kaya/flowman/example/weather:/home/flowman/local dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3 bash   
 ```
 
 This will mount the local directory `/home/kaya/flowman/example/weather` on your host computer into the Docker

docs/releases.md

@@ -30,7 +30,7 @@ Breaking changes will be documented in the changelog file for each version.
 The following gives an (incomplete) list of past releases of the last 12 months. This will help you to spot breaking 
 changes over time.
 
-## Version 1.2.0 - Upcoming
+## Version 1.2.0 - 2024-04-03
 
 * github-464: Upgrade Cloudera CDP 7.1 to Hotfix 16
 * github-465: Fix parsing of Swagger schema files

docs/setup/building.md

@@ -13,13 +13,13 @@ versions. The naming is very simple:
 flowman-dist-<version>-oss-spark<spark-version>-hadoop<hadoop-version>-bin.tar.gz
 ```
 You simply have to use the package which fits to the Spark and Hadoop versions of your environment. For example the
-package of Flowman 1.1.0 and for Spark 3.4 and Hadoop 3.3 would be
+package of Flowman 1.2.0 and for Spark 3.4 and Hadoop 3.3 would be
 ```
-flowman-dist-1.1.0-oss-spark3.4-hadoop3.3-bin.tar.gz
+flowman-dist-1.2.0-oss-spark3.4-hadoop3.3-bin.tar.gz
 ```
 and the full URL then would be
 ```
-https://github.com/dimajix/flowman/releases/download/1.1.0/flowman-dist-1.1.0-oss-spark3.4-hadoop3.3-bin.tar.gz
+https://github.com/dimajix/flowman/releases/download/1.2.0/flowman-dist-1.2.0-oss-spark3.4-hadoop3.3-bin.tar.gz
 ```
 
 ## Build with Maven

docs/setup/docker.md

@@ -15,12 +15,12 @@ We publish Flowman Docker images on [Docker Hub](https://hub.docker.com/reposito
 which are good enough for local work. You can easily start a Flowman session in Docker as follows:
 
 ```shell
-docker run --rm -ti dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3 bash
+docker run --rm -ti dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3 bash
 ```
 When you are using [git bash](https://git-scm.com/download/win), you will probably need to use `winpty`, which 
 translates to the following command
 ```shell
-winpty docker run --rm -ti dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3 bash
+winpty docker run --rm -ti dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3 bash
 ```
 
 Once the Docker image has started, you will be presented with a bash prompt. Then you can easily build the
@@ -35,7 +35,7 @@ flowexec -f examples/weather job build main
 By using Docker volumes, you can easily mount a Flowman project into the Docker container, for example
 
 ```shell
-docker run --rm -ti --mount type=bind,source=$(pwd)/my_project,target=/home/flowman/my_project dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3 bash
+docker run --rm -ti --mount type=bind,source=$(pwd)/my_project,target=/home/flowman/my_project dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3 bash
 ```
 The command above will start a Docker container running Flowman, and the local subdirectory `my_project` within the 
 current working directory is mounted into the container at `/home/flowman/my_project`. Then you open your project
@@ -58,7 +58,7 @@ version: "3"
 services:
   flowman:
     # Set the appropriate Flowman Docker image of your choice.
-    image: dimajix/flowman:1.1.0-oss-spark3.4-hadoop3.3
+    image: dimajix/flowman:1.2.0-oss-spark3.4-hadoop3.3
     # Let Docker start a bash if nothing else is specified.
     command: bash
     # Mount local volumes into the Docker container. Adjust the example entries to your needs!

docs/setup/emr.md

@@ -29,13 +29,13 @@ opening firewall ports, providing your public ssh key and more. You can read det
 Once you successfully logged in to the master node, you need to download an EMR optimized version of Flowman using
 `wget` or `curl`:
 ```shell
-wget https://github.com/dimajix/flowman/releases/download/1.1.0/flowman-dist-1.0.0-emr6.12-spark3.4-hadoop3.3-bin.tar.gz
+wget https://github.com/dimajix/flowman/releases/download/1.2.0/flowman-dist-1.0.0-emr6.12-spark3.4-hadoop3.3-bin.tar.gz
 ```
 Next you unpack Flowman as follows:
 ```shell
-tar xvzf flowman-dist-1.1.0-emr6.12-spark3.4-hadoop3.3-bin.tar.gz
+tar xvzf flowman-dist-1.2.0-emr6.12-spark3.4-hadoop3.3-bin.tar.gz
 ```
-This will create a directory `flowman-1.1.0-emr6.12-spark3.4-hadoop3.3` which contains all executables and libraries
+This will create a directory `flowman-1.2.0-emr6.12-spark3.4-hadoop3.3` which contains all executables and libraries
 of Flowman.
 
 #### Directory Layout
@@ -216,7 +216,7 @@ This deployment descriptor contains all required information
 ```yaml
 flowman:
   # Specify the Flowman version to use
-  version: 1.1.0-emr6.12-spark3.4-hadoop3.3
+  version: 1.2.0-emr6.12-spark3.4-hadoop3.3
   plugins:
     # Specify the list of plugins to use
     - flowman-avro

docs/setup/index.md

@@ -19,7 +19,7 @@ Moreover, managed Spark environments like AWS EMR or Azure Synapse are supported
 Flowman is available for many different Spark/Hadoop environments. Flowman provides different packages
 for each of these environments to ensure a high degree of compatibility. Each variant is identified by its suffix
 appended to the Flowman version, i.e. `<flowman-version>-<flowman-variant>`. So for example, the full version tag
-of Flowman 0.30.0 for Cloudera CDP 7.1 and Spark 3.3 would be `0.30.0-cdp7-spark3.3-hadoop3.1`.
+of Flowman 1.2.0 for Cloudera CDP 7.1 and Spark 3.3 would be `1.2.0-cdp7-spark3.3-hadoop3.1`.
 
 The following environments are officially supported with corresponding build variants:
 

docs/setup/installation.md

@@ -21,7 +21,7 @@ needs to match the ones of your platform
 
 ### Download & Install Spark
 
-As of this writing, the latest release of Flowman is 1.1.0 and is available prebuilt for Spark 3.4.1 on the Spark
+As of this writing, the latest release of Flowman is 1.2.0 and is available prebuilt for Spark 3.4.1 on the Spark
 homepage. So we download the appropriate Spark distribution from the Apache archive and unpack it.
 
 ```shell
@@ -64,13 +64,13 @@ versions. The naming is straight forward:
 flowman-dist-<version>-oss-spark<spark-version>-hadoop<hadoop-version>-bin.tar.gz
 ```
 You simply have to use the package which fits to the Spark and Hadoop versions of your environment. For example, the
-package of Flowman 1.1.0 and for Spark 3.4 and Hadoop 3.3 would be
+package of Flowman 1.2.0 and for Spark 3.4 and Hadoop 3.3 would be
 ```
-flowman-dist-1.1.0-oss-spark3.4-hadoop3.3-bin.tar.gz
+flowman-dist-1.2.0-oss-spark3.4-hadoop3.3-bin.tar.gz
 ```
 and the full URL then would be
 ```
-https://github.com/dimajix/flowman/releases/download/1.1.0/flowman-dist-1.1.0-oss-spark3.4-hadoop3.3-bin.tar.gz
+https://github.com/dimajix/flowman/releases/download/1.2.0/flowman-dist-1.2.0-oss-spark3.4-hadoop3.3-bin.tar.gz
 ```
 
 ### Supported Spark Environments
@@ -89,8 +89,7 @@ Flowman is available for many different Spark/Hadoop environments. The following
 | Open Source      | 3.3.4 | 2.7    | 11   | 2.12  | oss-spark3.3-hadoop2.7        |
 | Open Source      | 3.3.3 | 3.3    | 11   | 2.12  | oss-spark3.3-hadoop3.3        |
 | Open Source      | 3.4.1 | 3.3    | 11   | 2.12  | oss-spark3.4-hadoop3.3        |
-| Open Source      | 3.5.0 | 3.3    | 11   | 2.12  | oss-spark3.5-hadoop3.3        |
-| AWS EMR 6.10     | 3.3.1 | 3.3    | 1.8  | 2.12  | emr6.10-spark3.3-hadoop3.3    |
+| Open Source      | 3.5.1 | 3.3    | 11   | 2.12  | oss-spark3.5-hadoop3.3        |
 | AWS EMR 6.12     | 3.4.0 | 3.3    | 1.8  | 2.12  | emr6.12-spark3.4-hadoop3.3    |
 | Azure Synapse    | 3.3.1 | 3.3    | 1.8  | 2.12  | synapse3.3-spark3.3-hadoop3.3 |
 | Cloudera CDH 6.3 | 2.4.0 | 3.0    | 1.8  | 2.11  | cdh6-spark2.4-hadoop3.0       |

docs/setup/synapse.md

@@ -70,7 +70,7 @@ This deployment descriptor contains all required information
 ```yaml
 flowman:
   # Specify the Flowman version to use
-  version: 1.1.0-synapse3.3-spark3.3-hadoop3.3
+  version: 1.2.0-synapse3.3-spark3.3-hadoop3.3
   plugins:
     # Specify the list of plugins to use
     - flowman-avro

flowman-common-java/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-common-jersey/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-common/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-core/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-dist/pom.xml

@@ -12,7 +12,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-api/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-common/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-server/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <artifactId>flowman-root</artifactId>
         <groupId>com.dimajix.flowman</groupId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-kernel-tools/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-parent/pom.xml

@@ -12,7 +12,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
 	    <artifactId>flowman-root</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../pom.xml</relativePath>
     </parent>
 

flowman-plugins/avro/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/aws/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/azure/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/delta/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/impala/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/json/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/kafka/pom.xml

@@ -11,7 +11,7 @@
     <parent>
 	    <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/mariadb/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>
 

flowman-plugins/mssqlserver/pom.xml

@@ -11,7 +11,7 @@
     <parent>
         <groupId>com.dimajix.flowman</groupId>
         <artifactId>flowman-plugin-parent</artifactId>
-        <version>1.2.0-SNAPSHOT</version>
+        <version>1.2.0</version>
         <relativePath>../parent/pom.xml</relativePath>
     </parent>