dimajix

All

33 repositories

flowman
Public
Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.
flowman scala sql big-data spark apache-spark hadoop etl bigdata data-engineering
Scala
•
Apache License 2.0
•19•94•47•9•Updated Dec 16, 2024Dec 16, 2024
pyspark-advanced
Public
Jupyter Notebooks for PySpark Advanced Workshop
Jupyter Notebook
•
Apache License 2.0
•8•4•0•0•Updated Dec 5, 2023Dec 5, 2023
pyspark-datascience
Public
Jupyter Notebook
•0•0•0•0•Updated Nov 16, 2023Nov 16, 2023
terraform-emr-training
Public
Terraform script for launching multiple EMR clusters for training purposes.
Shell
•
Other
•20•16•1•0•Updated Nov 2, 2023Nov 2, 2023
flowman-maven
Public
Maven plugin for streamlining the development workflow with Flowman
Java
•
Apache License 2.0
•0•0•0•2•Updated Aug 14, 2023Aug 14, 2023
flowman-tutorial
Public
Tutorial for Flowman
Shell
•
Apache License 2.0
•0•0•0•0•Updated Jul 21, 2023Jul 21, 2023
flowman-demo-weather
Public
Shell
•
Apache License 2.0
•0•3•0•0•Updated Jun 29, 2023Jun 29, 2023
docker-jupyterhub
Public
Docker image with jupyterhub
Python
•
Apache License 2.0
•0•0•0•0•Updated May 19, 2023May 19, 2023
spark-training
Public
Repository used for Spark Trainings
python scala spark hive hadoop pyspark spark-streaming sqoop spark-ml hadoop-training
Jupyter Notebook
•66•53•1•4•Updated Apr 21, 2023Apr 21, 2023
docker-maven-npm
Public
0•0•0•0•Updated Mar 7, 2023Mar 7, 2023
flowman-example
Public
Example project for Flowman
Scala
•
Apache License 2.0
•0•0•0•0•Updated Sep 15, 2022Sep 15, 2022
spark-data-engineering
Public
Training notebooks for Data Engineering with Spark
0•0•0•0•Updated Sep 18, 2021Sep 18, 2021
weather-analysis
Public
Jupyter Notebook
•
Apache License 2.0
•5•7•0•0•Updated Dec 24, 2020Dec 24, 2020
docker-spark
Public
Repository for building Docker containers for Spark
docker spark hadoop cluster
Shell
•
Apache License 2.0
•2•2•0•0•Updated Aug 19, 2020Aug 19, 2020
pyspark-ml-taxis
Public
Jupyter Notebooks for PySpark Workshop using NYC Taxi Trip data
Jupyter Notebook
•1•2•0•0•Updated Oct 20, 2019Oct 20, 2019
docker-hadoop
Public
Repository for building Docker containers for Hadoop
docker hadoop
Shell
•
Apache License 2.0
•2•1•0•0•Updated Apr 11, 2019Apr 11, 2019
docker-java
Public archive
Base image for Java based Docker images
java docker
Dockerfile
•
Apache License 2.0
•0•0•0•0•Updated Apr 11, 2019Apr 11, 2019
docker-jupyter-anaconda
Public archive
Docker Jupyter image based on Anaconda distribution
Shell
•
Apache License 2.0
•1•1•0•0•Updated Dec 8, 2018Dec 8, 2018
docker-miniconda
Public
Miniconda base image
python docker anaconda
Shell
•0•1•0•0•Updated Dec 8, 2018Dec 8, 2018
pyspark-ml-crashcourse
Public
Jupyter Notebook
•4•3•0•0•Updated Sep 27, 2018Sep 27, 2018
docker-jupyter-spark
Public
Docker image for Jupyter notebooks with PySpark
python docker spark hadoop jupyter pyspark
Shell
•
Apache License 2.0
•25•27•1•0•Updated Aug 3, 2018Aug 3, 2018
docker-hive
Public
Docker container running the Hive Metastore
docker hive hadoop
Shell
•
Apache License 2.0
•1•2•0•0•Updated Dec 23, 2017Dec 23, 2017
docker-alluxio
Public
Docker image for Apache Alluxio
docker alluxio
Shell
•
Apache License 2.0
•0•2•0•0•Updated Dec 23, 2017Dec 23, 2017
docker-presto
Public archive
Repository for building Docker containers for Presto
docker presto hadoop prestodb
Shell
•
Apache License 2.0
•0•1•0•0•Updated Aug 15, 2017Aug 15, 2017
vagrant-druid
Public archive
vagrant cluster virtual vagrantfile
Puppet
•0•1•0•0•Updated Dec 16, 2016Dec 16, 2016
puppet-druid
Public archive
Puppet module that sets up and configures a full druid cluster
Puppet
•
Apache License 2.0
•7•1•0•0•Updated Dec 16, 2016Dec 16, 2016
vagrant-cloudera
Public archive
A Vagrant setup to run a virtual Cloudera cluster
vagrant cloudera cluster virtual vagrantfile
Puppet
•4•2•0•0•Updated Jul 12, 2016Jul 12, 2016
vagrant-storm-cluster
Public archive
Vagrant files for storm cluster
Puppet
•4•0•0•0•Updated Feb 22, 2016Feb 22, 2016
hadoop-training
Public
Source Code for Hadoop Training
spark hadoop hadoop-training
Scala
•4•0•0•0•Updated Dec 28, 2015Dec 28, 2015
puppet-spark
Public archive
Puppet module to manage Apache Spark
Puppet
•0•0•0•0•Updated Nov 17, 2015Nov 17, 2015