#

pyspark

Here are 37 public repositories matching this topic...

HerveMignot / CloudProvisioning

Scripts for provisioning data science tools

emr ec2 jupyter rstudio shiny-server pyspark jupyterhub jupyterlab

Updated May 26, 2018
Shell

jonathanAmancioSales / Hadoop_Dataproc_Google_Cloud_Platform_DIO

Projeto do Curso "Criando um Ecossistema Hadoop Totalmente Gerenciado com Google Cloud Dataproc" do Bootcamp Data Engineer da Digital Innovation One

hadoop google-cloud pyspark dataproc-cluster google-cloud-dataproc

Updated Aug 21, 2021
Shell

timvisee / hhs-p7-spark-docker

🐳 Docker container for Spark on college (HHS).

docker spark docker-container jupyter-notebook pyspark college

Updated May 1, 2017
Shell

redvg / dataproc-pyspark-mapreduce

GCP Dataproc mapreduce sample with PySpark

python spark apache-spark hadoop pyspark dataproc-clusters

Updated Aug 9, 2018
Shell

LSSTDESC / desc-spark

Apache Spark for the LSST DESC

apache-spark tutorials pyspark desc

Updated Oct 12, 2021
Shell

divya-anand21 / customer_demographic_hive_analysis

SQL Hive Analaysis on (Adventure Works)dataset

sql hive python3 pyspark sqoop

Updated Mar 22, 2022
Shell

jonathanAmancioSales / Semantix_Academy

Exercícios desenvolvidos nos cursos de BigData Cience e BigData Engineer da Semantix Academy

redis elasticsearch kafka spark mongodb hive hadoop bigdata hbase pyspark elastic sqoop

Updated May 6, 2022
Shell

unnitin / pyspark-jupyter-kernel

Installation instructions for pyspark and a kernel with jupyter

helper tutorial spark jupyter installer pyspark jupyter-notebooks installer-script pyspark-notebook

Updated Feb 5, 2019
Shell

Didone / sam-pyspark

Serverless PySpark

aws lambda spark aws-lambda serverless lambda-functions pyspark aws-sam

Updated Mar 10, 2020
Shell

bozzlab / pyspark-dataproc-gcs-to-bigquery

The Data Pipeline using Google Cloud Dataproc, Cloud Storage and BigQuery

python bigquery cloud-storage pyspark google-cloud-platform dataproc

Updated Feb 27, 2021
Shell

jcchac / spark-standalone-cluster-on-docker

Building a Spark standalone cluster with Docker

python docker r scala spark docker-compose pyspark jupyterlab

Updated Apr 1, 2021
Shell

chimera-suite / jupyter-notebook

Chimera Jupyter Notebook is an extension of the juptypter/pyspark-notebook image that integrates PySPARQL

python docker sparql jupyter-notebook pyspark chimera pysparql

Updated Dec 22, 2020
Shell

raspberry-pi4-hadoop-spark-cluster

aimanamri / raspberry-pi4-hadoop-spark-cluster

This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.

big-data yarn pyspark hdfs distributed-storage hadoop-cluster parallel-processing spark-shell spark-cluster raspberry-pi-4

Updated Jul 13, 2024
Shell

aaa121 / Big-Data-Analytics

python r scala sql hive pyspark pig sparkr hadoop-filesystem hadoop-mapreduce

Updated Jul 22, 2017
Shell

Anusha-GK / AWS-Data-Pipeline

Setting up Data Pipeline in AWS using AWS Data Pipeline, S3 and EMR

aws-emr pyspark emractivity pipeline-definition

Updated Sep 30, 2022
Shell

Aless19 / pyspark-dev

ezpz pyspark dev environment with docker

docker spark docker-compose pyspark jupyter-lab

Updated Jul 20, 2024
Shell

vishnudxb / gcloud-dataproc-creation

Creating gcloud dataproc cluster with this github action

testing big-data google-cloud pyspark spark-streaming dataproc-cluster

Updated Oct 18, 2020
Shell

mpolatcan / spark-docker

Scalable Spark Docker image that can works on Docker Compose and Kubernetes

docker kubernetes dockerfile spark scalable docker-compose docker-image pyspark

Updated Nov 16, 2020
Shell

Thelin90 / deiteo

P.O.C Spark On Kubernetes

docker kubernetes spark kubernetes-cluster python3 pyspark minikube minikube-cluster kubectl pipenv spark-structured-streaming

Updated Feb 18, 2021
Shell

richardcann / spark-integration-localstack

Local integration test setup for pyspark with AWS through Localstack

spark hadoop aws-s3 pyspark localstack

Updated Jan 5, 2022
Shell

Improve this page

Add a description, image, and links to the pyspark topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pyspark topic, visit your repo's landing page and select "manage topics."