ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau

Monte Carlo stock simulation using Apache Spark.

Project for Cloud Computing course (A.Y. 2018/2019)

Apache spark sandbox on GCP and Amazon EMR.

Leveraging NYC Open Data, this repository contains Databricks notebooks for analyzing motor vehicle collisions. We perform EDA, spatial clustering, and predictive modeling on collision, vehicle, and person datasets to understand accident trends and predict potential risks.

Implements a work queue for Dataproc Worflow Template executions

Data is fetched from StackExchange, transformed using Pig, queried and stored in Hive. Additionally, the TF-IDF of the top 10 users is calculated using Hive.

First project for Big Data course held at Roma Tre University

Hadoop Google DataProc DIO study

Project for Scalable and Cloud Programming Course - 2018/19 UNIBO.

Marketing Campaign Data Analysis Using Apache Spark (PySpark)

Car Insurance Cold Calls Data Analysis using Apache Hive

Movie Rating Analysis using Apache Spark (pyspark)

Process large amount of data and implement complex data analyses using Spark. The dataset has been made available by Google. It includes data about a cluster of 12500 machines, and the activity on this cluster during 29 days.