Skip to content

This is complete End to End PySpark project and we have covered each and every thing with PySpark Example and PySpark Project Scenario.

Notifications You must be signed in to change notification settings

zBalachandar/Sales-Analysis-End-to-End-Pyspark-Real-Time-prod-project-02.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Sales-Analysis-End-to-End-Pyspark-Real-Time-prod-project 2.

This is complete End to End PySpark project and we have covered each and every thing with PySpark Example and PySpark Project Scenario.

Banner

    🔧 Analyzing Sales Data

Data Processing using DataBricks


📝 Table of Contents

  1. Project Overview
  2. Data Transformation 2.1 [DataBricks Notebook]
  3. Data Reporting 3.1[DASHBOARD Presentation]
  4. Credits
  5. Contact

🔬 Project Overview

we have Business requirements and we want to do data cleaning and processing using PySpark in Databricks Environment. we have discussed how we work in real-time in Databricks and PySpark we have developed the presentation Dashboard according to the Databricks notebook KPI's.

💾 Dataset

Dataset link: https://drive.google.com/drive/folders/1id0VXIu3LaF4cWWAMf6fbahzJR9yQvCI image

Business Requirement.

image

KPI

image

Project steps to follow:

what we have covered in this project:

  • We have Covered End to End PySpark Project
  • PySpark Project Example
  • Databricks PySpark Project
  • Data processing with KPI's
  • Developed the KPI's Data Visualization according to the business requirement

we have Business requirements and we want to do data cleaning and processing using PySpark in Databricks Environment. we have discussed how we work in real-time in Databricks and PySpark

⚙️ Data Transformation

Data cleaning and processing using PySpark in Databricks Environment.

DataBricks Notebook.

DataBricks Notebook Live-link image image image image image image image image image image image image image image

📊 Data Reporting KPI's

I created a presentation dashboard and insightful data visualizations. Data Visualization presentation Live-link image image image image

🛠️ Technologies Used

  • Data processing: DataBricks -Pyspark
  • Data Visualization: DataBricks Visualization

📋 Credits

📨 Contact Me

LinkedInGmail

About

This is complete End to End PySpark project and we have covered each and every thing with PySpark Example and PySpark Project Scenario.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published