Pinned Loading

1. Google-Cloud-Data-Migration-Pipeline Google-Cloud-Data-Migration-Pipeline Public

   This project aims to provide an end-to-end Extract, Transform, Load (ETL) pipeline built using Apache Airflow to transfer data from local MongoDB and MySQL databases to Google Cloud services.

   Python

2. vnstock-data-pipeline vnstock-data-pipeline Public

   Creating a robust and scalable data pipeline on Google Cloud Platform (GCP) to monitor and analyze stock performance. Leveraging the power of GCP's data processing and storage services, a comprehen…

   Python 1

3. Tiki-product-scraper Tiki-product-scraper Public

   This project aims to scrape all product data from the Tiki website in June 2023 and store it in a MongoDB database. The collected data can then be analyzed and used for various purposes 🕸️

   Python 1

4. data-migration-on-GCP data-migration-on-GCP Public

   This project aims to migrate data from MongoDB to Google Cloud Storage (GCS) and BigQuery automatically. It enables businesses to easily transfer and analyze the data in the cloud, improving data a…

   Python

5. graphic-cards-scraper graphic-cards-scraper Public

   Collect graphic cards data from newegg.com website in May 2023 and store it in a MySQL database ⚙️

   Python

6. data-transformation-and-analysis data-transformation-and-analysis Public

   This project uses Bash to transform and analyze a collection of book data files, perform statistical analysis, and generate insightful reports for valuable insights 🚀

   Shell