GCP_Data_Enginner

This is Google Cloud Engineering Path hands on challenge and my documented solutions.

Scripts, deployment manager (DM) yaml and jinja templates used for GCP network implementations including: partner interconnect, cloud routers, vpc peering, vpn, etc

Ships Kafka topics and offsets to GCP Storage using Linkedin Burrow

This tool is for sending directories to storage on clouds for backup. 'salvare' means save in Latin.

Automating the ingestion of data into Google Cloud Storage (GCS) with bash scripts

Leveraged GitHub Actions to automate the deployment of a GCP pipeline for Snowflake to BigQuery data migration. Utilized 'sensex-data-analysis' as the data source and Snowflake storage integration feature to load data to GCS. Implemented workflow management and transformation using Composer (Airflow) and Dataflow