Data Engineer since 2022. Aspiring Web Developer since 2020. Enjoys developing with Python, JavaScript, Power BI and SQL.
Timezone: Europe/Madrid (CEST)
My latest achivement is finishing Udacity program for Data Engineer with Microsoft Azure. In this program we had several very interesting projects.
Project 1: Create Data Warehouse for Bike share business in the Azure cloud, with Postgres database and develop ETL with Azure Synapse.
Project 2: We extended previous project to develop a data lake solution using Azure Databricks and lake house architecture.
Project 3: This was a final capstone project. The business problem we were solving was to analyze how the New York City's financial resources are allocated and how much of the City's budget is being devoted to overtime.
We used following technologies to solve this problem:
- Azure Data Lake Gen2
- Azure SQL DB
- Azure Data Factory
- Azure Synapse Analytics
One of my other favorite projects is called "Weather Data ETL Pipeline" with Python and Apache Airflow that retrieves weather data from the OpenWeatherMap API, stores it in a PostgreSQL database, and uses Apache Airflow for orchestration.
It was also fun and exciting to participate in Kaggle "Titanic" competition with my team from AW.