A framework for word embedding evaluation automation and visualization.

Information Builder, one of the top Big Data Integration Platforms in the industry, helps the enterprises leverage big data technologies and data science methods to drive competitive advantage on decision making and business strategies. The project is working for an apparel retailer to migrate and integrate data into decision support systems bas…

A starter project to get going with transformers and deep learning for NLP tasks with Hugging Face and PyTorch and GLUE.

To run the same ETL code in multiple cloud services based on your preference, thus saving time further to develop the ETL scripts for different environments & clouds.

An End-To-End Data Pipeline for keywords related to Football

Real-time IoT event streaming with Kafka and Spark to AWS.

The aim of this project is to combine secure data management with insightful analysis of YouTube video categories and trends using an ETL pipeline.

The lambda function to start a AWS work-flow on new file uploaded to S3-Bucket.

Glue VSCode devcontainer setup

Dive into an ETL pipeline project to improve AML transaction monitoring for financial institutions. This guide covers using AWS services such as Aurora MySQL, Glue, DMS, S3, and Athena to create an effective solution for AML compliance. Perfect for data enthusiasts, it includes database migration, ETL processing, and cost-efficient querying.

end-to-end data pipeline for getting information from blockchains.

Aws Lambda to Ingest Data Incrementally from Github Archive Website

O projeto foi elaborado com o objetivo de estabelecer uma arquitetura na AWS, originada a partir de uma migração de um banco de dados existente em um ambiente local (on-premise).

An Ariflow, Kafka, AWS and Python data streaming project for Fire incidents in San Francisco

Projeto de pipeline B3 para o Tech Challnege Fase 2 da FIAP

Event-Driven Python on AWS #CloudGuruChallenge

A data pipeline example using Kafka on Docker

Data Engineering Coding Challenge

Create Python module and use it in Glue Job