The objective of this project is to ingest, transform, analysis, and visualize the data to make resilient data processing and high accuracy analytical data. The pipeline should be designed to handle large amounts of data and ensure data integrity during the data processing. The pipeline should include steps for extracting data from the data source (BMKG), loading data into datalake (AWS S3 Bucket), transforming into data warehouse (Snowflake), doing some analysis on it, and finally build data visualization to get more insight.
-
Notifications
You must be signed in to change notification settings - Fork 1
ArkanNibrastama/weather-analytics
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Weather data pipeline with AWS, Snowflakes, and Airflow
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published