AEGIS Harvester

A pipeline consisting of four micro services performing the following steps:

Fetch data from OpenWeatherMap
Transform JSON to CSV
Aggregate results in a file for a specified duration
Export the file to Hops

Prerequisites

Java JDK 1.8
Maven

Setup

There are two ways to install the AEGIS weather demo stack:

Install the following services manually. Specific instructions can be found in their respective directories.
- Importer
- Transformer
- Aggregator
- Exporter
Install Docker compose and run the following commands. Please note that manual configuration of the services may still be required.
```
./install.sh
cd weather-harvester-demo
./deploy.sh
```