Ion is a web application designed to leverage OSINT and APIs to create a centralised information hub for data driven trading/market intelligence. It is powered by powerful charting systems (d3 charting written in a plugin architecture to allow customisability) and comes with its own ETL Prefect pipeline that schedules data extraction for larger data sources.
| Home Page | Available Functions |
|---|---|
 |
 |
| ETF Explorer | Chart Explorer |
|---|---|
 |
 |
| FRED Economics | Watchlist |
|---|---|
 |
 |
docker compose -f "./docker-compose.base.yml" up
prefect orion start
prefect agent start -q "common" "treasury"
python -m deployment
brew services start rabbitmq
uvicorn src.data_ingestion.app.main:app --reload --port 1236
yarn start
-
ion-frontendhandles the UI/UX of Ion, including the dashboard and the features seen below. -
data-backendhandles the extraction of data from the database thatdata-enginewrites to. -
ion-ingestionhandles the scraping of data that otherwise takes a long time to extract. E.g. Treasury data. This service writes to both MongoDB and PostgresSQL databases. -
ion-clientsprovides a unified package service that contains all of the code used bydata-backendanddata-engineservices, including database schemas.
| Status | Prompt |
|---|---|
| Online |  |
| Work in Progress (WIP) |  |
| Bug |  |
| Data Provider | Data | Repo | Status | Pages Using | Retrieval |
|---|---|---|---|---|---|
| Open Weather API | Weather | ion-clients | |
Home (Widget) | On-Demand |
| US Department of Treasury | Treasury Rates | ion-clients | |
Home (Widget) | Scheduled |
| Oanda API | Live and Historical Forex Data | ion-clients | |
Home (Widget) | On-Demand |
| Geonames | Geographical Names with Lat and Lon Data | ion-clients | |
Home (Weather Widget) | Scheduled |
| ETFDB | ETF Metadata and Database | pyETFDB-scraper | |
ETF List | Scheduled + On-Demand |
| Finnhub API | Daily Historical Ticker Prices | ion-clients | |
ETF List | On-Demand |
| USDA ESR API | Agricultural Exports & Release Schedule | usda-api | |
To be Decided | Scheduled + On-Demand |
| USDA GATS API | Agricultural Trade Data | usda-api | |
To be Decided | Scheduled + On-Demand |
| USDA PSD API | Agricultural S&D Forecasts Data | usda-api | |
To be Decided | Scheduled + On-Demand |
| FRED API | US Federal Reserve Economic Data | fred-api | |
To be Decided | On-Demand |
| EIA API | US Official Energy Statistics Data | eia-api | |
To be Decided | On-Demand |
| News API | Live Internet News Aggregated Data | news-api | |
To be Decided | On-Demand |
Academic Records
Probability and Statistics for Finance - Svetlozar, Rachev, Markus Hoechstoetter
Stochastic calculus for finance I: The binomial asset pricing model - Steven E. Shreve
Stochastic calculus for finance II Continuous time models - Steven E. Shreve\
Financial Models for Numerical Methods
UI UX Design
Bloomberg Charting
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.