The ledger importer utilizes Storm to process incoming ledgers and transactions in real time. Transactions are parsed into formats useful for analytics and reporting, and aggregated in various ways suitable for reporting network statistics, monitoring, and visualizing data.
The Storm Ledger Importer requires the following software installed first:
- Node.js
- npm
- git
- Apache Storm
- Apache Maven
- HBase Hbase and thrift server required
- install dependencies
- clone this repository
- from the main directory, run
npm install
- update
config/import.config.json
to point to your Hbase thrift server - to run locally:
- adjust storm parallelism as needed in
storm/local/config.properties
- from the command line, run `storm/local/deploy.sh'
- adjust storm parallelism as needed in
- to deploy to a storm cluster:
- adjust storm parallelism as needed in
storm/production/config.properties
- from the command line, run:
storm/production/importer.sh start
to start,storm/production/importer.sh stop
to stop, orstorm/production/importer.sh restart
to restart
- adjust storm parallelism as needed in