-
Notifications
You must be signed in to change notification settings - Fork 0
meeting public dashboard 2024 07 05
Kenneth Hoste edited this page Aug 9, 2024
·
1 revision
attending: Satish, Maksim, CaspEr (SURF), Kenneth + Lara (HPC-UGent)
- setup
- JSON data coming from ReFrame, pre-processed with a Python script
- fed into ElasticSearch (ES)
- visualisation frontend using Vue.js + D3.js, with a Python script in between to access data from ES
- dashboard with performance results looking good
- historical data per system/test
- several options to explore the data
- visualisation frontend using Vue.js + D3.js
- card view with status of software on different systems (WIP)
- intent to make initial view 2D: software vs systems (general status)
- 2nd level view: different runs per software across different systems + status
- colors:
- green: all OK
- yellow: some problems (only regressions)
- red: some failures (on some systems)
- input data
- currently manually ingested based on JSON data produced by ReFrame on different systems
- would be nice to provide API so additional data can be pushed in from different systems
- with some form of authentication (tokens, etc.)
- ideally we also have a backup of the raw data in a central location (S3 bucket?)
- should also do data validation (compare MD5 checksum), to avoid that data points are ingested in Elasticsearch multiple times
- next meeting
- Fri 9 August 2024
- could discuss how to migrate the setup to a VM managed by EESSI team