Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Track additional metrics around resource consumption #5304

Closed
4 tasks done
gnunicorn opened this issue Mar 18, 2020 · 0 comments
Closed
4 tasks done

Track additional metrics around resource consumption #5304

gnunicorn opened this issue Mar 18, 2020 · 0 comments

Comments

@gnunicorn
Copy link
Contributor

gnunicorn commented Mar 18, 2020 •
edited by the-right-joyce
Loading

On Kusama, we see weird behaviors around some resource consumption of our process. Specifically around resources needed for networking. To make debugging easier, we should track a few more metrics around that via prometheus:

  • num open connections
  • num of open streams
  • num of open sockets / connections by the system (lsof-style)
  • total number of open files

Any other suggestions of resources we are not tracking yet but would be useful to?

Refs #4679 .
@gnunicorn gnunicorn added the Z1-easy Can be fixed primarily by duplicating and adapting code by an intermediate coder label Mar 18, 2020
@gnunicorn gnunicorn mentioned this issue Mar 26, 2020
Merged
8 tasks
gnunicorn added a commit that referenced this issue Apr 4, 2020
@gnunicorn @mxinden @expenses
Additional Metrics collected and exposed via prometheus (#5414)
8991aab 
This PR refactors the metrics measuring and Prometheus exposing entity in sc-service into its own submodule and extends the parameters it exposes by:

- system load average (over one, five and 15min)
- the TCP connection state of the process (lsof), refs #5304
- number of tokio threads
- number of known forks
- counter for items in each unbounded queue (with internal unbounded channels)
- number of file descriptors opened by this process (*nix only at this point)
- number of system threads (*nix only at this point)

refs #4679

Co-authored-by: Max Inden <mail@max-inden.de>
Co-authored-by: Ashley <ashley.ruglys@gmail.com>
@andresilva andresilva moved this to In Progress 🛠 in SDK Node Apr 26, 2022
@the-right-joyce the-right-joyce removed the Z1-easy Can be fixed primarily by duplicating and adapting code by an intermediate coder label Apr 26, 2022
@the-right-joyce the-right-joyce moved this from In Progress 🛠 to Done ✅ in SDK Node May 11, 2022
Repository owner moved this from Done ✅ to Blocked ⛔️ in SDK Node May 11, 2022
@the-right-joyce the-right-joyce moved this from Blocked ⛔️ to Done ✅ in SDK Node May 11, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
SDK Node
Status: done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gnunicorn @the-right-joyce