feat: per HTTP handler metrics

[lidel]

This adds generic HTTP metrics

Per handler (ipfs, ipns, legacyKuboRpc)

• ipfs_http_requests_inflight (gauge)
  • partially closes Add metric with number of incoming/outgoing connections #112 (outgoing requests will be tracked in metric exposed by backed such as caboose)

Per handler/method/code:

• ipfs_http_requests_total (counter)
• ipfs_http_request_duration_seconds (summary)
  • partially closes More Metrics on TTLB #120, we see duration per status code, if we need more resolution then we need per response type metric like ipfs_http_gw_car_stream_fail_duration_seconds from feat(gw): add ipfs_http_gw_car_stream_fail_duration_seconds ipfs/boxo#312
• ipfs_http_request_size_bytes (summary)
• ipfs_http_response_size_bytes (summary)

Demo

cc @cameronwood @gmasgras (fyi)

Click to expand

# HELP ipfs_http_request_duration_seconds The HTTP request latencies in seconds.
# TYPE ipfs_http_request_duration_seconds summary
ipfs_http_request_duration_seconds{code="200",handler="ipfs",method="get",quantile="0.5"} 0.000620535
ipfs_http_request_duration_seconds{code="200",handler="ipfs",method="get",quantile="0.9"} 0.00075842
ipfs_http_request_duration_seconds{code="200",handler="ipfs",method="get",quantile="0.99"} 0.522976382
ipfs_http_request_duration_seconds_sum{code="200",handler="ipfs",method="get"} 0.5885777660000001
ipfs_http_request_duration_seconds_count{code="200",handler="ipfs",method="get"} 99
ipfs_http_request_duration_seconds{code="200",handler="ipns",method="get",quantile="0.5"} 0.407661731
ipfs_http_request_duration_seconds{code="200",handler="ipns",method="get",quantile="0.9"} 1.519944324
ipfs_http_request_duration_seconds{code="200",handler="ipns",method="get",quantile="0.99"} 1.694205379
ipfs_http_request_duration_seconds_sum{code="200",handler="ipns",method="get"} 10.605908031
ipfs_http_request_duration_seconds_count{code="200",handler="ipns",method="get"} 19
# HELP ipfs_http_request_size_bytes The HTTP request sizes in bytes.
# TYPE ipfs_http_request_size_bytes summary
ipfs_http_request_size_bytes{code="200",handler="ipfs",method="get",quantile="0.5"} 119
ipfs_http_request_size_bytes{code="200",handler="ipfs",method="get",quantile="0.9"} 119
ipfs_http_request_size_bytes{code="200",handler="ipfs",method="get",quantile="0.99"} 525
ipfs_http_request_size_bytes_sum{code="200",handler="ipfs",method="get"} 12187
ipfs_http_request_size_bytes_count{code="200",handler="ipfs",method="get"} 99
ipfs_http_request_size_bytes{code="200",handler="ipns",method="get",quantile="0.5"} 485
ipfs_http_request_size_bytes{code="200",handler="ipns",method="get",quantile="0.9"} 548
ipfs_http_request_size_bytes{code="200",handler="ipns",method="get",quantile="0.99"} 670
ipfs_http_request_size_bytes_sum{code="200",handler="ipns",method="get"} 9661
ipfs_http_request_size_bytes_count{code="200",handler="ipns",method="get"} 19
# HELP ipfs_http_requests_inflight Tracks the number of HTTP client requests currently in progress.
# TYPE ipfs_http_requests_inflight gauge
ipfs_http_requests_inflight{handler="ipfs"} 0
ipfs_http_requests_inflight{handler="ipns"} 1
ipfs_http_requests_inflight{handler="kuboRpc"} 0
# HELP ipfs_http_requests_total Total number of HTTP requests made.
# TYPE ipfs_http_requests_total counter
ipfs_http_requests_total{code="200",handler="ipfs",method="get"} 99
ipfs_http_requests_total{code="200",handler="ipns",method="get"} 19
# HELP ipfs_http_response_size_bytes The HTTP response sizes in bytes.
# TYPE ipfs_http_response_size_bytes summary
ipfs_http_response_size_bytes{code="200",handler="ipfs",method="get",quantile="0.5"} 119762
ipfs_http_response_size_bytes{code="200",handler="ipfs",method="get",quantile="0.9"} 119762
ipfs_http_response_size_bytes{code="200",handler="ipfs",method="get",quantile="0.99"} 119762
ipfs_http_response_size_bytes_sum{code="200",handler="ipfs",method="get"} 1.1856438e+07
ipfs_http_response_size_bytes_count{code="200",handler="ipfs",method="get"} 99
ipfs_http_response_size_bytes{code="200",handler="ipns",method="get",quantile="0.5"} 6398
ipfs_http_response_size_bytes{code="200",handler="ipns",method="get",quantile="0.9"} 153909
ipfs_http_response_size_bytes{code="200",handler="ipns",method="get",quantile="0.99"} 328521
ipfs_http_response_size_bytes_sum{code="200",handler="ipns",method="get"} 784726
ipfs_http_response_size_bytes_count{code="200",handler="ipns",method="get"} 19

[gmasgras]

This is great! Could we also get quantile="0.95" ? It's the most used quantile in our dashboards 🙇‍♂️

[lidel]

Added P75 and P95. Merging :)