p2p, p2p/discover: add dial metrics #27621
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lightclient
requested review from
karalabe,
holiman and
rjl493456442
as code owners
|
Okay I ended up realizing I could just make some measurements from the eth handshake and subtract those from the p2p dial "successes" to determine the number of peers we dial that turn into useful peers. |
lightclient
force-pushed
the
disc-metrics
branch
from
de7e5d7
to
2465a30
Compare
lightclient
force-pushed
the
disc-metrics
branch
from
2465a30
to
111fa80
Compare
|
This PR sucks. It should be closed immediately. |
|
Don't be impolite @anti-fjl! The PR is decent, just needs a bit of work to be fully correct. |
fjl
requested changes
Jun 30, 2023
|
I think there is some confusion about the term 'dial' here. In package p2p, when we say 'dial' we exclusively mean 'outbound connections created by us'. So the terms 'ingress' 'egress' cannot be applied to a dialed connection. |
lightclient
force-pushed
the
disc-metrics
branch
from
5bf3938
to
18c0cc7
Compare
|
Good point on the confusion of "dial" and ingress/egress. I've updated it in the PR and it should be fixed now. |
devopsbo3
pushed a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
devopsbo3
added a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This reverts commit 463ad60.
devopsbo3
added a commit
to HorizenOfficial/go-ethereum
that referenced
this pull request
Nov 10, 2023
This reverts commit 463ad60.
4 tasks
nibty
pushed a commit
to FairCrypto/go-ethereum
that referenced
this pull request
Apr 10, 2024
This PR adds metrics for p2p dialing, which gives us visibility into the quality of the dial candidates returned by our discovery methods.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds metrics for the p2p dialer, which gives us visibility into the quality of the dial candidates given to us by our discovery methods. This isn't quite a full picture though, because often once the dial completes, the subprotocols will then perform their handshakes. These frequently fail for a multitude of reasons: wrong chain, too many peers, etc. That isn't shown with these metrics.
This is the reason the "success" rate seems very high for a rather low peer count. Using discv4, around 28% we can connect to on RLPx, but many of them immediately disconnect during(fixed by tracking errors during handshake). With DNS discovery, the number is much lower because (presumably) they're already maxed out on peers due to the constant barrage of ingress connection requests they receive. So it takes longer to find a node with a free peer slot.ethhandshakingThe one notable change here other than the new metrics is moving
p2p/dialsandp2p/servesoutside ofmeteredConn. This seems to be nice because it reduces the noise of dialing on the metrics. Connections are only counted now if they reach the "peer added" checkpoint.Added Metrics
discover/bucket/{index}/count- the number of nodes in bucketindexeth/protocols/eth/{ingress|egress}/handshake/error/peer- unexpected peer behavioreth/protocols/eth/{ingress|egress}/handshake/error/timeout- handshake timeouteth/protocols/eth/{ingress|egress}/handshake/error/network- wrong network ideth/protocols/eth/{ingress|egress}/handshake/error/version- wrong protocol versioneth/protocols/eth/{ingress|egress}/handshake/error/genesis- wrong genesiseth/protocols/eth/{ingress|egress}/handshake/error/forkid- wrong forkideth/protocols/snap/{ingress|egress}/registration/error- error registering snap protocol (usually snap, but no eth)p2p/dials/success- the total number of dials that result in a peer being added to the peersetp2p/dials/error/connection- unable to initiate TCP connection to targetp2p/dials/error/saturated- local client is already connected to its maximum number of peersp2p/dials/error/known- dialing an already connected peerp2p/dials/error/self- dialing the local node's idp2p/dials/error/useless- dialing a peer that doesn't share an capabilities with the local nodep2p/dials/error/id/unexpected- dialed peer repsoned with different id than expectedp2p/dials/error/rlpx/enc- error negotiating the rlpx encryption during dialp2p/dials/error/rlpx/proto- error during rlpx protocol handshake`Mainnet (discv4 only)
Sepolia (discv4 only)
Dashboard
JSON
{ "annotations": { "list": [ { "builtIn": 1, "datasource": { "type": "datasource", "uid": "grafana" }, "enable": true, "hide": true, "iconColor": "rgba(0, 211, 255, 1)", "name": "Annotations & Alerts", "target": { "limit": 100, "matchAny": false, "tags": [], "type": "dashboard" }, "type": "dashboard" } ] }, "description": "A Prometheus metric dashboard for go-ethereum, supports all blockchains compatible with go-ethereum", "editable": true, "fiscalYearStartMonth": 0, "gnetId": 18463, "graphTooltip": 0, "id": 1, "links": [], "liveNow": false, "panels": [ { "collapsed": false, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 0 }, "id": 157, "panels": [], "title": "Discovery", "type": "row" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "max": 0.5, "noValue": "0", "thresholds": { "mode": "absolute", "steps": [ { "color": "red", "value": null }, { "color": "#EAB839", "value": 0.15 }, { "color": "green", "value": 0.3 } ] }, "unit": "percentunit" }, "overrides": [] }, "gridPos": { "h": 5, "w": 5, "x": 0, "y": 1 }, "id": 159, "options": { "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showThresholdLabels": false, "showThresholdMarkers": true }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "(rate(p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}[5m]) - rate(eth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}[5m])) / rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[5m])", "legendFormat": "__auto", "range": true, "refId": "A" } ], "title": "Dial Quality (5m)", "type": "gauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "right", "axisSoftMax": 0.5, "axisSoftMin": 0, "barAlignment": 0, "drawStyle": "line", "fillOpacity": 5, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineStyle": { "fill": "solid" }, "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [ { "matcher": { "id": "byName", "options": "connect rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "left" }, { "id": "unit", "value": "percentunit" } ] } ] }, "gridPos": { "h": 11, "w": 12, "x": 5, "y": 1 }, "id": 158, "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "(rate(p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"}[1m]) - rate(eth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}[1m])) / rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "instant": false, "interval": "", "legendFormat": "connect rate", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "attempts", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "peers", "range": true, "refId": "C" } ], "title": "Dial Quality", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "hideFrom": { "legend": false, "tooltip": false, "viz": false } }, "mappings": [] }, "overrides": [ { "matcher": { "id": "byName", "options": "rlpx proto error" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-purple", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "peer error" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-blue", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "wrong network id" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-red", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "connection error" }, "properties": [ { "id": "color", "value": { "fixedColor": "semi-dark-orange", "mode": "fixed" } } ] }, { "matcher": { "id": "byName", "options": "useless" }, "properties": [ { "id": "color", "value": { "fixedColor": "dark-yellow", "mode": "fixed" } } ] }, { "__systemRef": "hideSeriesFrom", "matcher": { "id": "byNames", "options": { "mode": "exclude", "names": [ "success", "already connected", "too many local peers", "useless", "self dial", "rlpx enc error", "rlpx proto error", "wrong genesis", "wrong network id", "eth handshake timeout", "wrong protocol version", "connection error" ], "prefix": "All except:", "readOnly": true } }, "properties": [ { "id": "custom.hideFrom", "value": { "legend": false, "tooltip": false, "viz": true } } ] }, { "matcher": { "id": "byName", "options": "already connected" }, "properties": [ { "id": "color", "value": { "fixedColor": "super-light-green", "mode": "fixed" } } ] } ] }, "gridPos": { "h": 11, "w": 7, "x": 17, "y": 1 }, "id": 161, "options": { "displayLabels": [ "percent" ], "legend": { "displayMode": "list", "placement": "bottom", "showLegend": true }, "pieType": "pie", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "tooltip": { "mode": "single", "sort": "none" } }, "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_success{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"} - eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"} -\neth_protocols_snap_egress_registration_error{chain=\"$chain\", instance=~\"$instance\"}", "legendFormat": "success", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_known{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "already connected", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_saturated{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "too many local peers", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_useless{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "useless", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_self{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "self dial", "range": true, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_rlpx_enc{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "rlpx enc error", "range": true, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_rlpx_proto{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "rlpx proto error", "range": true, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_dials_error_connection{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "connection error", "range": true, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_forkid{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong forkid", "range": true, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_genesis{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong genesis", "range": true, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_network{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong network id", "range": true, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_peer{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "peer error", "range": true, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "eth handshake timeout", "range": true, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "eth_protocols_eth_egress_handshake_error_version{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "wrong protocol version", "range": true, "refId": "N" } ], "title": "Dial Results", "type": "piechart" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "red", "value": null }, { "color": "yellow", "value": 5 }, { "color": "green", "value": 15 }, { "color": "blue", "value": 30 } ] } }, "overrides": [] }, "gridPos": { "h": 5, "w": 5, "x": 0, "y": 6 }, "id": 160, "options": { "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showThresholdLabels": false, "showThresholdMarkers": true }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "legendFormat": "__auto", "range": true, "refId": "A" } ], "title": "Peers", "type": "gauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 10, "w": 9, "x": 0, "y": 12 }, "id": 154, "options": { "displayMode": "gradient", "minVizHeight": 10, "minVizWidth": 0, "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "showUnfilled": true, "valueMode": "color" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_0_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "0", "range": false, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_1_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "1", "range": false, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_2_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "2", "range": false, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_3_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "3", "range": false, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_4_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "4", "range": false, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_5_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "5", "range": false, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_6_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "6", "range": false, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_7_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "7", "range": false, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_8_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "8", "range": false, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_9_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "9", "range": false, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_10_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "10", "range": false, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_11_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "11", "range": false, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_12_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "12", "range": false, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_13_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "13", "range": false, "refId": "N" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_14_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "14", "range": false, "refId": "O" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_15_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "15", "range": false, "refId": "P" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_16_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": true, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "16", "range": false, "refId": "Q" } ], "title": "kbuckets", "type": "bargauge" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*-flow$" }, "properties": [ { "id": "unit", "value": "decbytes" }, { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 10, "w": 15, "x": 9, "y": 12 }, "id": 156, "links": [], "options": { "legend": { "calcs": [ "mean", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(discover_ingress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ingress-rate", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(discover_egress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "egress-rate", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "discover_ingress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "igress-flow", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "discover_egress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "egress-flow", "range": true, "refId": "D" } ], "title": "Traffic", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 0, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "auto", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 10, "w": 9, "x": 0, "y": 22 }, "id": 155, "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_0_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "0", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_1_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "1", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_2_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "2", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_3_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "3", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_4_count{chain=\"$chain\", instance=~\"$instance\"}", "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "4", "range": true, "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_5_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "5", "range": true, "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_6_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "6", "range": true, "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_7_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "7", "range": true, "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_8_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "8", "range": true, "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_9_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "9", "range": true, "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_10_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "10", "range": true, "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_11_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "11", "range": true, "refId": "L" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_12_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "12", "range": true, "refId": "M" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_13_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "13", "range": true, "refId": "N" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_14_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "14", "range": true, "refId": "O" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_15_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "15", "range": true, "refId": "P" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "discover_bucket_16_count{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "key": "Q-2be36ee5-e2f7-481d-911d-2ea14c8898d7-0", "legendFormat": "16", "range": true, "refId": "Q" } ], "title": "kbuckets", "type": "timeseries" }, { "collapsed": false, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 32 }, "id": 4, "panels": [], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Blockchain", "type": "row" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 33 }, "id": 109, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_block{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "A" } ], "title": "Latest block", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [] }, "gridPos": { "h": 6, "w": 7, "x": 3, "y": 33 }, "id": 110, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_header{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "header", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_receipt{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "receipt", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_block{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "block", "refId": "C" } ], "title": "Chain head", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 3, "w": 2, "x": 10, "y": 33 }, "id": 152, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "chain_reorg_add{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "range": true, "refId": "A" } ], "title": "Chain Reorg Add", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 33 }, "id": 113, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_pending{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Executable transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [] }, "gridPos": { "h": 6, "w": 9, "x": 15, "y": 33 }, "id": 116, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_pending{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_queued{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "gapped", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_local{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "local", "refId": "C" } ], "title": "Transaction pool", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 35 }, "id": 108, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "chain_head_header{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "range": true, "refId": "A" } ], "title": "Latest header", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 35 }, "id": 115, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_local{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Local transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 3, "w": 2, "x": 10, "y": 36 }, "id": 153, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "chain_reorg_drop{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "range": true, "refId": "A" } ], "title": "Chain Reorg Drop", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 0, "y": 37 }, "id": 111, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_head_receipt{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "A" } ], "title": "Latest receipt", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [ { "options": { "match": "null", "result": { "text": "N/A" } }, "type": "special" } ], "thresholds": { "mode": "absolute", "steps": [ { "color": "green", "value": null } ] }, "unit": "locale" }, "overrides": [] }, "gridPos": { "h": 2, "w": 3, "x": 12, "y": 37 }, "id": 114, "links": [], "maxDataPoints": 100, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "horizontal", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "text": {}, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "txpool_queued{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "refId": "A" } ], "title": "Gapped transactions", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "normal" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 39 }, "id": 112, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_execution{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "execution (q=$quantile)", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_validation{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "validation (q=$quantile)", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_write{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "commit (q=$quantile)", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_reads{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account read (q=$quantile)", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_updates{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account update (q=$quantile)", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_hashes{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account hashe (q=$quantile)", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_account_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "account commit (q=$quantile)", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_reads{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage read (q=$quantile)", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_updates{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage update (q=$quantile)", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "chain_storage_hashes{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "storage hashe (q=$quantile)", "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_storage_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "storage commit (q=$quantile)", "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "chain_snapshot_commits{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}", "hide": false, "interval": "", "legendFormat": "snapshot commit (q=$quantile)", "refId": "L" } ], "title": "Block processing", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 39 }, "id": 117, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_valid{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "valid", "refId": "K" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_invalid{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "invalid", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_underpriced{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "underpriced", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_discard{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "executable discard", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_replace{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable replace", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_ratelimit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable ratelimit", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_pending_nofunds{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "executable nofunds", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_discard{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped discard", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_replace{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped replace", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_ratelimit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped ratelimit", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(txpool_queued_nofunds{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gapped nofunds", "refId": "J" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(txpool_known{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "legendFormat": "known", "range": true, "refId": "L" } ], "title": "Transaction propagation", "type": "timeseries" }, { "collapsed": true, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 47 }, "id": 149, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 82 }, "id": 150, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_success_count{instance=\"$instance\"}[5m])) by (chain, instance, method)", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" } ], "title": "Success RPC QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 82 }, "id": 147, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_failure_count{instance=\"$instance\"}[5m])) by (chain, instance, method)", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "hide": false, "refId": "B" } ], "title": "Failure RPC QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": false, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] }, "unit": "dtdurations" }, "overrides": [ { "matcher": { "id": "byName", "options": "debug_traceBlockByNumber" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 90 }, "id": 146, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "asc" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_success{quantile='$quantile', instance=\"$instance\"}[5m])) by (chain, instance, method) \n/ \nsum(rate(geth_rpc_requests_success_count{instance=\"$instance\"}[5m])) by (chain, instance, method) /1e6 \n< 1e200", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" } ], "title": "Success RPC Latency", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "dtdurations" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 12, "y": 90 }, "id": 151, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true, "sortBy": "Mean", "sortDesc": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "sum(rate(geth_rpc_requests_failure{quantile='$quantile', instance=\"$instance\"}[5m])) by (chain, instance, method) / sum(rate(geth_rpc_requests_failure_count{instance=\"$instance\"}[5m])) by (chain, instance, method) /1e6", "hide": false, "interval": "", "legendFormat": "{{method}}", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "hide": false, "refId": "B" } ], "title": "Failure RPC Latency", "type": "timeseries" } ], "title": "RPC", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 48 }, "id": 82, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "percent" }, "overrides": [ { "matcher": { "id": "byName", "options": "goroutines" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "short" } ] }, { "matcher": { "id": "byName", "options": "threads" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 8, "x": 0, "y": 83 }, "id": 106, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_sysload{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "system", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_syswait{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "iowait", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_procload{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "geth", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_goroutines{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "hide": false, "interval": "", "legendFormat": "goroutines", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "avg(system_cpu_threads{chain=\"$chain\", instance=~\"$instance\"}) by (instance)", "hide": false, "interval": "", "legendFormat": "threads", "refId": "E" } ], "title": "CPU", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [ { "__systemRef": "hideSeriesFrom", "matcher": { "id": "byNames", "options": { "mode": "exclude", "names": [ "used" ], "prefix": "All except:", "readOnly": true } }, "properties": [ { "id": "custom.hideFrom", "value": { "legend": false, "tooltip": false, "viz": true } } ] } ] }, "gridPos": { "h": 6, "w": 8, "x": 8, "y": 83 }, "id": 86, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_memory_allocs{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "alloc", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_used{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "used", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_held{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "held", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_frees{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "instant": false, "interval": "", "legendFormat": "free", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "system_memory_pauses{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "pause", "refId": "E" } ], "title": "Memory", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 8, "x": 16, "y": 83 }, "id": 85, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_disk_readbytes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "read", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(system_disk_writebytes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "write", "refId": "B" } ], "title": "Disk", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "System", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 49 }, "id": 75, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*-flow$" }, "properties": [ { "id": "unit", "value": "decbytes" }, { "id": "custom.axisPlacement", "value": "right" } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 84 }, "id": 96, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(p2p_ingress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ingress-rate", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(p2p_egress{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "egress-rate", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_ingress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "igress-flow", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "p2p_egress{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "legendFormat": "egress-flow", "range": true, "refId": "D" } ], "title": "Traffic", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "none" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 84 }, "id": 77, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "p2p_peers{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "peers", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(p2p_dials{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "dials", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(p2p_serves{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "serves", "refId": "C" } ], "title": "Peers", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Network", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 50 }, "id": 136, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in #peers per second", "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "#EAB839", "value": 30 }, { "color": "#6ED0E0", "value": 50 } ] }, "unit": "cps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 6, "x": 0, "y": 85 }, "id": 129, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Throttle", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 85 }, "id": 144, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": true, "interval": "", "intervalFactor": 1, "legendFormat": "throttle peers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies in", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "receipts in", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "bodies drop", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "headers drop", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "receipts drop", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "bodies timeout", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "headers timeout", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": true, "interval": "", "legendFormat": "receipts timeout", "refId": "J" } ], "title": "QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 91 }, "id": 145, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_throttle{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "hide": true, "interval": "", "intervalFactor": 1, "legendFormat": "throttle peers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "bodies in", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": true, "interval": "", "legendFormat": "receipts in", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "bodies drop", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "headers drop", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_drop{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "receipts drop", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_bodies_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "bodies timeout", "refId": "H" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_headers_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "headers timeout", "refId": "I" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_downloader_receipts_timeout{chain=\"$chain\", instance=~\"$instance\"}", "hide": false, "interval": "", "legendFormat": "receipts timeout", "refId": "J" } ], "title": "Abnormal QPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 91 }, "id": 130, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_bodies_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies(q={{quantile}})", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_headers_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers(q={{quantile}})", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_downloader_receipts_req{chain=\"$chain\", instance=~\"$instance\", quantile=\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "receipts(q={{quantile}})", "refId": "D" } ], "title": "Latency", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Downloader", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 51 }, "id": 134, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 0, "y": 86 }, "id": 138, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_waiting_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Waiting Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 2, "y": 86 }, "id": 141, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_waiting_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Waiting Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 4, "y": 86 }, "id": 140, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_queueing_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Queueing Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 6, "y": 86 }, "id": 139, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_queueing_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Queueing Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 8, "y": 86 }, "id": 142, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_fetching_peers{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Fetching Peers", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" } ] } }, "overrides": [] }, "gridPos": { "h": 4, "w": 2, "x": 10, "y": 86 }, "id": 143, "options": { "colorMode": "value", "graphMode": "none", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [ "lastNotNull" ], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_fetcher_transaction_fetching_hashes{chain=\"$chain\", instance=~\"$instance\"}", "interval": "", "legendFormat": "", "refId": "A" } ], "title": "Fetching Hashes", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [] }, "gridPos": { "h": 12, "w": 12, "x": 12, "y": 86 }, "id": 132, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request out", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_fail{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request fail", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_done{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request done", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_request_timeout{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "request timeout", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies in", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_known{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies known", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_underpriced{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies underpriced", "refId": "G" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_transaction_replies_otherreject{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "replies otherreject", "refId": "H" } ], "title": "QPS of Transaction", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "description": "Measured in blocks per second", "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "smooth", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "reqps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*(timeout|drop)" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "custom.axisSoftMax", "value": 100 }, { "id": "unit", "value": "short" } ] } ] }, "gridPos": { "h": 8, "w": 12, "x": 0, "y": 90 }, "id": 131, "links": [], "options": { "legend": { "calcs": [ "mean", "lastNotNull", "max", "min" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_bodies{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "bodies", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_headers{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "headers", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_headers_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter headers in", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_headers_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter headers out", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_bodies_in{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter bodies in", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_fetcher_block_filter_bodies_out{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "filter bodies out", "refId": "F" } ], "title": "QPS of Block", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Fetcher", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 52 }, "id": 17, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 7, "w": 12, "x": 0, "y": 87 }, "id": 35, "links": [], "options": { "legend": { "calcs": [ "mean", "min", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(eth_db_chaindata_disk_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ethdb read", "range": true, "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(eth_db_chaindata_disk_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "ethdb write", "range": true, "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": true, "expr": "rate(eth_db_chaindata_ancient_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "ancient read", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(eth_db_chaindata_ancient_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient write", "range": true, "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_input{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "compact read", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_output{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "compact write", "refId": "F" } ], "title": "Data rate", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [] }, "gridPos": { "h": 7, "w": 6, "x": 12, "y": 87 }, "id": 118, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_read{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb read", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_write{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb write", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_read{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient read", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_write{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient write", "refId": "D" } ], "title": "Session totals", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "decbytes" }, "overrides": [] }, "gridPos": { "h": 7, "w": 6, "x": 18, "y": 87 }, "id": 119, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_disk_size{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "leveldb", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "eth_db_chaindata_ancient_size{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "intervalFactor": 1, "legendFormat": "ancient", "refId": "A" } ], "title": "Storage size", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [ { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 4, "w": 3, "x": 0, "y": 94 }, "id": 127, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_db_chaindata_compact_writedelay_counter{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Compact Writedelay Count", "type": "stat" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "short" }, "overrides": [ { "matcher": { "id": "byName", "options": "time" }, "properties": [ { "id": "custom.lineWidth", "value": 3 }, { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "ns" } ] }, { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 8, "w": 21, "x": 3, "y": 94 }, "id": 121, "links": [], "options": { "legend": { "calcs": [ "mean", "min", "max" ], "displayMode": "table", "placement": "right", "showLegend": true }, "tooltip": { "mode": "multi", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_time{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "time", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_nonlevel0{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "level0", "refId": "A" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_level0{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "~level0", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_memory{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "mem", "refId": "D" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_seek{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "seek", "refId": "E" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_writedelay_duration{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "delay time", "refId": "F" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(eth_db_chaindata_compact_writedelay_counter{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "delay count", "refId": "G" } ], "title": "Compact", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "thresholds" }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [ { "matcher": { "id": "byName", "options": "time" }, "properties": [ { "id": "unit", "value": "ns" } ] }, { "matcher": { "id": "byName", "options": "delay time" }, "properties": [ { "id": "unit", "value": "ns" } ] } ] }, "gridPos": { "h": 4, "w": 3, "x": 0, "y": 98 }, "id": 128, "links": [], "options": { "colorMode": "value", "graphMode": "area", "justifyMode": "auto", "orientation": "auto", "reduceOptions": { "calcs": [], "fields": "", "values": false }, "textMode": "auto" }, "pluginVersion": "9.5.2", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "eth_db_chaindata_compact_writedelay_duration{chain=\"$chain\", instance=~\"$instance\"}", "format": "time_series", "interval": "", "intervalFactor": 1, "legendFormat": "", "refId": "B" } ], "title": "Compact Writedelay Duration", "type": "stat" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Database", "type": "row" }, { "collapsed": true, "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "gridPos": { "h": 1, "w": 24, "x": 0, "y": 53 }, "id": 37, "panels": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 88 }, "id": 120, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "min", "max" ], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "exemplar": false, "expr": "rate(trie_memcache_clean_read{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "instant": false, "intervalFactor": 1, "legendFormat": "read", "range": true, "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "editorMode": "code", "expr": "rate(trie_memcache_clean_write{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "write", "range": true, "refId": "B" } ], "title": "Clean cache-BPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "Bps" }, "overrides": [] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 88 }, "id": 56, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_gc_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_flush_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "intervalFactor": 1, "legendFormat": "overflow", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "expr": "rate(trie_memcache_commit_size{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "intervalFactor": 1, "legendFormat": "commit", "refId": "A" } ], "title": "Dirty cache-BPS", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "rps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "percentunit" }, { "id": "custom.lineWidth", "value": 2 }, { "id": "color", "value": { "mode": "continuous-RdYlGr" } } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 0, "y": 94 }, "id": 122, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "hit", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "miss", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])/(rate(trie_memcache_clean_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])+rate(trie_memcache_clean_hit{chain=\"$chain\", instance=~\"$instance\"}[1m]))", "hide": false, "interval": "", "legendFormat": "hit rate", "refId": "A" } ], "title": "Clean cache-Count", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "rps" }, "overrides": [ { "matcher": { "id": "byRegexp", "options": ".*rate" }, "properties": [ { "id": "custom.axisPlacement", "value": "right" }, { "id": "unit", "value": "percentunit" }, { "id": "custom.lineWidth", "value": 2 }, { "id": "color", "value": { "mode": "continuous-RdYlGr" } } ] } ] }, "gridPos": { "h": 6, "w": 12, "x": 12, "y": 94 }, "id": 124, "links": [], "options": { "legend": { "calcs": [], "displayMode": "list", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "hit", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "miss", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m])/(rate(trie_memcache_dirty_miss{chain=\"$chain\", instance=~\"$instance\"}[1m])+rate(trie_memcache_dirty_hit{chain=\"$chain\", instance=~\"$instance\"}[1m]))", "hide": false, "interval": "", "legendFormat": "hit rate", "refId": "A" } ], "title": "Dirty cache-Count", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "wps" }, "overrides": [] }, "gridPos": { "h": 9, "w": 12, "x": 0, "y": 100 }, "id": 125, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "mean", "min", "max" ], "displayMode": "table", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_gc_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_commit_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "commit", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_flush_nodes{chain=\"$chain\", instance=~\"$instance\"}[1m])", "hide": false, "interval": "", "legendFormat": "overflow", "refId": "A" } ], "title": "MPT-Nodes", "type": "timeseries" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "fieldConfig": { "defaults": { "color": { "mode": "palette-classic" }, "custom": { "axisCenteredZero": false, "axisColorMode": "text", "axisLabel": "", "axisPlacement": "auto", "barAlignment": 0, "drawStyle": "line", "fillOpacity": 10, "gradientMode": "none", "hideFrom": { "legend": false, "tooltip": false, "viz": false }, "lineInterpolation": "linear", "lineWidth": 1, "pointSize": 5, "scaleDistribution": { "type": "linear" }, "showPoints": "never", "spanNulls": true, "stacking": { "group": "A", "mode": "none" }, "thresholdsStyle": { "mode": "off" } }, "mappings": [], "thresholds": { "mode": "absolute", "steps": [ { "color": "green" }, { "color": "red", "value": 80 } ] }, "unit": "ns" }, "overrides": [] }, "gridPos": { "h": 9, "w": 12, "x": 12, "y": 100 }, "id": 126, "links": [], "options": { "legend": { "calcs": [ "lastNotNull", "mean", "min", "max" ], "displayMode": "table", "placement": "bottom", "showLegend": true }, "tooltip": { "mode": "single", "sort": "none" } }, "pluginVersion": "8.3.3", "targets": [ { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_gc_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "gc", "refId": "C" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_commit_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "format": "time_series", "hide": false, "interval": "", "intervalFactor": 1, "legendFormat": "commit", "refId": "B" }, { "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "exemplar": true, "expr": "rate(trie_memcache_flush_time{chain=\"$chain\", instance=~\"$instance\", quantile=~\"$quantile\"}[1m])", "hide": false, "interval": "", "legendFormat": "overflow", "refId": "A" } ], "title": "MPT-Time", "type": "timeseries" } ], "targets": [ { "datasource": { "type": "prometheus", "uid": "PBFA97CFB590B2093" }, "refId": "A" } ], "title": "Trie Stats", "type": "row" } ], "refresh": "10s", "revision": 1, "schemaVersion": 38, "style": "dark", "tags": [ "go-ethereum", "blockchain", "ethereum", "prometheus" ], "templating": { "list": [ { "current": { "selected": false, "text": "mainnet", "value": "mainnet" }, "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "definition": "label_values(chain_head_block{}, chain)", "description": "go-ethereum compatible chains", "hide": 0, "includeAll": false, "label": "chain", "multi": false, "name": "chain", "options": [], "query": { "query": "label_values(chain_head_block{}, chain)", "refId": "StandardVariableQuery" }, "refresh": 2, "regex": "", "skipUrlSync": false, "sort": 0, "type": "query" }, { "current": { "selected": false, "text": "asrock-boulder-02", "value": "asrock-boulder-02" }, "datasource": { "type": "prometheus", "uid": "ce6cc990-5b5c-46e8-ac79-e607ace03b57" }, "definition": "label_values(chain_head_block{chain=~\"$chain\"}, instance)", "hide": 0, "includeAll": false, "label": "instance", "multi": false, "name": "instance", "options": [], "query": { "query": "label_values(chain_head_block{chain=~\"$chain\"}, instance)", "refId": "StandardVariableQuery" }, "refresh": 1, "regex": "", "skipUrlSync": false, "sort": 0, "type": "query" }, { "current": { "selected": false, "text": "0.95", "value": "0.95" }, "hide": 0, "includeAll": false, "multi": false, "name": "quantile", "options": [ { "selected": false, "text": "0.5", "value": "0.5" }, { "selected": false, "text": "0.75", "value": "0.75" }, { "selected": true, "text": "0.95", "value": "0.95" }, { "selected": false, "text": "0.99", "value": "0.99" }, { "selected": false, "text": "0.999", "value": "0.999" }, { "selected": false, "text": "0.9999", "value": "0.9999" } ], "query": "0.5, 0.75, 0.95, 0.99, 0.999, 0.9999", "queryValue": "", "skipUrlSync": false, "type": "custom" } ] }, "time": { "from": "now-15m", "to": "now" }, "timepicker": { "refresh_intervals": [ "5s", "10s", "30s", "1m", "5m", "15m", "30m", "1h", "2h", "1d" ], "time_options": [ "5m", "15m", "1h", "6h", "12h", "24h", "2d", "7d", "30d" ] }, "timezone": "", "title": "Go-Ethereum-By-Instance", "uid": "MHrP4vo7i", "version": 20, "weekStart": "" }