-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Metric relabel ignored #33089
Comments
Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
Either method should work. Can you reproduce it with the collector's self-observability metrics, like in the readme?
|
In theory, yes, in practice, I wouldn't have the soul as an OSS maintainer myself, to make this up, no.
I haven't tried |
receivers:
prometheus:
config:
global:
scrape_interval: 1m
scrape_timeout: 40s
external_labels:
cluster: our-cluster-name Neither |
Actually, I may have spoken too soon. It seems like it works in a rather...strange way. The global config above should add that label to every metric, alas, it does not. Some metrics are suspiciously missing it. Example: Seems like a very strange heisenbug 🫠 😮💨 |
This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping Pinging code owners:
See Adding Labels via Comments if you do not have permissions to add labels yourself. |
FYI: This is still an issue. |
Component(s)
receiver/prometheus
Describe the issue you're reporting
This was originally raised in open-telemetry/opentelemetry-operator#2961
We have a small EKS cluster that runs
kube-state-metrics
for reporting the metrics from it.The metrics are scraped by adot collector which has the following scrape config (the rest of the config is omitted):
This should add
cluster="cluster-name"
label to every metric scraped fromkube-state-metrics
job alas, it's completely ignored for some reason.Other things we've tried:
I am not sure if this is a bug or if we are missing something here, but this seems like it should work as it works for other prometheus scrapers. Equally, if you check https://relabeler.promlabs.com/ this should add the cluster label in. If anyone has any ideas that'd be greatly appreciated!
The text was updated successfully, but these errors were encountered: