[kube-prometheus-stack] Scraping of kube-state-metrics broken after update v45.2.0

[ldunkum]

Describe the bug a clear and concise description of what the bug is.

We updated to the Chart version v45.2.0 earlier today and since the kube-state-metrics Endpoint is in state down with the following error kube-state-metrics: proto: wrong wireType = 0 for field Metric.

As v45.2.0 introduces kube-state-metrics v2.8.0 (app version), on the first glance it seems like the bug might be related to the feature introduced in kubernetes/kube-state-metrics#1974.

After reverting the update, kube-state-metrics metrics are accessible again.

What's your helm version?

v3.11.0

What's your kubectl version?

v1.26.1

Which chart?

kube-prometheus-stack

What's the chart version?

v45.2.0

What happened?

No response

What you expected to happen?

No response

How to reproduce it?

No response

Enter the changed values of values.yaml?

No response

Enter the command that you execute and failing/misfunctioning.

Anything else we need to know?

No response

[ben5556]

@ldunkum I think I hit this issue too. I don't see kube_pod* and other related metrics in Prometheus UI. What version did you revert to, to fix the issue ? Thanks

[ldunkum]

@ben5556 We reverted to v45.1.1, if you need any more confirmation, you can check Status → Targets and filter by unhealthy in the Prometheus UI.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Any further update will cause the issue/pull request to no longer be considered stale. Thank you for your contributions.

[stale]

This issue is being automatically closed due to inactivity.