Enable metrics-scraping

[bavarianbidi]

/kind feature

Describe the solution you'd like
I created PR 📖 document metrics scraping and enable metrics services via annotations at CAPI and also some PRs on other infraproviders to document how to setup all the RBAC stuff together with kube-rbac-proxy and prometheus to scrape metrics from CAPI containers.

The annotation already exist at capz but was removed last year with this commit in PR #1019 by @devigned

Using the prometheus-operator is definitely a valid solution to bring some observability in a cluster, but imho using a "simple" prometheus deployment/statefulset with a very common config is also very proven in a k8s environment.

would you accept a PR, where i set some annotations on the metrics-service?

metadata:
  annotations:
    prometheus.io/scrape: "true"
    prometheus.io/port: "8443"
    prometheus.io/scheme: "https"

• new PRs:
  • CAPI
  • Packet - merged
  • IBM Cloud - merged
  • DigitalOcean - merged
• annotation already exist:
  • AWS
  • Metal3
  • GCP
  • OpenStack
  • vSphere

[CecileRobertMichon]

would you accept a PR, where i set some annotations on the metrics-service?

@bavarianbidi, yes please go ahead and open a PR to add it back