Continuous ApplyingManifest events

[piercsi]

Every 3 minutes I get this slew of events starting with "Applying manifest at ":

kube-system           78s         Normal    ApplyingManifest                 addon/ccm                                                             Applying manifest at "/var/lib/rancher/k3s/server/manifests/ccm.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/coredns                                                         Applying manifest at "/var/lib/rancher/k3s/server/manifests/coredns.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/local-storage                                                   Applying manifest at "/var/lib/rancher/k3s/server/manifests/local-storage.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/aggregated-metrics-reader                                       Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/auth-delegator                                                  Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/auth-reader                                                     Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/metrics-apiservice                                              Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/metrics-server-deployment                                       Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/metrics-server-service                                          Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/resource-reader                                                 Applying manifest at "/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/rolebindings                                                    Applying manifest at "/var/lib/rancher/k3s/server/manifests/rolebindings.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/runtimes                                                        Applying manifest at "/var/lib/rancher/k3s/server/manifests/runtimes.yaml"
kube-system           78s         Normal    ApplyingManifest                 addon/traefik                                                         Applying manifest at "/var/lib/rancher/k3s/server/manifests/traefik.yaml"

In journalctl I also get:

time="2024-07-23T17:32:34Z" level=error msg="Failed to process config: failed to process /var/lib/rancher/k3s/server/manifests/coredns.yaml: failed to create kube-system/kube-dns /v1, Kind=Service for kube-system/coredns: Service "kube-dns" is invalid: spec.clusterIPs: Invalid value: []string{"10.43.0.10"}: failed to allocate IP 10.43.0.10: provided IP is already allocated"

Can anyone shed any light on these? The cluster operations seem fine. k3s v1.29.4+k3s1

[shakibamoshiri]

failed to allocate IP 10.43.0.10: provided IP is already allocated

The default IP for DNS of the cluster is 10.43.0.10 which in your case seems to be used by another service
Check or change your default setting for networking parts

read the dock https://docs.k3s.io/networking/basic-network-options

[piercsi]

In the end I deleted my coredns deployment, restarted k3s, let it recreate the coredns setup, and all is ok.