-
Notifications
You must be signed in to change notification settings - Fork 883
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
helm install chart failed: failed pre-install: timed out waiting for the condition / job failed: BackoffLimitExceeded #3905
Comments
/assign chaosi-zju |
I got the bug report today in two scenes (using a 1、DNS broken Phenomenon: ➜ karmada git:(dev) kubectl get pods -o wide -A
NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
karmada-system karmada-pre-install-6ppns 0/1 Init:ImagePullBackOff 0 12m 10.244.0.5 host-control-plane <none> <none>
...
➜ karmada git:(dev) kubectl describe pods karmada-pre-install-6ppns -n karmada-system
...
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 12m default-scheduler Successfully assigned karmada-system/karmada-pre-install-6ppns to host-control-plane
Warning Failed 9m38s kubelet Failed to pull image "docker.io/cfssl/cfssl:latest": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/cfssl/cfssl:latest": failed to copy: httpReadSeeker: failed open: failed to do request: Get "https://registry-1.docker.io/v2/cfssl/cfssl/blobs/sha256:5997e4205ef719aca0e749aaed2000f49a2485a8f3f6861ad9582f90395754c5": dial tcp: lookup registry-1.docker.io on 172.18.0.1:53: no such host Solution: append below text to nameserver 8.8.8.8 2、Too slow to pull images Phenomenon: if it is too slow to pull ➜ karmada git:(dev) kubectl describe pods karmada-pre-install-6ppns -n karmada-system
...
Warning Failed 46s kubelet Failed to pull image "docker.io/cfssl/cfssl:latest": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/cfssl/cfssl:latest": failed to read expected number of bytes: unexpected EOF
Warning Failed 46s kubelet Error: ErrImagePull
Normal BackOff 46s kubelet Back-off pulling image "docker.io/cfssl/cfssl:latest" if it is too slow to pull other images, you will see: ➜ karmada git:(dev) helm install karmada -n karmada-system --create-namespace --dependency-update ./charts/karmada --debug
...
client.go:773: [debug] karmada-post-install: Jobs active: 0, jobs failed: 6, jobs succeeded: 0
client.go:734: [debug] Add/Modify event for karmada-post-install: MODIFIED
Error: INSTALLATION FAILED: failed post-install: 1 error occurred:
* job failed: BackoffLimitExceeded
helm.go:84: [debug] failed post-install: 1 error occurred:
* job failed: BackoffLimitExceeded Solution: pull image by kind create cluster --name karmada-host --kubeconfig ~/.kube/config --image kindest/node:v1.26.0
cat >/tmp/pull-image.sh<<EOF
#!/bin/bash
docker pull docker.io/cfssl/cfssl:latest
docker pull docker.io/bitnami/kubectl:latest
docker pull docker.io/karmada/karmada-scheduler:latest
docker pull docker.io/karmada/karmada-webhook:latest
docker pull docker.io/karmada/karmada-controller-manager:latest
docker pull docker.io/karmada/karmada-aggregated-apiserver:latest
docker pull docker.io/karmada/karmada-agent:latest
docker pull docker.io/karmada/karmada-scheduler-estimator:latest
docker pull docker.io/karmada/karmada-descheduler:latest
docker pull docker.io/karmada/karmada-search:latest
docker pull registry.k8s.io/kube-controller-manager:v1.25.4
docker pull registry.k8s.io/kube-apiserver:v1.25.4
docker pull registry.k8s.io/etcd:3.5.9-0
kind load docker-image docker.io/cfssl/cfssl:latest --name karmada-host
kind load docker-image docker.io/bitnami/kubectl:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-scheduler:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-webhook:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-controller-manager:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-aggregated-apiserver:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-agent:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-scheduler-estimator:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-descheduler:latest --name karmada-host
kind load docker-image docker.io/karmada/karmada-search:latest --name karmada-host
kind load docker-image registry.k8s.io/kube-apiserver:v1.25.4 --name karmada-host
kind load docker-image registry.k8s.io/kube-controller-manager:v1.25.4 --name karmada-host
kind load docker-image registry.k8s.io/etcd:3.5.9-0 --name karmada-host
EOF
bash /tmp/pull-image.sh
git clone https://github.com/karmada-io/karmada
cd karmada
helm install karmada -n karmada-system --create-namespace --dependency-update ./charts/karmada --debug
then, the |
/remove-kind bug |
/close |
What happened:
What you expected to happen:
install success
How to reproduce it (as minimally and precisely as possible):
Anything else we need to know?:
Environment:
kubectl-karmada version
orkarmadactl version
):The text was updated successfully, but these errors were encountered: