Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I,m try use sealer Clusterfile install k8s ,is failed, #2315

Closed
summer908 opened this issue Nov 2, 2023 · 2 comments
Closed

I,m try use sealer Clusterfile install k8s ,is failed, #2315

summer908 opened this issue Nov 2, 2023 · 2 comments
Labels
kind/bug Something isn't working

Comments

@summer908
Copy link

What happen?

[cError: failed to init master0 init master0 failed, error: [ssh][10.10.5.12]run command failed [kubeadm init --config=/var/lib/sealer/data/my-cluster/rootfs/kubeadm-config.yaml --upload-certs -v 6 --ignore-preflight-errors=SystemVerification]. Please clean and reinstall

2023-11-01 17:37:37 [ERROR] [root.go:75] sealer-v0.9.2: failed to init master0: failed to execute command(kubeadm init --config=/etc/kubernetes/kubeadm.yaml --upload-certs -v 6 --ignore-preflight-errors=SystemVerification,Port-10250,DirAvailable--etc-kubernetes-manifests) on host(10.10.5.12): error(I1101 17:34:57.650328 217517 initconfiguration.go:201] loading configuration from "/etc/kubernetes/kubeadm.yaml"
W1101 17:34:57.657902 217517 strict.go:54] error unmarshaling configuration schema.GroupVersionKind{Group:"kubelet.config.k8s.io", Version:"v1beta1", Kind:"KubeletConfiguration"}: error unmarshaling JSON: while decoding JSON: json: unknown field "flushFrequency"
W1101 17:34:57.662247 217517 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10 10.96.0.10]
W1101 17:34:57.662276 217517 utils.go:69] The recommended value for "readOnlyPort" in "KubeletConfiguration" is: 0; the provided value is: 10255
I1101 17:34:57.743375 217517 certs.go:474] validating certificate period for CA certificate
I1101 17:34:57.743711 217517 certs.go:474] validating certificate period for front-proxy CA certificate
I1101 17:34:57.744068 217517 checks.go:577] validating Kubernetes and kubeadm version
I1101 17:34:57.744135 217517 checks.go:166] validating if the firewall is enabled and active
I1101 17:34:57.758096 217517 checks.go:201] validating availability of port 6443
I1101 17:34:57.758368 217517 checks.go:201] validating availability of port 10259
I1101 17:34:57.758420 217517 checks.go:201] validating availability of port 10257
I1101 17:34:57.758476 217517 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml
I1101 17:34:57.758507 217517 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml
I1101 17:34:57.758532 217517 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml
I1101 17:34:57.758550 217517 checks.go:286] validating the existence of file /etc/kubernetes/manifests/etcd.yaml
I1101 17:34:57.758584 217517 checks.go:432] validating if the connectivity type is via proxy or direct
I1101 17:34:57.758660 217517 checks.go:471] validating http connectivity to first IP address in the CIDR
I1101 17:34:57.758723 217517 checks.go:471] validating http connectivity to first IP address in the CIDR
I1101 17:34:57.758755 217517 checks.go:471] validating http connectivity to first IP address in the CIDR
I1101 17:34:57.758781 217517 checks.go:471] validating http connectivity to first IP address in the CIDR
I1101 17:34:57.758804 217517 checks.go:102] validating the container runtime
I1101 17:34:57.816490 217517 checks.go:128] validating if the "docker" service is enabled and active
I1101 17:34:57.883507 217517 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables
I1101 17:34:57.883635 217517 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward
I1101 17:34:57.883707 217517 checks.go:649] validating whether swap is enabled or not
I1101 17:34:57.883774 217517 checks.go:376] validating the presence of executable conntrack
I1101 17:34:57.883825 217517 checks.go:376] validating the presence of executable ip
I1101 17:34:57.883858 217517 checks.go:376] validating the presence of executable iptables
I1101 17:34:57.883906 217517 checks.go:376] validating the presence of executable mount
I1101 17:34:57.883942 217517 checks.go:376] validating the presence of executable nsenter
I1101 17:34:57.884001 217517 checks.go:376] validating the presence of executable ebtables
I1101 17:34:57.884034 217517 checks.go:376] validating the presence of executable ethtool
I1101 17:34:57.884066 217517 checks.go:376] validating the presence of executable socat
I1101 17:34:57.884102 217517 checks.go:376] validating the presence of executable tc
I1101 17:34:57.884132 217517 checks.go:376] validating the presence of executable touch
I1101 17:34:57.884173 217517 checks.go:520] running all checks
I1101 17:34:57.901247 217517 checks.go:406] checking whether the given node name is reachable using net.LookupHost
[WARNING Hostname]: hostname "master01" could not be reached
[WARNING Hostname]: hostname "master01": lookup master01 on 8.8.8.8:53: no such host
I1101 17:34:57.975708 217517 checks.go:618] validating kubelet version
I1101 17:34:58.106547 217517 checks.go:128] validating if the "kubelet" service is enabled and active
I1101 17:34:58.119462 217517 checks.go:201] validating availability of port 10250
I1101 17:34:58.119559 217517 checks.go:201] validating availability of port 2379
I1101 17:34:58.119615 217517 checks.go:201] validating availability of port 2380
I1101 17:34:58.119668 217517 checks.go:249] validating the existence and emptiness of directory /var/lib/etcd
I1101 17:34:58.181678 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/kube-apiserver:v1.20.11-aliyun.1
I1101 17:35:02.778723 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/kube-controller-manager:v1.20.11-aliyun.1
I1101 17:35:05.436519 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/kube-scheduler:v1.20.11-aliyun.1
I1101 17:35:08.067124 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/kube-proxy:v1.20.11-aliyun.1
I1101 17:35:12.817628 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/pause:3.2
I1101 17:35:13.095807 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/etcd:3.5.4
I1101 17:35:20.303985 217517 checks.go:845] pulling sea.hub:5000/ecp_builder/coredns:v1.8.4.5-2ce07fd2-aliyun
I1101 17:35:21.577948 217517 certs.go:474] validating certificate period for ca certificate
I1101 17:35:21.578861 217517 certs.go:474] validating certificate period for apiserver certificate
I1101 17:35:21.579903 217517 certs.go:474] validating certificate period for apiserver-kubelet-client certificate
I1101 17:35:21.580593 217517 certs.go:474] validating certificate period for front-proxy-ca certificate
I1101 17:35:21.581263 217517 certs.go:474] validating certificate period for front-proxy-client certificate
I1101 17:35:21.581873 217517 certs.go:474] validating certificate period for etcd/ca certificate
I1101 17:35:21.582580 217517 certs.go:474] validating certificate period for etcd/server certificate
I1101 17:35:21.583387 217517 certs.go:474] validating certificate period for etcd/peer certificate
I1101 17:35:21.584154 217517 certs.go:474] validating certificate period for etcd/healthcheck-client certificate
I1101 17:35:21.584909 217517 certs.go:474] validating certificate period for apiserver-etcd-client certificate
I1101 17:35:21.585364 217517 certs.go:76] creating new public/private key files for signing service account users
I1101 17:35:21.585604 217517 kubeconfig.go:101] creating kubeconfig file for admin.conf
I1101 17:35:21.780881 217517 loader.go:379] Config loaded from file: /etc/kubernetes/admin.conf
I1101 17:35:21.780900 217517 kubeconfig.go:101] creating kubeconfig file for kubelet.conf
I1101 17:35:21.832603 217517 loader.go:379] Config loaded from file: /etc/kubernetes/kubelet.conf
I1101 17:35:21.832617 217517 kubeconfig.go:101] creating kubeconfig file for controller-manager.conf
I1101 17:35:21.995081 217517 loader.go:379] Config loaded from file: /etc/kubernetes/controller-manager.conf
W1101 17:35:21.995091 217517 kubeconfig.go:246] a kubeconfig file "/etc/kubernetes/controller-manager.conf" exists already but has an unexpected API Server URL: expected: https://10.10.5.12:6443, got: https://apiserver.cluster.local:6443
I1101 17:35:21.995100 217517 kubeconfig.go:101] creating kubeconfig file for scheduler.conf
I1101 17:35:22.575859 217517 loader.go:379] Config loaded from file: /etc/kubernetes/scheduler.conf
W1101 17:35:22.575881 217517 kubeconfig.go:246] a kubeconfig file "/etc/kubernetes/scheduler.conf" exists already but has an unexpected API Server URL: expected: https://10.10.5.12:6443, got: https://apiserver.cluster.local:6443
I1101 17:35:22.575900 217517 kubelet.go:63] Stopping the kubelet
I1101 17:35:22.816430 217517 manifests.go:96] [control-plane] getting StaticPodSpecs
I1101 17:35:22.817193 217517 manifests.go:109] [control-plane] adding volume "audit" for component "kube-apiserver"
I1101 17:35:22.817210 217517 manifests.go:109] [control-plane] adding volume "audit-log" for component "kube-apiserver"
I1101 17:35:22.817219 217517 manifests.go:109] [control-plane] adding volume "ca-certs" for component "kube-apiserver"
I1101 17:35:22.817227 217517 manifests.go:109] [control-plane] adding volume "etc-pki" for component "kube-apiserver"
I1101 17:35:22.817236 217517 manifests.go:109] [control-plane] adding volume "k8s-certs" for component "kube-apiserver"
I1101 17:35:22.817245 217517 manifests.go:109] [control-plane] adding volume "localtime" for component "kube-apiserver"
I1101 17:35:22.828551 217517 manifests.go:126] [control-plane] wrote static Pod manifest for component "kube-apiserver" to "/etc/kubernetes/manifests/kube-apiserver.yaml"
I1101 17:35:22.828571 217517 manifests.go:96] [control-plane] getting StaticPodSpecs
I1101 17:35:22.828881 217517 manifests.go:109] [control-plane] adding volume "ca-certs" for component "kube-controller-manager"
I1101 17:35:22.828891 217517 manifests.go:109] [control-plane] adding volume "etc-pki" for component "kube-controller-manager"
I1101 17:35:22.828898 217517 manifests.go:109] [control-plane] adding volume "flexvolume-dir" for component "kube-controller-manager"
I1101 17:35:22.828904 217517 manifests.go:109] [control-plane] adding volume "k8s-certs" for component "kube-controller-manager"
I1101 17:35:22.828909 217517 manifests.go:109] [control-plane] adding volume "kubeconfig" for component "kube-controller-manager"
I1101 17:35:22.828914 217517 manifests.go:109] [control-plane] adding volume "localtime" for component "kube-controller-manager"
I1101 17:35:22.829837 217517 manifests.go:126] [control-plane] wrote static Pod manifest for component "kube-controller-manager" to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
I1101 17:35:22.829854 217517 manifests.go:96] [control-plane] getting StaticPodSpecs
I1101 17:35:22.830158 217517 manifests.go:109] [control-plane] adding volume "admin-config" for component "kube-scheduler"
I1101 17:35:22.830169 217517 manifests.go:109] [control-plane] adding volume "kubeconfig" for component "kube-scheduler"
I1101 17:35:22.830178 217517 manifests.go:109] [control-plane] adding volume "localtime" for component "kube-scheduler"
I1101 17:35:22.830184 217517 manifests.go:109] [control-plane] adding volume "scheduler-config" for component "kube-scheduler"
I1101 17:35:22.830893 217517 manifests.go:126] [control-plane] wrote static Pod manifest for component "kube-scheduler" to "/etc/kubernetes/manifests/kube-scheduler.yaml"
I1101 17:35:22.834849 217517 local.go:74] [etcd] wrote Static Pod manifest for a local etcd member to "/etc/kubernetes/manifests/etcd.yaml"
I1101 17:35:22.834906 217517 waitcontrolplane.go:87] [wait-control-plane] Waiting for the API server to be healthy
I1101 17:35:22.836020 217517 loader.go:379] Config loaded from file: /etc/kubernetes/admin.conf
I1101 17:35:22.839020 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:23.340372 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:23.840709 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:24.341149 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:24.840772 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:25.340465 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:25.840707 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:26.340369 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:26.840163 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:27.340214 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:27.840376 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:28.340563 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:28.840794 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:29.340632 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:29.839826 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:30.340073 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:30.839878 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:31.339850 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:31.839605 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s in 0 milliseconds
I1101 17:35:35.901321 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s 500 Internal Server Error in 3561 milliseconds
I1101 17:35:36.341649 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s 500 Internal Server Error in 2 milliseconds
I1101 17:35:36.842226 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s 500 Internal Server Error in 2 milliseconds
I1101 17:35:37.341143 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/healthz?timeout=10s 200 OK in 1 milliseconds
I1101 17:35:37.341235 217517 uploadconfig.go:108] [upload-config] Uploading the kubeadm ClusterConfiguration to a ConfigMap
I1101 17:35:37.346297 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 3 milliseconds
I1101 17:35:37.349555 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 2 milliseconds
I1101 17:35:37.353252 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 3 milliseconds
I1101 17:35:37.353661 217517 uploadconfig.go:122] [upload-config] Uploading the kubelet component config to a ConfigMap
I1101 17:35:37.356881 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/api/v1/namespaces/kube-system/configmaps?timeout=10s 201 Created in 2 milliseconds
I1101 17:35:37.360199 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/roles?timeout=10s 201 Created in 2 milliseconds
I1101 17:35:37.362886 217517 round_trippers.go:445] POST https://apiserver.cluster.local:6443/apis/rbac.authorization.k8s.io/v1/namespaces/kube-system/rolebindings?timeout=10s 201 Created in 2 milliseconds
I1101 17:35:37.363111 217517 uploadconfig.go:127] [upload-config] Preserving the CRISocket information for the control-plane node
I1101 17:35:37.363131 217517 patchnode.go:30] [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "master01" as an annotation
I1101 17:35:37.867357 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:38.366531 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:38.865993 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:39.365518 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:39.866259 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:40.365739 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:40.866291 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:41.365732 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:41.866282 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:42.365832 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:42.866260 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:43.366366 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:43.867552 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 4 milliseconds
I1101 17:35:44.367066 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:44.868582 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:45.367231 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:45.867029 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:46.367021 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:46.868253 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:47.368338 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 4 milliseconds
I1101 17:35:47.867724 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:48.366527 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:48.867174 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:49.368092 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:49.867042 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:50.367339 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 2 milliseconds
I1101 17:35:50.868077 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:51.367599 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:51.867729 217517 round_trippers.go:445] GET https://apiserver.cluster.local:6443/api/v1/nodes/master01?timeout=10s 404 Not Found in 3 milliseconds
I1101 17:35:52.366529 217517 round_trippers.go:

Relevant log output?

[root@master01 aliai]# kubeadm init --config=/etc/kubernetes/kubeadm.yaml --upload-certs -v 6 --ignore-preflight-errors=SystemVerification,Port-10250,DirAvailable--etc-kubernetes-manifests

I1101 17:04:47.049746   98853 initconfiguration.go:201] loading configuration from "/etc/kubernetes/kubeadm.yaml"

W1101 17:04:47.061668   98853 strict.go:54] error unmarshaling configuration schema.GroupVersionKind{Group:"kubelet.config.k8s.io", Version:"v1beta1", Kind:"KubeletConfiguration"}: error unmarshaling JSON: while decoding JSON: json: unknown field "flushFrequency"

[config] WARNING: Ignored YAML document with GroupVersionKind kubeadm.k8s.io/v1beta2, Kind=JoinConfiguration

W1101 17:04:47.065871   98853 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10 10.96.0.10]

W1101 17:04:47.065920   98853 utils.go:69] The recommended value for "readOnlyPort" in "KubeletConfiguration" is: 0; the provided value is: 10255

I1101 17:04:47.140781   98853 certs.go:474] validating certificate period for CA certificate

I1101 17:04:47.140927   98853 certs.go:474] validating certificate period for front-proxy CA certificate

[init] Using Kubernetes version: v1.20.11-aliyun.1

[preflight] Running pre-flight checks

I1101 17:04:47.141181   98853 checks.go:577] validating Kubernetes and kubeadm version

I1101 17:04:47.141226   98853 checks.go:166] validating if the firewall is enabled and active

I1101 17:04:47.156077   98853 checks.go:201] validating availability of port 6443

I1101 17:04:47.156460   98853 checks.go:201] validating availability of port 10259

I1101 17:04:47.156567   98853 checks.go:201] validating availability of port 10257

I1101 17:04:47.156637   98853 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-apiserver.yaml

I1101 17:04:47.156728   98853 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-controller-manager.yaml

I1101 17:04:47.156788   98853 checks.go:286] validating the existence of file /etc/kubernetes/manifests/kube-scheduler.yaml

I1101 17:04:47.156834   98853 checks.go:286] validating the existence of file /etc/kubernetes/manifests/etcd.yaml

I1101 17:04:47.156893   98853 checks.go:432] validating if the connectivity type is via proxy or direct

I1101 17:04:47.157008   98853 checks.go:471] validating http connectivity to first IP address in the CIDR

I1101 17:04:47.157081   98853 checks.go:471] validating http connectivity to first IP address in the CIDR

I1101 17:04:47.157126   98853 checks.go:471] validating http connectivity to first IP address in the CIDR

I1101 17:04:47.157162   98853 checks.go:471] validating http connectivity to first IP address in the CIDR

I1101 17:04:47.157201   98853 checks.go:102] validating the container runtime

I1101 17:04:47.220408   98853 checks.go:128] validating if the "docker" service is enabled and active

I1101 17:04:47.300237   98853 checks.go:335] validating the contents of file /proc/sys/net/bridge/bridge-nf-call-iptables

I1101 17:04:47.300406   98853 checks.go:335] validating the contents of file /proc/sys/net/ipv4/ip_forward

I1101 17:04:47.300499   98853 checks.go:649] validating whether swap is enabled or not

I1101 17:04:47.300579   98853 checks.go:376] validating the presence of executable conntrack

I1101 17:04:47.300665   98853 checks.go:376] validating the presence of executable ip

I1101 17:04:47.300708   98853 checks.go:376] validating the presence of executable iptables

I1101 17:04:47.300754   98853 checks.go:376] validating the presence of executable mount

I1101 17:04:47.300799   98853 checks.go:376] validating the presence of executable nsenter

I1101 17:04:47.300843   98853 checks.go:376] validating the presence of executable ebtables

I1101 17:04:47.300889   98853 checks.go:376] validating the presence of executable ethtool

I1101 17:04:47.300947   98853 checks.go:376] validating the presence of executable socat

I1101 17:04:47.301027   98853 checks.go:376] validating the presence of executable tc

I1101 17:04:47.301066   98853 checks.go:376] validating the presence of executable touch

I1101 17:04:47.301109   98853 checks.go:520] running all checks

I1101 17:04:47.317737   98853 checks.go:406] checking whether the given node name is reachable using net.LookupHost

        [WARNING Hostname]: hostname "master01" could not be reached

        [WARNING Hostname]: hostname "master01": lookup master01 on 8.8.8.8:53: no such host

I1101 17:04:47.393134   98853 checks.go:618] validating kubelet version

I1101 17:04:47.545029   98853 checks.go:128] validating if the "kubelet" service is enabled and active

I1101 17:04:47.557335   98853 checks.go:201] validating availability of port 10250

        [WARNING Port-10250]: Port 10250 is in use

I1101 17:04:47.557480   98853 checks.go:201] validating availability of port 2379

I1101 17:04:47.557551   98853 checks.go:201] validating availability of port 2380

I1101 17:04:47.557640   98853 checks.go:249] validatin

What you expected to happen?

No response

How to reproduce it (as minimally and precisely as possible)?

Clusterfile:
apiVersion: sealer.cloud/v2
kind: Cluster
metadata:
  name: my-cluster
spec:
  env:
  - SkipPreflight=true
  - pc_storage_class=hostpath
  - pc_modules=base,label,search
  image: localhost/0613:v1
  ssh:
    passwd: xxx
    user: root
  hosts:
    - ips: [ xxx ]
      labels:
        aquila.apes: true
        master-install: true
      roles: [ master ]
---
apiVersion: sealer.aliyun.com/v1alpha1
kind: Plugin
metadata:
  name: z-install-base
spec:
  type: SHELL
  action: post-install
  'on': master-install=true
  data: |
    sh ./post-install.sh

sealer apply -f Clusterfile

Anything else we need to know?

Kubefile:
FROM ack-agility-registry.cn-shanghai.cr.aliyuncs.com/ecp_builder/ackdistro:v1-20-11-ack-22

What is the version of Sealer you using?

0.9.2 and 0.6.1

What is your OS environment?

centos7.9

What is the Kernel version?

3.10.0-1160.83.1.el7.x86_64

Other environment you want to tell us?

I,m try kubeadm reset but Have no effect
for the kubernetes/kubeadm#1587

@summer908 summer908 added the kind/bug Something isn't working label Nov 2, 2023
@summer908
Copy link
Author

[ERROR] [root.go:75] sealer-v0.9.2: failed to init master0: failed to execute command(kubeadm init --config=/etc/kubernetes/kubeadm.yaml --upload-certs -v 0 --ignore-preflight-errors=SystemVerification,Port-10250,DirAvailable--etc-kubernetes-manifests) on host(10.10.5.12): error(W1103 16:04:31.222037 298667 strict.go:54] error unmarshaling configuration schema.GroupVersionKind{Group:"kubelet.config.k8s.io", Version:"v1beta1", Kind:"KubeletConfiguration"}: error unmarshaling JSON: while decoding JSON: json: unknown field "flushFrequency"
W1103 16:04:31.227733 298667 utils.go:69] The recommended value for "clusterDNS" in "KubeletConfiguration" is: [10.96.0.10]; the provided value is: [169.254.20.10 10.96.0.10]
W1103 16:04:31.227766 298667 utils.go:69] The recommended value for "readOnlyPort" in "KubeletConfiguration" is: 0; the provided value is: 10255
[WARNING Hostname]: hostname "master01" could not be reached
[WARNING Hostname]: hostname "master01": lookup master01 on [::1]:53: read udp [::1]:48904->[::1]:53: read: connection refused
W1103 16:04:54.229578 298667 kubeconfig.go:246] a kubeconfig file "/etc/kubernetes/controller-manager.conf" exists already but has an unexpected API Server URL: expected: https://10.10.5.12:6443, got: https://apiserver.cluster.local:6443
W1103 16:04:54.361969 298667 kubeconfig.go:246] a kubeconfig file "/etc/kubernetes/scheduler.conf" exists already but has an unexpected API Server URL: expected: https://10.10.5.12:6443, got: https://apiserver.cluster.local:6443
error execution phase upload-config/kubelet: Error writing Crisocket information for the control-plane node: timed out waiting for the condition
To see the stack trace of this error execute with --v=5 or higher
). Please clean and reinstall

@summer908
Copy link
Author

清空环境配置遗留

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant