Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot start minikube when using non-default profile #2717

Closed
petertrotman opened this issue Apr 12, 2018 · 8 comments
Closed

Cannot start minikube when using non-default profile #2717

petertrotman opened this issue Apr 12, 2018 · 8 comments

Comments

@petertrotman
Copy link
Contributor

petertrotman commented Apr 12, 2018

Is this a BUG REPORT or FEATURE REQUEST?: BUG REPORT

Environment:

Minikube version: v0.26.0

  • OS: Arch Linux (4.15.15-1-ARCH)
  • VM Driver: virtualbox
  • ISO version: minikube-v0.26.0.iso
  • Install tools:
  • Others:

What happened:

╭─peter@peter-arch-9370 ~
╰─$ minikube profile default
minikube profile was successfully set to minikube
╭─peter@peter-arch-9370 ~
╰─$ minikube delete
Deleting local Kubernetes cluster...
Errors occurred deleting machine:  Error deleting host: minikube: Error loading host from store: Docker machine "minikube" does not exist. Use "docker-machine ls" to list machines. Use "docker-machine create" to add a new one.
╭─peter@peter-arch-9370 ~
╰─$ minikube start                                                                                                                                                                                                                                                                                                       1 ↵
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
Kubectl is now configured to use the cluster.
Loading cached images from config file.
╭─peter@peter-arch-9370 ~
╰─$ minikube stop
Stopping local Kubernetes cluster...
Machine stopped.
╭─peter@peter-arch-9370 ~
╰─$ minikube profile minikube-test
minikube profile was successfully set to minikube-test
╭─peter@peter-arch-9370 ~
╰─$ minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0412 15:12:08.112719   17668 start.go:276] Error starting cluster:  kubeadm init error sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap  running command: : running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap
 output: [init] Using Kubernetes version: v1.10.0
[init] Using Authorization modes: [Node RBAC]
[preflight] Running pre-flight checks.
[certificates] Using the existing ca certificate and key.
        [WARNING Swap]: running with swap on is not supported. Please disable swap
Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.
[certificates] Using the existing apiserver certificate and key.
[certificates] Generated apiserver-kubelet-client certificate and key.
[certificates] Generated etcd/ca certificate and key.
[certificates] Generated etcd/server certificate and key.
[certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1]
[certificates] Generated etcd/peer certificate and key.
[certificates] etcd/peer serving cert is signed for DNS names [minikube-test] and IPs [192.168.99.100]
[certificates] Generated etcd/healthcheck-client certificate and key.
[certificates] Generated apiserver-etcd-client certificate and key.
[certificates] Generated sa key and public key.
[certificates] Generated front-proxy-ca certificate and key.
[certificates] Generated front-proxy-client certificate and key.
[certificates] Valid certificates and keys now exist in "/var/lib/localkube/certs/"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf"
[controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml"
[init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests".
[init] This might take a minute or longer if the control plane images have to be pulled.
[apiclient] All control plane components are healthy after 36.001321 seconds
[uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[markmaster] Will mark node minikube-test as master by adding a label and a taint
: running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap
.: Process exited with status 1
================================================================================
An error has occurred. Would you like to opt in to sending anonymized crash
information to minikube to help prevent future errors?
To opt out of these messages, run the command:
        minikube config set WantReportErrorPrompt false
================================================================================
Please enter your response [Y/n]:
Y

What you expected to happen:

Expect minikube start to run correctly when the profile is not default.

How to reproduce it (as minimally and precisely as possible):

minikube profile minikube-test
minikube start

Output of minikube logs (if applicable):

-- Logs begin at Thu 2018-04-12 14:09:15 UTC, end at Thu 2018-04-12 14:24:02 UTC. --
Apr 12 14:09:26 minikube-test systemd[1]: /etc/systemd/system/kubelet.service.d/10-kubeadm.conf:7: Unknown lvalue 'Wants' in section 'Install'
Apr 12 14:09:26 minikube-test systemd[1]: Started kubelet: The Kubernetes Node Agent.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --allow-privileged has been deprecated, will be removed in a future version
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:27 minikube-test kubelet[3357]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Apr 12 14:09:27 minikube-test kubelet[3357]: I0412 14:09:27.067903    3357 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:28 minikube-test kubelet[3357]: W0412 14:09:28.200017    3357 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200119    3357 server.go:376] Version: v1.10.0
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200151    3357 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:28 minikube-test kubelet[3357]: I0412 14:09:28.200241    3357 plugins.go:89] No cloud provider specified.
Apr 12 14:09:28 minikube-test kubelet[3357]: F0412 14:09:28.200263    3357 server.go:233] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Unit entered failed state.
Apr 12 14:09:28 minikube-test systemd[1]: kubelet.service: Failed with result 'exit-code'.
Apr 12 14:09:38 minikube-test systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Apr 12 14:09:38 minikube-test systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Apr 12 14:09:38 minikube-test systemd[1]: Started kubelet: The Kubernetes Node Agent.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --allow-privileged has been deprecated, will be removed in a future version
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Apr 12 14:09:38 minikube-test kubelet[3547]: Flag --cadvisor-port has been deprecated, The default will change to 0 (disabled) in 1.12, and the cadvisor port will be removed entirely in 1.13
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.339985    3547 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.349021    3547 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349050    3547 server.go:376] Version: v1.10.0
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349076    3547 feature_gate.go:226] feature gates: &{{} map[]}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.349145    3547 plugins.go:89] No cloud provider specified.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378325    3547 server.go:613] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378530    3547 container_manager_linux.go:242] container manager verified user specified cgroup-root exists: /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378538    3547 container_manager_linux.go:247] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378620    3547 container_manager_linux.go:266] Creating device plugin manager: true
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378679    3547 state_mem.go:36] [cpumanager] initializing new in-memory state store
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378731    3547 state_file.go:82] [cpumanager] state file: created new state file "/var/lib/kubelet/cpu_manager_state"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378792    3547 kubelet.go:272] Adding pod path: /etc/kubernetes/manifests
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.378802    3547 kubelet.go:297] Watching apiserver
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385443    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385695    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.385867    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.392884    3547 kubelet_network.go:139] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393028    3547 kubelet.go:556] Hairpin mode set to "hairpin-veth"
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393837    3547 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.393953    3547 client.go:104] Start docker client with request timeout=2m0s
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.397562    3547 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.398299    3547 docker_service.go:244] Docker cri networking managed by kubernetes.io/no-op
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.405787    3547 docker_service.go:249] Docker Info: &{ID:G2X3:QTVG:DSMQ:LLZ7:PG2P:GTRB:KMU5:TSRG:LVKL:B3YN:BSQF:2DI4 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:12 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:35 SystemTime:2018-04-12T14:09:38.400447021Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.9.64 OperatingSystem:Buildroot 2017.11 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420238e00 NCPU:2 MemTotal:2097205248 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:minikube-test Labels:[provider=virtualbox] ExperimentalBuild:false ServerVersion:17.12.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9b55aab90508bd389d7654c4baf173a981477d55 Expected:9b55aab90508bd389d7654c4baf173a981477d55} RuncCommit:{ID:9f9c96235cc97674e935002fc3d78361b696a69e Expected:9f9c96235cc97674e935002fc3d78361b696a69e} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.406646    3547 docker_service.go:262] Setting cgroupDriver to cgroupfs
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.416083    3547 remote_runtime.go:43] Connecting to runtime service unix:///var/run/dockershim.sock
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.435962    3547 kuberuntime_manager.go:186] Container runtime docker initialized, version: 17.12.1-ce, apiVersion: 1.35.0
Apr 12 14:09:38 minikube-test kubelet[3547]: W0412 14:09:38.436271    3547 probe.go:215] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.436502    3547 csi_plugin.go:61] kubernetes.io/csi: plugin initializing...
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.438068    3547 kubelet.go:1277] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data for container /
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438354    3547 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438373    3547 status_manager.go:140] Starting to sync pod status with apiserver
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438426    3547 kubelet.go:1777] Starting kubelet main sync loop.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438436    3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438515    3547 server.go:129] Starting to listen on 0.0.0.0:10250
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.438886    3547 server.go:299] Adding debug handlers to kubelet server.
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.439609    3547 volume_manager.go:247] Starting Kubelet Volume Manager
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.440974    3547 server.go:944] Started kubelet
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.441006    3547 desired_state_of_world_populator.go:129] Desired state populator starts to run
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.443834    3547 event.go:209] Unable to write event: 'Post https://192.168.99.100:8443/api/v1/namespaces/default/events: dial tcp 192.168.99.100:8443: getsockopt: connection refused' (may retry after sleeping)
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.538616    3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.540158    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.554417    3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.555172    3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.739728    3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.755575    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:38 minikube-test kubelet[3547]: I0412 14:09:38.768319    3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:38 minikube-test kubelet[3547]: E0412 14:09:38.770030    3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.140219    3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.171043    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.186353    3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.187048    3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.387243    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.395714    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: E0412 14:09:39.395714    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.940808    3547 kubelet.go:1794] skipping pod synchronization - [container runtime is down]
Apr 12 14:09:39 minikube-test kubelet[3547]: I0412 14:09:39.987623    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.007318    3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.007839    3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.389333    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.396845    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.397966    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.562870    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573328    3547 cpu_manager.go:155] [cpumanager] starting with none policy
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573345    3547 cpu_manager.go:156] [cpumanager] reconciling every 10s
Apr 12 14:09:40 minikube-test kubelet[3547]: I0412 14:09:40.573351    3547 policy_none.go:42] [cpumanager] none policy: Start
Apr 12 14:09:40 minikube-test kubelet[3547]: Starting Device Plugin manager
Apr 12 14:09:40 minikube-test kubelet[3547]: E0412 14:09:40.583391    3547 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.390901    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://192.168.99.100:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.399135    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://192.168.99.100:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.399552    3547 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://192.168.99.100:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.541886    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.572567    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.577412    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.588369    3547 status_manager.go:461] Failed to get status for pod "kube-addon-manager-minikube_kube-system(3afaf06535cc3b85be93c31632b765da)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.596106    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.596196    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.608184    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.612564    3547 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(940d4985f94e6ed126cfc4d1f57697e6)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.618305    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.618873    3547 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Apr 12 14:09:41 minikube-test kubelet[3547]: I0412 14:09:41.621350    3547 kubelet_node_status.go:82] Attempting to register node minikube
Apr 12 14:09:41 minikube-test kubelet[3547]: E0412 14:09:41.624449    3547 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://192.168.99.100:8443/api/v1/nodes: dial tcp 192.168.99.100:8443: getsockopt: connection refused
Apr 12 14:09:41 minikube-test kubelet[3547]: W0412 14:09:41.632924    3547 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(e50b4f2cea204f117cba6ed8206cd941)": Get https://192.168.99.100:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 192.168.99.100:8443: getsockopt: connection refused

Anything else do we need to know:

The name given doesn't seem to make a difference.

@petertrotman
Copy link
Contributor Author

After some reading through the source and a bit of testing, I have found the source of the problem:

https://github.com/kubernetes/minikube/blob/master/pkg/minikube/bootstrapper/kubeadm/versions.go#L184

The kubelets are started with --hostname-override=minikube as hard coded, even though the kubeadm and kubelet configs are updated with the profile name given - so in this example the kubeadm hostname runs at minikube-test but the kubelets are still looking for minikube and can't find it.

I'm actually not sure which way to go - either we could update the hostname-override to also refer to the profile, but actually I don't think it makes sense for minikube to use that profile name as a host name in the first place, so perhaps we should change the kubeadm and kubelet confs to use minikube instead of using the given profile name.

Thoughts?

@kevindrosendahl
Copy link

related: #2574

@zaa
Copy link

zaa commented Apr 19, 2018

FWIW, I was able to resolve the issue by applying the patch from #2722 (comment)

@stevesloka
Copy link
Contributor

stevesloka commented May 23, 2018

Applying the patch from #2796 also resolves my issue with profiles. Thanks @petertrotman!

diegodelemos pushed a commit to diegodelemos/reana-cluster that referenced this issue Jun 5, 2018
* Minikube 0.27 does not support profiles see
  kubernetes/minikube#2717.
diegodelemos pushed a commit to diegodelemos/reana-cluster that referenced this issue Jun 6, 2018
* Update python-kubernetes to support interaction with 1.9.4
  K8S cluster.
* Upgrade official kubernetes cluster to 6.0.0 as it supports
  k8s 1.9.4 (also 1.10).
* Stop using profiles since Minikube 0.27 does not support it
  see kubernetes/minikube#2717.

Signed-off-by: Harri Hirvonsalo <harri.hirvonsalo@cern.ch>
Co-authored-by: Diego Rodriguez <diego.rodriguez@cern.ch>
@ascheman
Copy link
Contributor

I tried to locally re-build a Minikube ISO with that patch. But I still seem to get the old kubeadm:
https://kubernetes.slack.com/archives/C1F5CT6Q1/p1528636475000058
Any hints how to proceed?

@nlamirault
Copy link

i can't start the minikube VM using a profile

KUBECONFIG=./deploy/minikube/kube-config minikube start --profile atmos \
        --docker-env HTTP_PROXY=${HTTP_PROXY} \
        --docker-env HTTPS_PROXY=${HTTPS_PROXY} \
        --docker-env NO_PROXY=192.168.99.0/24                                                                                                                                            
There is a newer version of minikube available (v0.28.0).  Download it here:                                                                                                             
https://github.com/kubernetes/minikube/releases/tag/v0.28.0                                                                                                                              
                                                                                                                                                                                         
To disable this notification, run the following:                                                                                                                                         
minikube config set WantUpdateNotification false
Starting local Kubernetes v1.10.0 cluster...
Starting VM...                                                                                                                                                                           
Downloading Minikube ISO
 150.53 MB / 150.53 MB [============================================] 100.00% 0s                                                                                                         
Getting VM IP address...                                                                                                                                                                 
Moving files into cluster...                                                                                                                                                             
Downloading kubeadm v1.10.0
Downloading kubelet v1.10.0
Finished Downloading kubelet v1.10.0
Finished Downloading kubeadm v1.10.0
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0614 18:43:20.423392   18434 start.go:276] Error starting cluster:  kubeadm init error sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--
etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=File
Available--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvai$
able--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap --ignore-preflight-errors=CRI  running command: : running command: sudo /usr/bin/kubeadm init --config /var/lib/k$
beadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--data --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifest$
-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-control$
er-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=Swap --ignore-preflight-errors=CRI
 output: [init] Using Kubernetes version: v1.10.0
[init] Using Authorization modes: [Node RBAC]
[preflight] Running pre-flight checks.
[certificates] Using the existing ca certificate and key.
        [WARNING Swap]: running with swap on is not supported. Please disable swap
Flag --admission-control has been deprecated, Use --enable-admission-plugins or --disable-admission-plugins instead. Will be removed in a future version.
[certificates] Using the existing apiserver certificate and key.
[certificates] Generated apiserver-kubelet-client certificate and key.
[certificates] Generated etcd/ca certificate and key.
[certificates] Generated etcd/server certificate and key.
[certificates] etcd/server serving cert is signed for DNS names [localhost] and IPs [127.0.0.1]
[certificates] Generated etcd/peer certificate and key.
[certificates] etcd/peer serving cert is signed for DNS names [atmos] and IPs [192.168.99.102]
[certificates] Generated etcd/healthcheck-client certificate and key.
[certificates] Generated apiserver-etcd-client certificate and key.
[certificates] Generated sa key and public key.
[certificates] Generated front-proxy-ca certificate and key.
[certificates] Generated front-proxy-client certificate and key.
[certificates] Valid certificates and keys now exist in "/var/lib/localkube/certs/"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/admin.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/kubelet.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/controller-manager.conf"
[kubeconfig] Wrote KubeConfig file to disk: "/etc/kubernetes/scheduler.conf"
[controlplane] Wrote Static Pod manifest for component kube-apiserver to "/etc/kubernetes/manifests/kube-apiserver.yaml"
[controlplane] Wrote Static Pod manifest for component kube-controller-manager to "/etc/kubernetes/manifests/kube-controller-manager.yaml"
[controlplane] Wrote Static Pod manifest for component kube-scheduler to "/etc/kubernetes/manifests/kube-scheduler.yaml"
[etcd] Wrote Static Pod manifest for a local etcd instance to "/etc/kubernetes/manifests/etcd.yaml"
[init] Waiting for the kubelet to boot up the control plane as Static Pods from directory "/etc/kubernetes/manifests".
[init] This might take a minute or longer if the control plane images have to be pulled.
[apiclient] All control plane components are healthy after 38.507298 seconds
[uploadconfig] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
[markmaster] Will mark node atmos as master by adding a label and a taint
: running command: sudo /usr/bin/kubeadm init --config /var/lib/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests --ignore-preflight-errors=DirAvailable--dat$
 --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml --ignore-pre$
light-errors=FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml --ignore-preflight-errors=FileAvailable--etc-kubernetes-manifests-etcd.yaml --ignore-preflight-errors=S$
ap --ignore-preflight-errors=CRI
.: Process exited with status 1
================================================================================
An error has occurred. Would you like to opt in to sending anonymized crash
information to minikube to help prevent future errors?
To opt out of these messages, run the command:
        minikube config set WantReportErrorPrompt false
================================================================================
Please enter your response [Y/n]:
make: *** [Makefile:64: minikube-start] Error 1

According to #2818 i try with --bootstrapper localkube and it works :

$ KUBECONFIG=./deploy/minikube/kube-config minikube start --bootstrapper localkube --profile atmos \
        --docker-env HTTP_PROXY=${HTTP_PROXY} \
        --docker-env HTTPS_PROXY=${HTTPS_PROXY} \
        --docker-env NO_PROXY=192.168.99.0/24
There is a newer version of minikube available (v0.28.0).  Download it here:
https://github.com/kubernetes/minikube/releases/tag/v0.28.0

To disable this notification, run the following:
minikube config set WantUpdateNotification false
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Downloading Minikube ISO
 150.53 MB / 150.53 MB [============================================] 100.00% 0s
Getting VM IP address...
WARNING: The localkube bootstrapper is now deprecated and support for it
will be removed in a future release. Please consider switching to the kubeadm bootstrapper, which
is intended to replace the localkube bootstrapper. To disable this message, run
[minikube config set ShowBootstrapperDeprecationNotification false]
Moving files into cluster...
Downloading localkube binary
 173.54 MB / 173.54 MB [============================================] 100.00% 0s
 0 B / 65 B [----------------------------------------------------------]   0.00%
 65 B / 65 B [======================================================] 100.00% 0sSetting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
Kubectl is now configured to use the cluster.
Loading cached images from config file.

$ KUBECONFIG=./deploy/minikube/kube-config kubectl get all --all-namespaces
NAMESPACE     NAME                          DESIRED   CURRENT   UP-TO-DATE   AVAILABLE   AGE
kube-system   deploy/kube-dns               1         1         1            1           45s
kube-system   deploy/kubernetes-dashboard   1         1         1            1           45s

NAMESPACE     NAME                                 DESIRED   CURRENT   READY     AGE
kube-system   rs/kube-dns-6dcb57bcc8               1         1         1         45s
kube-system   rs/kubernetes-dashboard-5498ccf677   1         1         1         45s

NAMESPACE     NAME                                       READY     STATUS    RESTARTS   AGE
kube-system   po/kube-addon-manager-atmos                1/1       Running   0          54s
kube-system   po/kube-dns-6dcb57bcc8-4ctdj               3/3       Running   0          45s
kube-system   po/kubernetes-dashboard-5498ccf677-8qx54   1/1       Running   0          45s
kube-system   po/storage-provisioner                     1/1       Running   0          43s

NAMESPACE     NAME                       TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)         AGE
default       svc/kubernetes             ClusterIP   10.96.0.1      <none>        443/TCP         1m
kube-system   svc/kube-dns               ClusterIP   10.96.0.10     <none>        53/UDP,53/TCP   45s
kube-system   svc/kubernetes-dashboard   NodePort    10.99.27.184   <none>        80:30000/TCP    45s

$ KUBECONFIG=./deploy/minikube/kube-config minikube dashboard -p atmos
Opening kubernetes dashboard in default browser...

@markmandel
Copy link

markmandel commented Jun 16, 2018

Can confirm this still exists on 0.28

Can see in the minikube logs:

Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.302613    2714 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.312948    2714 kubelet_node_status.go:82] Attempting to register node minikube
Jun 16 22:28:10 agones kubelet[2714]: E0616 22:28:10.316095    2714 kubelet_node_status.go:106] Unable to register node "minikube" with API server: nodes "minikube" is forbidden: node "agones" cannot modify node "minikube"
Jun 16 22:28:10 agones kubelet[2714]: I0616 22:28:10.399470    2714 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach

@dlorenc
Copy link
Contributor

dlorenc commented Jun 18, 2018

This should be fixed with #2796

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants