* * ==> Audit <== * |--------------|------------------------|----------|---------|---------|-------------------------------|-------------------------------| | Command | Args | Profile | User | Version | Start Time | End Time | |--------------|------------------------|----------|---------|---------|-------------------------------|-------------------------------| | delete | --all | minikube | prakhar | v1.25.2 | Wed, 11 May 2022 17:21:09 IST | Wed, 11 May 2022 17:21:09 IST | | update-check | | minikube | prakhar | v1.25.2 | Thu, 12 May 2022 11:20:30 IST | Thu, 12 May 2022 11:20:31 IST | | update-check | | minikube | prakhar | v1.25.2 | Thu, 12 May 2022 12:12:37 IST | Thu, 12 May 2022 12:12:37 IST | | update-check | | minikube | prakhar | v1.25.2 | Fri, 13 May 2022 11:28:52 IST | Fri, 13 May 2022 11:28:52 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 11:33:28 IST | Sat, 14 May 2022 11:33:28 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 11:34:02 IST | Sat, 14 May 2022 11:34:02 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 11:37:12 IST | Sat, 14 May 2022 11:37:13 IST | | start | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 11:37:23 IST | Sat, 14 May 2022 11:38:22 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 11:58:31 IST | Sat, 14 May 2022 11:58:31 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 12:05:39 IST | Sat, 14 May 2022 12:05:41 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 12:16:09 IST | Sat, 14 May 2022 12:16:10 IST | | docker-env | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 12:16:20 IST | Sat, 14 May 2022 12:17:23 IST | | logs | --file=logs.txt | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 15:47:42 IST | Sat, 14 May 2022 15:47:43 IST | | logs | --file=logs.txt | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 15:47:46 IST | Sat, 14 May 2022 15:47:47 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 15:51:46 IST | Sat, 14 May 2022 15:51:48 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 15:58:21 IST | Sat, 14 May 2022 15:58:33 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 15:58:37 IST | Sat, 14 May 2022 15:58:40 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:05:44 IST | Sat, 14 May 2022 16:05:45 IST | | start | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:06:17 IST | Sat, 14 May 2022 16:07:20 IST | | docker-env | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:08:16 IST | Sat, 14 May 2022 16:08:17 IST | | docker-env | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:08:33 IST | Sat, 14 May 2022 16:08:33 IST | | --help | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:08:58 IST | Sat, 14 May 2022 16:08:58 IST | | image | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:11:09 IST | Sat, 14 May 2022 16:11:09 IST | | node | add | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:11:53 IST | Sat, 14 May 2022 16:12:45 IST | | node | delete minikube-m03 | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:14:50 IST | Sat, 14 May 2022 16:14:51 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:16:29 IST | Sat, 14 May 2022 16:16:30 IST | | image | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:17:35 IST | Sat, 14 May 2022 16:17:35 IST | | image | ls | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:17:39 IST | Sat, 14 May 2022 16:17:39 IST | | image | push | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:17:48 IST | Sat, 14 May 2022 16:17:48 IST | | cache | add bank:1.0 | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:38:50 IST | Sat, 14 May 2022 16:39:01 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:41:06 IST | Sat, 14 May 2022 16:41:06 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 16:47:57 IST | Sat, 14 May 2022 16:47:58 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 17:42:59 IST | Sat, 14 May 2022 17:43:11 IST | | image | load bank:1.0 | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 17:52:35 IST | Sat, 14 May 2022 17:52:45 IST | | cache | list | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:14:21 IST | Sat, 14 May 2022 18:14:21 IST | | cache | list | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:14:24 IST | Sat, 14 May 2022 18:14:24 IST | | image | list | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:16:23 IST | Sat, 14 May 2022 18:16:24 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:22:59 IST | Sat, 14 May 2022 18:23:11 IST | | image | add grofffer/bank:1.0 | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:32:49 IST | Sat, 14 May 2022 18:32:49 IST | | image | load grofffer/bank:1.0 | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:32:54 IST | Sat, 14 May 2022 18:33:36 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 18:35:00 IST | Sat, 14 May 2022 18:35:12 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 22:00:08 IST | Sat, 14 May 2022 22:00:20 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 22:00:24 IST | Sat, 14 May 2022 22:00:26 IST | | stop | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 22:02:57 IST | Sat, 14 May 2022 22:03:09 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 22:06:53 IST | Sat, 14 May 2022 22:06:53 IST | | delete | --all | minikube | prakhar | v1.25.2 | Sat, 14 May 2022 22:52:24 IST | Sat, 14 May 2022 22:52:26 IST | | update-check | | minikube | prakhar | v1.25.2 | Sun, 15 May 2022 14:00:05 IST | Sun, 15 May 2022 14:00:05 IST | | update-check | | minikube | prakhar | v1.25.2 | Sun, 15 May 2022 16:35:10 IST | Sun, 15 May 2022 16:35:10 IST | | delete | --all | minikube | prakhar | v1.25.2 | Mon, 16 May 2022 17:42:19 IST | Mon, 16 May 2022 17:42:20 IST | | delete | --all | minikube | prakhar | v1.25.2 | Tue, 17 May 2022 11:07:59 IST | Tue, 17 May 2022 11:08:00 IST | | start | --driver=virtualbox | minikube | prakhar | v1.25.2 | Tue, 17 May 2022 11:08:04 IST | Tue, 17 May 2022 11:09:15 IST | | update-check | | minikube | prakhar | v1.25.2 | Tue, 17 May 2022 11:38:38 IST | Tue, 17 May 2022 11:38:38 IST | | update-check | | minikube | prakhar | v1.25.2 | Wed, 18 May 2022 20:58:34 IST | Wed, 18 May 2022 20:58:34 IST | | update-check | | minikube | prakhar | v1.25.2 | Thu, 19 May 2022 12:28:46 IST | Thu, 19 May 2022 12:28:46 IST | | delete | --all | minikube | prakhar | v1.25.2 | Thu, 19 May 2022 16:01:41 IST | Thu, 19 May 2022 16:01:42 IST | | logs | --file=logs.txt | minikube | prakhar | v1.25.2 | Sat, 21 May 2022 13:24:40 IST | Sat, 21 May 2022 13:24:41 IST | | delete | | minikube | prakhar | v1.25.2 | Sat, 21 May 2022 13:32:17 IST | Sat, 21 May 2022 13:32:20 IST | | delete | | minikube | prakhar | v1.25.2 | Sat, 21 May 2022 13:33:01 IST | Sat, 21 May 2022 13:33:01 IST | | delete | | minikube | prakhar | v1.25.2 | Sat, 21 May 2022 13:43:23 IST | Sat, 21 May 2022 13:43:25 IST | | update-check | | minikube | prakhar | v1.25.2 | Sat, 21 May 2022 14:09:55 IST | Sat, 21 May 2022 14:09:55 IST | |--------------|------------------------|----------|---------|---------|-------------------------------|-------------------------------| * * ==> Last Start <== * Log file created at: 2022/05/21 14:12:02 Running on machine: borderfree Binary: Built with gc go1.17.7 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0521 14:12:02.289404 6868 out.go:297] Setting OutFile to fd 1 ... I0521 14:12:02.289471 6868 out.go:349] isatty.IsTerminal(1) = true I0521 14:12:02.289475 6868 out.go:310] Setting ErrFile to fd 2... I0521 14:12:02.289480 6868 out.go:349] isatty.IsTerminal(2) = true I0521 14:12:02.289646 6868 root.go:315] Updating PATH: /home/prakhar/.minikube/bin I0521 14:12:02.290121 6868 out.go:304] Setting JSON to false I0521 14:12:02.308557 6868 start.go:112] hostinfo: {"hostname":"borderfree","uptime":317,"bootTime":1653122206,"procs":329,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.13.0-41-generic","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"host","hostId":"6c22426d-630d-43fb-908d-357167804395"} I0521 14:12:02.308614 6868 start.go:122] virtualization: kvm host I0521 14:12:02.311874 6868 out.go:176] 😄 minikube v1.25.2 on Ubuntu 20.04 I0521 14:12:02.312268 6868 notify.go:193] Checking for updates... I0521 14:12:02.313227 6868 driver.go:344] Setting default libvirt URI to qemu:///system I0521 14:12:02.313245 6868 global.go:111] Querying for installed drivers using PATH=/home/prakhar/.minikube/bin:/home/prakhar/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/local/go/bin I0521 14:12:02.372041 6868 docker.go:132] docker version: linux-20.10.14 I0521 14:12:02.372937 6868 cli_runner.go:133] Run: docker system info --format "{{json .}}" I0521 14:12:02.647948 6868 info.go:263] docker info: {ID:R6F2:HSQH:TEZG:MS76:YBIA:ZSS7:M65M:CFYM:OVX4:RTVV:BH2A:27RV Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:false NGoroutines:89 SystemTime:2022-05-21 08:42:02.459638902 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:8073154560 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=cgroupns] ProductLicense: Warnings: ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:sbom Path:/usr/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:}} I0521 14:12:02.648017 6868 docker.go:237] overlay module found I0521 14:12:02.648023 6868 global.go:119] docker default: true priority: 9, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0521 14:12:02.648080 6868 global.go:119] kvm2 default: true priority: 8, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "virsh": executable file not found in $PATH Reason: Fix:Install libvirt Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/kvm2/ Version:} I0521 14:12:02.653232 6868 global.go:119] none default: false priority: 4, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:running the 'none' driver as a regular user requires sudo permissions Reason: Fix: Doc: Version:} I0521 14:12:02.653288 6868 global.go:119] podman default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "podman": executable file not found in $PATH Reason: Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/ Version:} I0521 14:12:02.653313 6868 global.go:119] ssh default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0521 14:12:02.685124 6868 virtualbox.go:136] virtual box version: 6.1.32_Ubuntur149290 I0521 14:12:02.685143 6868 global.go:119] virtualbox default: true priority: 6, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:6.1.32_Ubuntur149290 } I0521 14:12:02.685225 6868 global.go:119] vmware default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "docker-machine-driver-vmware": executable file not found in $PATH Reason: Fix:Install docker-machine-driver-vmware Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/ Version:} I0521 14:12:02.685258 6868 driver.go:279] not recommending "ssh" due to default: false I0521 14:12:02.685274 6868 driver.go:314] Picked: docker I0521 14:12:02.685280 6868 driver.go:315] Alternatives: [virtualbox ssh] I0521 14:12:02.685284 6868 driver.go:316] Rejects: [kvm2 none podman vmware] I0521 14:12:02.686887 6868 out.go:176] ✨ Automatically selected the docker driver. Other choices: virtualbox, ssh I0521 14:12:02.686905 6868 start.go:281] selected driver: docker I0521 14:12:02.686908 6868 start.go:798] validating driver "docker" against I0521 14:12:02.686919 6868 start.go:809] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0521 14:12:02.686971 6868 cli_runner.go:133] Run: docker system info --format "{{json .}}" I0521 14:12:02.805415 6868 info.go:263] docker info: {ID:R6F2:HSQH:TEZG:MS76:YBIA:ZSS7:M65M:CFYM:OVX4:RTVV:BH2A:27RV Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:67 OomKillDisable:false NGoroutines:89 SystemTime:2022-05-21 08:42:02.769159642 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:4 KernelVersion:5.10.104-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:4 MemTotal:8073154560 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[] ExperimentalBuild:false ServerVersion:20.10.14 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3df54a852345ae127d1fa3092b95168e4a88e2f8 Expected:3df54a852345ae127d1fa3092b95168e4a88e2f8} RuncCommit:{ID:v1.0.3-0-gf46b6ba Expected:v1.0.3-0-gf46b6ba} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=default name=cgroupns] ProductLicense: Warnings: ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Experimental:true Name:app Path:/usr/libexec/docker/cli-plugins/docker-app SchemaVersion:0.1.0 ShortDescription:Docker App Vendor:Docker Inc. Version:v0.9.1-beta3] map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.8.2-docker] map[Name:compose Path:/usr/lib/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.5.0] map[Name:sbom Path:/usr/lib/docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scan Path:/usr/lib/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShadowedPaths:[/usr/libexec/docker/cli-plugins/docker-scan] ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.17.0]] Warnings:}} I0521 14:12:02.805509 6868 start_flags.go:288] no existing cluster config was found, will generate one from the flags I0521 14:12:02.806055 6868 start_flags.go:369] Using suggested 7651MB memory alloc based on sys=31709MB, container=7699MB I0521 14:12:02.806140 6868 start_flags.go:397] setting extra-config: kubelet.housekeeping-interval=5m I0521 14:12:02.806147 6868 start_flags.go:813] Wait components to verify : map[apiserver:true system_pods:true] I0521 14:12:02.806158 6868 cni.go:93] Creating CNI manager for "" I0521 14:12:02.806163 6868 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0521 14:12:02.806166 6868 start_flags.go:302] config: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:7651 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/prakhar:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false} I0521 14:12:02.807666 6868 out.go:176] 👍 Starting control plane node minikube in cluster minikube I0521 14:12:02.807849 6868 cache.go:120] Beginning downloading kic base image for docker with docker I0521 14:12:02.809092 6868 out.go:176] 🚜 Pulling base image ... I0521 14:12:02.809110 6868 preload.go:132] Checking if preload exists for k8s version v1.23.3 and runtime docker I0521 14:12:02.809141 6868 preload.go:148] Found local preload: /home/prakhar/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4 I0521 14:12:02.809145 6868 cache.go:57] Caching tarball of preloaded images I0521 14:12:02.809172 6868 image.go:75] Checking for gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 in local docker daemon I0521 14:12:02.809267 6868 preload.go:174] Found /home/prakhar/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0521 14:12:02.809273 6868 cache.go:60] Finished verifying existence of preloaded tar for v1.23.3 on docker I0521 14:12:02.809491 6868 profile.go:148] Saving config to /home/prakhar/.minikube/profiles/minikube/config.json ... I0521 14:12:02.809505 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/config.json: {Name:mk75e506484faf622a3eaff0779abffd20716f29 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:12:02.858643 6868 cache.go:148] Downloading gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 to local cache I0521 14:12:02.858755 6868 image.go:59] Checking for gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 in local cache directory I0521 14:12:02.858959 6868 image.go:62] Found gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 in local cache directory, skipping pull I0521 14:12:02.858962 6868 image.go:103] gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 exists in cache, skipping pull I0521 14:12:02.858973 6868 cache.go:151] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 as a tarball I0521 14:12:02.858975 6868 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 from local cache I0521 14:12:04.303690 6868 cache.go:165] successfully loaded gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 from cached tarball I0521 14:12:04.303700 6868 cache.go:208] Successfully downloaded all kic artifacts I0521 14:12:04.303723 6868 start.go:313] acquiring machines lock for minikube: {Name:mka898a1c79c36ee488798837d646ad1f32f5fde Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0521 14:12:04.303820 6868 start.go:317] acquired machines lock for "minikube" in 73.082µs I0521 14:12:04.304055 6868 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:7651 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/prakhar:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true} I0521 14:12:04.304100 6868 start.go:126] createHost starting for "" (driver="docker") I0521 14:12:04.307514 6868 out.go:203] 🔥 Creating docker container (CPUs=2, Memory=7651MB) ... I0521 14:12:04.307731 6868 start.go:160] libmachine.API.Create for "minikube" (driver="docker") I0521 14:12:04.307745 6868 client.go:168] LocalClient.Create starting I0521 14:12:04.307918 6868 main.go:130] libmachine: Reading certificate data from /home/prakhar/.minikube/certs/ca.pem I0521 14:12:04.308083 6868 main.go:130] libmachine: Decoding PEM data... I0521 14:12:04.308094 6868 main.go:130] libmachine: Parsing certificate... I0521 14:12:04.308133 6868 main.go:130] libmachine: Reading certificate data from /home/prakhar/.minikube/certs/cert.pem I0521 14:12:04.308240 6868 main.go:130] libmachine: Decoding PEM data... I0521 14:12:04.308247 6868 main.go:130] libmachine: Parsing certificate... I0521 14:12:04.308448 6868 cli_runner.go:133] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" W0521 14:12:04.394669 6868 cli_runner.go:180] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1 I0521 14:12:04.394709 6868 network_create.go:254] running [docker network inspect minikube] to gather additional debugging logs... I0521 14:12:04.394721 6868 cli_runner.go:133] Run: docker network inspect minikube W0521 14:12:04.443909 6868 cli_runner.go:180] docker network inspect minikube returned with exit code 1 I0521 14:12:04.443923 6868 network_create.go:257] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1 stdout: [] stderr: Error: No such network: minikube I0521 14:12:04.443936 6868 network_create.go:259] output of [docker network inspect minikube]: -- stdout -- [] -- /stdout -- ** stderr ** Error: No such network: minikube ** /stderr ** I0521 14:12:04.443979 6868 cli_runner.go:133] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0521 14:12:04.508750 6868 network.go:240] skipping subnet 192.168.49.0/24 that is taken: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 Interface:{IfaceName:br-71d372ecba40 IfaceIPv4:192.168.49.1 IfaceMTU:1500 IfaceMAC:02:42:2b:57:28:3b}} I0521 14:12:04.509432 6868 network.go:288] reserving subnet 192.168.58.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.58.0:0xc000010658] misses:0} I0521 14:12:04.509456 6868 network.go:235] using free private subnet 192.168.58.0/24: &{IP:192.168.58.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.58.0/24 Gateway:192.168.58.1 ClientMin:192.168.58.2 ClientMax:192.168.58.254 Broadcast:192.168.58.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}} I0521 14:12:04.509466 6868 network_create.go:106] attempt to create docker network minikube 192.168.58.0/24 with gateway 192.168.58.1 and MTU of 1500 ... I0521 14:12:04.509505 6868 cli_runner.go:133] Run: docker network create --driver=bridge --subnet=192.168.58.0/24 --gateway=192.168.58.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true minikube I0521 14:12:04.602946 6868 network_create.go:90] docker network minikube 192.168.58.0/24 created I0521 14:12:04.602985 6868 kic.go:106] calculated static IP "192.168.58.2" for the "minikube" container I0521 14:12:04.603016 6868 cli_runner.go:133] Run: docker ps -a --format {{.Names}} I0521 14:12:04.650247 6868 cli_runner.go:133] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true I0521 14:12:04.726871 6868 oci.go:102] Successfully created a docker volume minikube I0521 14:12:04.726923 6868 cli_runner.go:133] Run: docker run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 -d /var/lib I0521 14:12:56.832647 6868 cli_runner.go:186] Completed: docker run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 -d /var/lib: (52.10569808s) I0521 14:12:56.832661 6868 oci.go:106] Successfully prepared a docker volume minikube I0521 14:12:56.832681 6868 preload.go:132] Checking if preload exists for k8s version v1.23.3 and runtime docker I0521 14:12:56.832693 6868 kic.go:179] Starting extracting preloaded images to volume ... I0521 14:12:56.832728 6868 cli_runner.go:133] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/prakhar/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 -I lz4 -xf /preloaded.tar -C /extractDir I0521 14:13:01.025872 6868 cli_runner.go:186] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/prakhar/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 -I lz4 -xf /preloaded.tar -C /extractDir: (4.193120393s) I0521 14:13:01.025885 6868 kic.go:188] duration metric: took 4.193191 seconds to extract preloaded images to volume W0521 14:13:01.025916 6868 oci.go:135] Your kernel does not support swap limit capabilities or the cgroup is not mounted. W0521 14:13:01.025920 6868 oci.go:119] Your kernel does not support memory limit capabilities or the cgroup is not mounted. I0521 14:13:01.025953 6868 cli_runner.go:133] Run: docker info --format "'{{json .SecurityOptions}}'" I0521 14:13:01.147595 6868 cli_runner.go:133] Run: docker run -d -t --privileged --device /dev/fuse --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.58.2 --volume minikube:/var --security-opt apparmor=unconfined --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 I0521 14:13:01.495592 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Running}} I0521 14:13:01.549315 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:13:01.601975 6868 cli_runner.go:133] Run: docker exec minikube stat /var/lib/dpkg/alternatives/iptables I0521 14:13:01.690834 6868 oci.go:281] the created container "minikube" has a running status. I0521 14:13:01.690845 6868 kic.go:210] Creating ssh key for kic: /home/prakhar/.minikube/machines/minikube/id_rsa... I0521 14:13:01.792851 6868 kic_runner.go:191] docker (temp): /home/prakhar/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes) I0521 14:13:01.885532 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:13:01.935721 6868 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys I0521 14:13:01.935729 6868 kic_runner.go:114] Args: [docker exec --privileged minikube chown docker:docker /home/docker/.ssh/authorized_keys] I0521 14:13:02.026921 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:13:02.083769 6868 machine.go:88] provisioning docker machine ... I0521 14:13:02.083786 6868 ubuntu.go:169] provisioning hostname "minikube" I0521 14:13:02.083816 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:02.135122 6868 main.go:130] libmachine: Using SSH client type: native I0521 14:13:02.135247 6868 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x7a12c0] 0x7a43a0 [] 0s} 127.0.0.1 37341 } I0521 14:13:02.135254 6868 main.go:130] libmachine: About to run SSH command: sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname I0521 14:13:02.265112 6868 main.go:130] libmachine: SSH cmd err, output: : minikube I0521 14:13:02.265151 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:02.312358 6868 main.go:130] libmachine: Using SSH client type: native I0521 14:13:02.312454 6868 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x7a12c0] 0x7a43a0 [] 0s} 127.0.0.1 37341 } I0521 14:13:02.312464 6868 main.go:130] libmachine: About to run SSH command: if ! grep -xq '.*\sminikube' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts; else echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; fi fi I0521 14:13:02.430144 6868 main.go:130] libmachine: SSH cmd err, output: : I0521 14:13:02.430159 6868 ubuntu.go:175] set auth options {CertDir:/home/prakhar/.minikube CaCertPath:/home/prakhar/.minikube/certs/ca.pem CaPrivateKeyPath:/home/prakhar/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/prakhar/.minikube/machines/server.pem ServerKeyPath:/home/prakhar/.minikube/machines/server-key.pem ClientKeyPath:/home/prakhar/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/prakhar/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/prakhar/.minikube} I0521 14:13:02.430172 6868 ubuntu.go:177] setting up certificates I0521 14:13:02.430177 6868 provision.go:83] configureAuth start I0521 14:13:02.430207 6868 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0521 14:13:02.477049 6868 provision.go:138] copyHostCerts I0521 14:13:02.477087 6868 exec_runner.go:144] found /home/prakhar/.minikube/ca.pem, removing ... I0521 14:13:02.477092 6868 exec_runner.go:207] rm: /home/prakhar/.minikube/ca.pem I0521 14:13:02.477941 6868 exec_runner.go:151] cp: /home/prakhar/.minikube/certs/ca.pem --> /home/prakhar/.minikube/ca.pem (1082 bytes) I0521 14:13:02.477993 6868 exec_runner.go:144] found /home/prakhar/.minikube/cert.pem, removing ... I0521 14:13:02.477996 6868 exec_runner.go:207] rm: /home/prakhar/.minikube/cert.pem I0521 14:13:02.478011 6868 exec_runner.go:151] cp: /home/prakhar/.minikube/certs/cert.pem --> /home/prakhar/.minikube/cert.pem (1123 bytes) I0521 14:13:02.478047 6868 exec_runner.go:144] found /home/prakhar/.minikube/key.pem, removing ... I0521 14:13:02.478050 6868 exec_runner.go:207] rm: /home/prakhar/.minikube/key.pem I0521 14:13:02.478063 6868 exec_runner.go:151] cp: /home/prakhar/.minikube/certs/key.pem --> /home/prakhar/.minikube/key.pem (1679 bytes) I0521 14:13:02.478235 6868 provision.go:112] generating server cert: /home/prakhar/.minikube/machines/server.pem ca-key=/home/prakhar/.minikube/certs/ca.pem private-key=/home/prakhar/.minikube/certs/ca-key.pem org=prakhar.minikube san=[192.168.58.2 127.0.0.1 localhost 127.0.0.1 minikube minikube] I0521 14:13:02.716421 6868 provision.go:172] copyRemoteCerts I0521 14:13:02.716447 6868 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0521 14:13:02.716465 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:02.758701 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:13:02.856108 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes) I0521 14:13:02.892450 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/machines/server.pem --> /etc/docker/server.pem (1204 bytes) I0521 14:13:02.909945 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0521 14:13:02.926220 6868 provision.go:86] duration metric: configureAuth took 496.035764ms I0521 14:13:02.926230 6868 ubuntu.go:193] setting minikube options for container-runtime I0521 14:13:02.926345 6868 config.go:176] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.3 I0521 14:13:02.926370 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:02.976013 6868 main.go:130] libmachine: Using SSH client type: native I0521 14:13:02.976113 6868 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x7a12c0] 0x7a43a0 [] 0s} 127.0.0.1 37341 } I0521 14:13:02.976119 6868 main.go:130] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0521 14:13:03.109472 6868 main.go:130] libmachine: SSH cmd err, output: : overlay I0521 14:13:03.109484 6868 ubuntu.go:71] root file system type: overlay I0521 14:13:03.109642 6868 provision.go:309] Updating docker unit: /lib/systemd/system/docker.service ... I0521 14:13:03.109684 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:03.173803 6868 main.go:130] libmachine: Using SSH client type: native I0521 14:13:03.173909 6868 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x7a12c0] 0x7a43a0 [] 0s} 127.0.0.1 37341 } I0521 14:13:03.173961 6868 main.go:130] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0521 14:13:03.318954 6868 main.go:130] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target Requires=docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0521 14:13:03.318998 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:03.370794 6868 main.go:130] libmachine: Using SSH client type: native I0521 14:13:03.370921 6868 main.go:130] libmachine: &{{{ 0 [] [] []} docker [0x7a12c0] 0x7a43a0 [] 0s} 127.0.0.1 37341 } I0521 14:13:03.370939 6868 main.go:130] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0521 14:13:03.985047 6868 main.go:130] libmachine: SSH cmd err, output: : --- /lib/systemd/system/docker.service 2021-12-13 11:43:42.000000000 +0000 +++ /lib/systemd/system/docker.service.new 2022-05-21 08:43:03.256366000 +0000 @@ -1,30 +1,32 @@ [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com +BindsTo=containerd.service After=network-online.target firewalld.service containerd.service Wants=network-online.target -Requires=docker.socket containerd.service +Requires=docker.socket +StartLimitBurst=3 +StartLimitIntervalSec=60 [Service] Type=notify -# the default is not to use systemd for cgroups because the delegate issues still -# exists and systemd currently does not support the cgroup feature set required -# for containers run by docker -ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock -ExecReload=/bin/kill -s HUP $MAINPID -TimeoutSec=0 -RestartSec=2 -Restart=always - -# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229. -# Both the old, and new location are accepted by systemd 229 and up, so using the old location -# to make them work for either version of systemd. -StartLimitBurst=3 +Restart=on-failure -# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230. -# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make -# this option work for either version of systemd. -StartLimitInterval=60s + + +# This file is a systemd drop-in unit that inherits from the base dockerd configuration. +# The base configuration already specifies an 'ExecStart=...' command. The first directive +# here is to clear out that command inherited from the base configuration. Without this, +# the command from the base configuration and the command specified here are treated as +# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd +# will catch this invalid input and refuse to start the service with an error like: +# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. + +# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other +# container runtimes. If left unlimited, it may result in OOM issues with MySQL. +ExecStart= +ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12 +ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. @@ -32,16 +34,16 @@ LimitNPROC=infinity LimitCORE=infinity -# Comment TasksMax if your systemd version does not support it. -# Only systemd 226 and above support this option. +# Uncomment TasksMax if your systemd version supports it. +# Only systemd 226 and above support this version. TasksMax=infinity +TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process -OOMScoreAdjust=-500 [Install] WantedBy=multi-user.target Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install. Executing: /lib/systemd/systemd-sysv-install enable docker I0521 14:13:03.985063 6868 machine.go:91] provisioned docker machine in 1.901285602s I0521 14:13:03.985071 6868 client.go:171] LocalClient.Create took 59.67732322s I0521 14:13:03.985078 6868 start.go:168] duration metric: libmachine.API.Create for "minikube" took 59.677349334s I0521 14:13:03.985083 6868 start.go:267] post-start starting for "minikube" (driver="docker") I0521 14:13:03.985086 6868 start.go:277] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0521 14:13:03.985129 6868 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0521 14:13:03.985156 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:04.038828 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:13:04.141927 6868 ssh_runner.go:195] Run: cat /etc/os-release I0521 14:13:04.150501 6868 main.go:130] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found I0521 14:13:04.150523 6868 main.go:130] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found I0521 14:13:04.150533 6868 main.go:130] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found I0521 14:13:04.150539 6868 info.go:137] Remote host: Ubuntu 20.04.2 LTS I0521 14:13:04.150550 6868 filesync.go:126] Scanning /home/prakhar/.minikube/addons for local assets ... I0521 14:13:04.151469 6868 filesync.go:126] Scanning /home/prakhar/.minikube/files for local assets ... I0521 14:13:04.151591 6868 start.go:270] post-start completed in 166.502005ms I0521 14:13:04.151917 6868 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0521 14:13:04.209295 6868 profile.go:148] Saving config to /home/prakhar/.minikube/profiles/minikube/config.json ... I0521 14:13:04.209443 6868 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'" I0521 14:13:04.209463 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:04.257508 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:13:04.344246 6868 start.go:129] duration metric: createHost completed in 1m0.040136544s I0521 14:13:04.344258 6868 start.go:80] releasing machines lock for "minikube", held for 1m0.040432301s I0521 14:13:04.344329 6868 cli_runner.go:133] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube I0521 14:13:04.394280 6868 ssh_runner.go:195] Run: systemctl --version I0521 14:13:04.394305 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:04.394340 6868 ssh_runner.go:195] Run: curl -sS -m 2 https://k8s.gcr.io/ I0521 14:13:04.394368 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:13:04.444071 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:13:04.444142 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:13:04.890365 6868 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd I0521 14:13:04.899792 6868 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0521 14:13:04.910200 6868 cruntime.go:272] skipping containerd shutdown because we are bound to it I0521 14:13:04.910236 6868 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0521 14:13:04.919668 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/dockershim.sock image-endpoint: unix:///var/run/dockershim.sock " | sudo tee /etc/crictl.yaml" I0521 14:13:04.932459 6868 ssh_runner.go:195] Run: sudo systemctl unmask docker.service I0521 14:13:04.998482 6868 ssh_runner.go:195] Run: sudo systemctl enable docker.socket I0521 14:13:05.071847 6868 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0521 14:13:05.085449 6868 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0521 14:13:05.164977 6868 ssh_runner.go:195] Run: sudo systemctl start docker I0521 14:13:05.175495 6868 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0521 14:13:05.208180 6868 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0521 14:13:05.246148 6868 out.go:203] 🐳 Preparing Kubernetes v1.23.3 on Docker 20.10.12 ... I0521 14:13:05.246206 6868 cli_runner.go:133] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" I0521 14:13:05.291765 6868 ssh_runner.go:195] Run: grep 192.168.58.1 host.minikube.internal$ /etc/hosts I0521 14:13:05.295817 6868 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.58.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0521 14:13:05.306725 6868 out.go:176] ▪ kubelet.housekeeping-interval=5m I0521 14:13:05.306786 6868 preload.go:132] Checking if preload exists for k8s version v1.23.3 and runtime docker I0521 14:13:05.306816 6868 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0521 14:13:05.336323 6868 docker.go:606] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.23.3 k8s.gcr.io/kube-scheduler:v1.23.3 k8s.gcr.io/kube-controller-manager:v1.23.3 k8s.gcr.io/kube-proxy:v1.23.3 k8s.gcr.io/etcd:3.5.1-0 k8s.gcr.io/coredns/coredns:v1.8.6 k8s.gcr.io/pause:3.6 kubernetesui/dashboard:v2.3.1 kubernetesui/metrics-scraper:v1.0.7 gcr.io/k8s-minikube/storage-provisioner:v5 -- /stdout -- I0521 14:13:05.336331 6868 docker.go:537] Images already preloaded, skipping extraction I0521 14:13:05.336363 6868 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0521 14:13:05.365134 6868 docker.go:606] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.23.3 k8s.gcr.io/kube-proxy:v1.23.3 k8s.gcr.io/kube-scheduler:v1.23.3 k8s.gcr.io/kube-controller-manager:v1.23.3 k8s.gcr.io/etcd:3.5.1-0 k8s.gcr.io/coredns/coredns:v1.8.6 k8s.gcr.io/pause:3.6 kubernetesui/dashboard:v2.3.1 kubernetesui/metrics-scraper:v1.0.7 gcr.io/k8s-minikube/storage-provisioner:v5 -- /stdout -- I0521 14:13:05.365144 6868 cache_images.go:84] Images are preloaded, skipping loading I0521 14:13:05.365177 6868 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}} I0521 14:13:05.435619 6868 cni.go:93] Creating CNI manager for "" I0521 14:13:05.435626 6868 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0521 14:13:05.435630 6868 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16 I0521 14:13:05.435637 6868 kubeadm.go:158] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.58.2 APIServerPort:8443 KubernetesVersion:v1.23.3 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:minikube NodeName:minikube DNSDomain:cluster.local CRISocket:/var/run/dockershim.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.58.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NoTaintMaster:true NodeIP:192.168.58.2 CgroupDriver:systemd ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[]} I0521 14:13:05.435725 6868 kubeadm.go:162] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta3 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.58.2 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: /var/run/dockershim.sock name: "minikube" kubeletExtraArgs: node-ip: 192.168.58.2 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta3 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.58.2"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.23.3 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: systemd clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%!"(MISSING) nodefs.inodesFree: "0%!"(MISSING) imagefs.available: "0%!"(MISSING) failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established" tcpEstablishedTimeout: 0s # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close" tcpCloseWaitTimeout: 0s I0521 14:13:05.435779 6868 kubeadm.go:936] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.23.3/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --container-runtime=docker --hostname-override=minikube --housekeeping-interval=5m --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.58.2 [Install] config: {KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} I0521 14:13:05.435808 6868 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.23.3 I0521 14:13:05.442876 6868 binaries.go:44] Found k8s binaries, skipping transfer I0521 14:13:05.442915 6868 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0521 14:13:05.449424 6868 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (361 bytes) I0521 14:13:05.461658 6868 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0521 14:13:05.473400 6868 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2029 bytes) I0521 14:13:05.485060 6868 ssh_runner.go:195] Run: grep 192.168.58.2 control-plane.minikube.internal$ /etc/hosts I0521 14:13:05.488312 6868 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.58.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0521 14:13:05.497362 6868 certs.go:54] Setting up /home/prakhar/.minikube/profiles/minikube for IP: 192.168.58.2 I0521 14:13:05.498331 6868 certs.go:182] skipping minikubeCA CA generation: /home/prakhar/.minikube/ca.key I0521 14:13:05.498471 6868 certs.go:182] skipping proxyClientCA CA generation: /home/prakhar/.minikube/proxy-client-ca.key I0521 14:13:05.498498 6868 certs.go:302] generating minikube-user signed cert: /home/prakhar/.minikube/profiles/minikube/client.key I0521 14:13:05.498503 6868 crypto.go:68] Generating cert /home/prakhar/.minikube/profiles/minikube/client.crt with IP's: [] I0521 14:13:05.572145 6868 crypto.go:156] Writing cert to /home/prakhar/.minikube/profiles/minikube/client.crt ... I0521 14:13:05.572151 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/client.crt: {Name:mk0e8a90b95a37c027425d0c869c5e2bfbf965da Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.572247 6868 crypto.go:164] Writing key to /home/prakhar/.minikube/profiles/minikube/client.key ... I0521 14:13:05.572250 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/client.key: {Name:mk529151df156fac38cb6eca9ff46dc074212b21 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.572299 6868 certs.go:302] generating minikube signed cert: /home/prakhar/.minikube/profiles/minikube/apiserver.key.cee25041 I0521 14:13:05.572304 6868 crypto.go:68] Generating cert /home/prakhar/.minikube/profiles/minikube/apiserver.crt.cee25041 with IP's: [192.168.58.2 10.96.0.1 127.0.0.1 10.0.0.1] I0521 14:13:05.649938 6868 crypto.go:156] Writing cert to /home/prakhar/.minikube/profiles/minikube/apiserver.crt.cee25041 ... I0521 14:13:05.649943 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/apiserver.crt.cee25041: {Name:mkbaa7091c673bead5c1df3b0406b25c9af97d9d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.650002 6868 crypto.go:164] Writing key to /home/prakhar/.minikube/profiles/minikube/apiserver.key.cee25041 ... I0521 14:13:05.650006 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/apiserver.key.cee25041: {Name:mk8e261b44ede1772b5545c2da8f799ad6574387 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.650051 6868 certs.go:320] copying /home/prakhar/.minikube/profiles/minikube/apiserver.crt.cee25041 -> /home/prakhar/.minikube/profiles/minikube/apiserver.crt I0521 14:13:05.650082 6868 certs.go:324] copying /home/prakhar/.minikube/profiles/minikube/apiserver.key.cee25041 -> /home/prakhar/.minikube/profiles/minikube/apiserver.key I0521 14:13:05.650106 6868 certs.go:302] generating aggregator signed cert: /home/prakhar/.minikube/profiles/minikube/proxy-client.key I0521 14:13:05.650111 6868 crypto.go:68] Generating cert /home/prakhar/.minikube/profiles/minikube/proxy-client.crt with IP's: [] I0521 14:13:05.749877 6868 crypto.go:156] Writing cert to /home/prakhar/.minikube/profiles/minikube/proxy-client.crt ... I0521 14:13:05.749883 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/proxy-client.crt: {Name:mkfb22a33ddd334ca7f3d4971d79d9a9223fd758 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.749954 6868 crypto.go:164] Writing key to /home/prakhar/.minikube/profiles/minikube/proxy-client.key ... I0521 14:13:05.749958 6868 lock.go:35] WriteFile acquiring /home/prakhar/.minikube/profiles/minikube/proxy-client.key: {Name:mk66456aee9632816480f486a0c21a6a2181279d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:05.750049 6868 certs.go:388] found cert: /home/prakhar/.minikube/certs/home/prakhar/.minikube/certs/ca-key.pem (1679 bytes) I0521 14:13:05.750066 6868 certs.go:388] found cert: /home/prakhar/.minikube/certs/home/prakhar/.minikube/certs/ca.pem (1082 bytes) I0521 14:13:05.750078 6868 certs.go:388] found cert: /home/prakhar/.minikube/certs/home/prakhar/.minikube/certs/cert.pem (1123 bytes) I0521 14:13:05.750100 6868 certs.go:388] found cert: /home/prakhar/.minikube/certs/home/prakhar/.minikube/certs/key.pem (1679 bytes) I0521 14:13:05.750790 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/profiles/minikube/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes) I0521 14:13:05.766282 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/profiles/minikube/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes) I0521 14:13:05.781048 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/profiles/minikube/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0521 14:13:05.796207 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/profiles/minikube/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes) I0521 14:13:05.814088 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0521 14:13:05.834559 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0521 14:13:05.853230 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0521 14:13:05.872982 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0521 14:13:05.898823 6868 ssh_runner.go:362] scp /home/prakhar/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0521 14:13:05.919775 6868 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes) I0521 14:13:05.934967 6868 ssh_runner.go:195] Run: openssl version I0521 14:13:05.940061 6868 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0521 14:13:05.948252 6868 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0521 14:13:05.951875 6868 certs.go:431] hashing: -rw-r--r-- 1 root root 1111 Mar 11 11:50 /usr/share/ca-certificates/minikubeCA.pem I0521 14:13:05.951909 6868 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0521 14:13:05.956796 6868 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0521 14:13:05.964526 6868 kubeadm.go:391] StartCluster: {Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:7651 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/prakhar:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false} I0521 14:13:05.964599 6868 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0521 14:13:05.991517 6868 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0521 14:13:05.998952 6868 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0521 14:13:06.005929 6868 kubeadm.go:221] ignoring SystemVerification for kubeadm because of docker driver I0521 14:13:06.005958 6868 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0521 14:13:06.012724 6868 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0521 14:13:06.012743 6868 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.23.3:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables" I0521 14:13:06.471069 6868 out.go:203] ▪ Generating certificates and keys ... I0521 14:13:08.554167 6868 out.go:203] ▪ Booting up control plane ... I0521 14:13:16.154643 6868 out.go:203] ▪ Configuring RBAC rules ... I0521 14:13:16.575456 6868 cni.go:93] Creating CNI manager for "" I0521 14:13:16.575468 6868 cni.go:167] CNI unnecessary in this configuration, recommending no CNI I0521 14:13:16.575488 6868 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj" I0521 14:13:16.575534 6868 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.3/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig I0521 14:13:16.575538 6868 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.23.3/kubectl label nodes minikube.k8s.io/version=v1.25.2 minikube.k8s.io/commit=362d5fdc0a3dbee389b3d3f1034e8023e72bd3a7 minikube.k8s.io/name=minikube minikube.k8s.io/updated_at=2022_05_21T14_13_16_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig I0521 14:13:16.906577 6868 ops.go:34] apiserver oom_adj: -16 I0521 14:13:16.906597 6868 kubeadm.go:1020] duration metric: took 331.104674ms to wait for elevateKubeSystemPrivileges. I0521 14:13:16.906617 6868 kubeadm.go:393] StartCluster complete in 10.942096271s I0521 14:13:16.906629 6868 settings.go:142] acquiring lock: {Name:mkcfb2dcfbb5470cff50a55872d1b3495cd0a17f Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0521 14:13:16.906721 6868 settings.go:150] Updating kubeconfig: /home/prakhar/.kube/config I0521 14:13:16.907443 6868 lock.go:35] WriteFile acquiring /home/prakhar/.kube/config: {Name:mk34c5c301368a302c776b644a948534c8ef1211 Clock:{} Delay:500ms Timeout:1m0s Cancel:} W0521 14:13:46.911110 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout W0521 14:14:17.412157 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout W0521 14:14:47.912639 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout W0521 14:15:18.412199 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout W0521 14:15:48.912920 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout W0521 14:16:18.913724 6868 kapi.go:226] failed getting deployment scale, will retry: Get "https://192.168.58.2:8443/apis/apps/v1/namespaces/kube-system/deployments/coredns/scale": dial tcp 192.168.58.2:8443: i/o timeout I0521 14:16:18.913767 6868 kapi.go:241] timed out trying to rescale deployment "coredns" in namespace "kube-system" and context "minikube" to 1: timed out waiting for the condition E0521 14:16:18.913781 6868 start.go:264] Unable to scale down deployment "coredns" in namespace "kube-system" to 1 replica: timed out waiting for the condition I0521 14:16:18.913914 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml" I0521 14:16:18.913915 6868 start.go:208] Will wait 6m0s for node &{Name: IP:192.168.58.2 Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true} I0521 14:16:18.918057 6868 out.go:176] 🔎 Verifying Kubernetes components... I0521 14:16:18.914214 6868 addons.go:415] enableAddons start: toEnable=map[], additional=[] I0521 14:16:18.918248 6868 addons.go:65] Setting storage-provisioner=true in profile "minikube" I0521 14:16:18.914553 6868 config.go:176] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.3 I0521 14:16:18.918275 6868 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0521 14:16:18.918294 6868 addons.go:153] Setting addon storage-provisioner=true in "minikube" W0521 14:16:18.918309 6868 addons.go:165] addon storage-provisioner should already be in state true I0521 14:16:18.918371 6868 host.go:66] Checking if "minikube" exists ... I0521 14:16:18.918429 6868 addons.go:65] Setting default-storageclass=true in profile "minikube" I0521 14:16:18.918468 6868 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "minikube" I0521 14:16:18.918540 6868 cache.go:107] acquiring lock: {Name:mk60797d4823c416e44e5e1859a5e99e5acb2046 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0521 14:16:18.919120 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:16:18.919403 6868 image.go:134] retrieving image: bank:1.0 I0521 14:16:18.919448 6868 image.go:140] checking repository: index.docker.io/library/bank I0521 14:16:18.919823 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:16:19.011146 6868 out.go:176] ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5 I0521 14:16:19.011245 6868 addons.go:348] installing /etc/kubernetes/addons/storage-provisioner.yaml I0521 14:16:19.011253 6868 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes) I0521 14:16:19.011287 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:16:19.011820 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.58.1 host.minikube.internal\n fallthrough\n }' | sudo /var/lib/minikube/binaries/v1.23.3/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -" I0521 14:16:19.012438 6868 api_server.go:51] waiting for apiserver process to appear ... I0521 14:16:19.012459 6868 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.* I0521 14:16:19.072517 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:16:19.181694 6868 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.23.3/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml I0521 14:16:19.596572 6868 start.go:777] {"host.minikube.internal": 192.168.58.1} host record injected into CoreDNS I0521 14:16:19.596603 6868 api_server.go:71] duration metric: took 682.630325ms to wait for apiserver process to appear ... I0521 14:16:19.596609 6868 api_server.go:87] waiting for apiserver healthz status ... I0521 14:16:19.596615 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... W0521 14:16:23.689654 6868 image.go:147] remote: HEAD https://index.docker.io/v2/library/bank/manifests/1.0: unexpected status code 401 Unauthorized (HEAD responses have no body, use GET for details) I0521 14:16:23.689702 6868 image.go:148] short name: bank:1.0 I0521 14:16:23.691229 6868 image.go:180] daemon lookup for bank:1.0: Error response from daemon: reference does not exist I0521 14:16:24.597179 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:25.098350 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... W0521 14:16:29.031568 6868 image.go:190] authn lookup for bank:1.0 (trying anon): GET https://index.docker.io/v2/library/bank/manifests/1.0: UNAUTHORIZED: authentication required; [map[Action:pull Class: Name:library/bank Type:repository]] I0521 14:16:30.099007 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:30.597444 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:16:33.189515 6868 image.go:194] remote lookup for bank:1.0: GET https://index.docker.io/v2/library/bank/manifests/1.0: UNAUTHORIZED: authentication required; [map[Action:pull Class: Name:library/bank Type:repository]] I0521 14:16:33.189632 6868 cache.go:96] cache image "bank:1.0" -> "/home/prakhar/.minikube/cache/images/amd64/bank_1.0" took 14.271114502s W0521 14:16:33.189816 6868 out.go:241] ❗ The image 'bank:1.0' was not found; unable to add it to cache. I0521 14:16:33.189859 6868 cache.go:87] Successfully saved all images to host disk. I0521 14:16:33.190153 6868 config.go:176] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.23.3 I0521 14:16:33.190613 6868 cli_runner.go:133] Run: docker container inspect minikube --format={{.State.Status}} I0521 14:16:33.240730 6868 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0521 14:16:33.240751 6868 cli_runner.go:133] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube I0521 14:16:33.290892 6868 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:37341 SSHKeyPath:/home/prakhar/.minikube/machines/minikube/id_rsa Username:docker} I0521 14:16:33.398261 6868 docker.go:606] Got preloaded images: -- stdout -- k8s.gcr.io/kube-apiserver:v1.23.3 k8s.gcr.io/kube-controller-manager:v1.23.3 k8s.gcr.io/kube-scheduler:v1.23.3 k8s.gcr.io/kube-proxy:v1.23.3 k8s.gcr.io/etcd:3.5.1-0 k8s.gcr.io/coredns/coredns:v1.8.6 k8s.gcr.io/pause:3.6 kubernetesui/dashboard:v2.3.1 kubernetesui/metrics-scraper:v1.0.7 gcr.io/k8s-minikube/storage-provisioner:v5 -- /stdout -- I0521 14:16:33.398269 6868 docker.go:612] bank:1.0 wasn't preloaded I0521 14:16:33.398273 6868 cache_images.go:88] LoadImages start: [bank:1.0] I0521 14:16:33.398849 6868 image.go:134] retrieving image: bank:1.0 I0521 14:16:33.398856 6868 image.go:140] checking repository: index.docker.io/library/bank W0521 14:16:34.668609 6868 image.go:147] remote: HEAD https://index.docker.io/v2/library/bank/manifests/1.0: unexpected status code 401 Unauthorized (HEAD responses have no body, use GET for details) I0521 14:16:34.668637 6868 image.go:148] short name: bank:1.0 I0521 14:16:34.669728 6868 image.go:180] daemon lookup for bank:1.0: Error response from daemon: reference does not exist I0521 14:16:35.598231 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:36.098250 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... W0521 14:16:38.421202 6868 image.go:190] authn lookup for bank:1.0 (trying anon): GET https://index.docker.io/v2/library/bank/manifests/1.0: UNAUTHORIZED: authentication required; [map[Action:pull Class: Name:library/bank Type:repository]] I0521 14:16:41.098528 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:41.597823 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:16:42.632198 6868 image.go:194] remote lookup for bank:1.0: GET https://index.docker.io/v2/library/bank/manifests/1.0: UNAUTHORIZED: authentication required; [map[Action:pull Class: Name:library/bank Type:repository]] I0521 14:16:42.632284 6868 image.go:93] error retrieve Image bank:1.0 ref Error response from daemon: reference does not exist I0521 14:16:42.632328 6868 cache_images.go:116] "bank:1.0" needs transfer: got empty img digest "" for bank:1.0 I0521 14:16:42.632398 6868 docker.go:287] Removing image: bank:1.0 I0521 14:16:42.632481 6868 ssh_runner.go:195] Run: docker rmi bank:1.0 I0521 14:16:42.696676 6868 cache_images.go:286] Loading image from: /home/prakhar/.minikube/cache/images/amd64/bank_1.0 I0521 14:16:42.696695 6868 cache_images.go:92] LoadImages completed in 9.298417394s W0521 14:16:42.696703 6868 cache_images.go:254] Failed to load cached images for profile minikube. make sure the profile is running. loading cached images: stat /home/prakhar/.minikube/cache/images/amd64/bank_1.0: no such file or directory I0521 14:16:42.696711 6868 cache_images.go:262] succeeded pushing to: I0521 14:16:42.696713 6868 cache_images.go:263] failed pushing to: minikube I0521 14:16:46.598958 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:47.097781 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... W0521 14:16:49.011946 6868 out.go:241] ❗ Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error listing StorageClasses: Get "https://192.168.58.2:8443/apis/storage.k8s.io/v1/storageclasses": dial tcp 192.168.58.2:8443: i/o timeout] I0521 14:16:49.013955 6868 out.go:176] 🌟 Enabled addons: storage-provisioner I0521 14:16:49.013967 6868 addons.go:417] enableAddons completed in 30.099900751s I0521 14:16:52.098317 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:52.597815 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:16:57.598331 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:16:57.598418 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:02.598891 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:03.097803 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:08.098227 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:08.597942 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:13.598324 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:14.097899 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:19.098296 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:19.598163 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:17:19.635000 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:17:19.635038 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:17:19.664466 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:17:19.664503 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:17:19.694988 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:17:19.695036 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:17:19.723555 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:17:19.723593 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:17:19.751722 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:17:19.751766 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:17:19.779389 6868 logs.go:274] 0 containers: [] W0521 14:17:19.779399 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:17:19.779427 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:17:19.806984 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:17:19.807022 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:17:19.836628 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:17:19.836645 6868 logs.go:123] Gathering logs for container status ... I0521 14:17:19.836652 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:17:19.866564 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:17:19.866574 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:17:19.914612 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:17:19.914622 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:17:19.922951 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:17:19.922960 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:17:19.978678 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:17:19.978688 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:17:20.012671 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:17:20.012681 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:17:20.042551 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:17:20.042562 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:17:20.085322 6868 logs.go:123] Gathering logs for Docker ... I0521 14:17:20.085331 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:17:20.098550 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:17:20.098560 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:17:20.131800 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:17:20.131810 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:17:20.159781 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:17:20.159792 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:17:20.194675 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:17:20.194684 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:17:20.224342 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:17:20.224352 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:17:22.756408 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:27.757562 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:28.098346 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:17:28.159537 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:17:28.159574 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:17:28.188382 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:17:28.188416 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:17:28.217986 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:17:28.218024 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:17:28.246999 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:17:28.247035 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:17:28.275110 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:17:28.275154 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:17:28.303941 6868 logs.go:274] 0 containers: [] W0521 14:17:28.303949 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:17:28.303975 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:17:28.332571 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:17:28.332608 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:17:28.360654 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:17:28.360669 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:17:28.360675 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:17:28.390524 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:17:28.390536 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:17:28.429808 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:17:28.429818 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:17:28.477389 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:17:28.477400 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:17:28.487830 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:17:28.487841 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:17:28.516092 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:17:28.516101 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:17:28.545333 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:17:28.545344 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:17:28.580440 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:17:28.580450 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:17:28.609376 6868 logs.go:123] Gathering logs for container status ... I0521 14:17:28.609387 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:17:28.643340 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:17:28.643349 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:17:28.703867 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:17:28.703878 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:17:28.738218 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:17:28.738228 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:17:28.767383 6868 logs.go:123] Gathering logs for Docker ... I0521 14:17:28.767393 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:17:31.282560 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:36.283579 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:36.598266 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:17:36.659479 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:17:36.659520 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:17:36.688729 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:17:36.688764 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:17:36.718014 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:17:36.718056 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:17:36.747461 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:17:36.747506 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:17:36.776981 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:17:36.777019 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:17:36.805131 6868 logs.go:274] 0 containers: [] W0521 14:17:36.805140 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:17:36.805166 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:17:36.833404 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:17:36.833443 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:17:36.863364 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:17:36.863381 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:17:36.863387 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:17:36.926370 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:17:36.926380 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:17:36.959637 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:17:36.959647 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:17:36.995463 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:17:36.995473 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:17:37.024895 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:17:37.024906 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:17:37.055689 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:17:37.055700 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:17:37.107732 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:17:37.107743 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:17:37.133345 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:17:37.133358 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:17:37.168408 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:17:37.168419 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:17:37.199508 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:17:37.199522 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:17:37.242573 6868 logs.go:123] Gathering logs for Docker ... I0521 14:17:37.242583 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:17:37.258102 6868 logs.go:123] Gathering logs for container status ... I0521 14:17:37.258114 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:17:37.282585 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:17:37.282595 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:17:39.794285 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:44.794654 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:45.098461 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:17:45.153418 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:17:45.153456 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:17:45.182026 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:17:45.182061 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:17:45.214149 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:17:45.214185 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:17:45.244032 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:17:45.244071 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:17:45.274484 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:17:45.274521 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:17:45.303420 6868 logs.go:274] 0 containers: [] W0521 14:17:45.303429 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:17:45.303478 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:17:45.333023 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:17:45.333062 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:17:45.362957 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:17:45.362972 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:17:45.362977 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:17:45.401519 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:17:45.401532 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:17:45.432704 6868 logs.go:123] Gathering logs for Docker ... I0521 14:17:45.432714 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:17:45.446720 6868 logs.go:123] Gathering logs for container status ... I0521 14:17:45.446730 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:17:45.472620 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:17:45.472632 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:17:45.518142 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:17:45.518152 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:17:45.548110 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:17:45.548120 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:17:45.576050 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:17:45.576060 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:17:45.605306 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:17:45.605317 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:17:45.647668 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:17:45.647678 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:17:45.657153 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:17:45.657162 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:17:45.718117 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:17:45.718129 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:17:45.765974 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:17:45.765986 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:17:48.295850 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:17:53.297066 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:17:53.597662 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:17:53.655608 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:17:53.655642 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:17:53.685604 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:17:53.685646 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:17:53.715261 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:17:53.715298 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:17:53.744829 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:17:53.744871 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:17:53.774841 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:17:53.774878 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:17:53.804552 6868 logs.go:274] 0 containers: [] W0521 14:17:53.804562 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:17:53.804589 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:17:53.833885 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:17:53.833925 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:17:53.861883 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:17:53.861897 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:17:53.861905 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:17:53.892475 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:17:53.892488 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:17:53.930351 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:17:53.930361 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:17:53.959965 6868 logs.go:123] Gathering logs for Docker ... I0521 14:17:53.959975 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:17:53.973792 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:17:53.973804 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:17:53.982607 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:17:53.982618 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:17:54.017290 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:17:54.017301 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:17:54.053650 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:17:54.053660 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:17:54.085391 6868 logs.go:123] Gathering logs for container status ... I0521 14:17:54.085403 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:17:54.110177 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:17:54.110187 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:17:54.155204 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:17:54.155214 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:17:54.210489 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:17:54.210498 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:17:54.239982 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:17:54.239992 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:17:56.782514 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:01.783440 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:02.098188 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:02.162217 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:02.162251 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:02.192509 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:02.192554 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:02.221967 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:02.222006 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:02.251082 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:02.251117 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:02.279768 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:02.279805 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:02.308481 6868 logs.go:274] 0 containers: [] W0521 14:18:02.308490 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:02.308516 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:02.338909 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:02.338952 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:02.368112 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:02.368147 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:02.368155 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:02.399522 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:02.399533 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:02.431560 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:02.431571 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:02.466797 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:02.466807 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:02.511065 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:02.511075 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:02.536995 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:02.537006 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:02.582446 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:02.582455 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:02.638055 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:02.638065 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:02.672807 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:02.672816 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:02.701982 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:02.701992 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:02.715763 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:02.715777 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:02.725834 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:02.725848 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:02.759993 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:02.760003 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:05.297123 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:10.298474 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:10.598249 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:10.646164 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:10.646200 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:10.677479 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:10.677515 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:10.706809 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:10.706843 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:10.737865 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:10.737909 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:10.766855 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:10.766895 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:10.794876 6868 logs.go:274] 0 containers: [] W0521 14:18:10.794885 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:10.794916 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:10.825624 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:10.825658 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:10.855113 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:10.855131 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:10.855139 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:10.892920 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:10.892929 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:10.922944 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:10.922954 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:10.953497 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:10.953507 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:10.995539 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:10.995550 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:11.009572 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:11.009582 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:11.018524 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:11.018535 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:11.082102 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:11.082111 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:11.116126 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:11.116136 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:11.150696 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:11.150705 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:11.181516 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:11.181530 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:11.213923 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:11.213934 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:11.241387 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:11.241398 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:13.793424 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:18.793949 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:19.097498 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:19.158180 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:19.158230 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:19.189840 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:19.189874 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:19.220199 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:19.220236 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:19.250720 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:19.250754 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:19.280049 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:19.280091 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:19.308128 6868 logs.go:274] 0 containers: [] W0521 14:18:19.308136 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:19.308164 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:19.338470 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:19.338504 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:19.367892 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:19.367906 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:19.367912 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:19.399069 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:19.399081 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:19.429588 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:19.429599 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:19.480039 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:19.480050 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:19.504618 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:19.504629 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:19.513402 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:19.513414 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:19.549948 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:19.549959 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:19.591544 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:19.591555 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:19.621594 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:19.621605 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:19.651019 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:19.651030 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:19.665929 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:19.665940 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:19.711767 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:19.711778 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:19.768965 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:19.768975 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:22.308258 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:27.308627 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:27.598360 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:27.660826 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:27.660869 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:27.689734 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:27.689778 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:27.719548 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:27.719582 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:27.748736 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:27.748771 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:27.778394 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:27.778431 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:27.806957 6868 logs.go:274] 0 containers: [] W0521 14:18:27.806968 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:27.807000 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:27.835797 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:27.835834 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:27.866699 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:27.866714 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:27.866722 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:27.930949 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:27.930958 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:27.967562 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:27.967573 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:27.999858 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:27.999870 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:28.035648 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:28.035660 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:28.066272 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:28.066282 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:28.107338 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:28.107348 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:28.153034 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:28.153044 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:28.161054 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:28.161062 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:28.172777 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:28.172787 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:28.198412 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:28.198422 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:28.224367 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:28.224378 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:28.259232 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:28.259242 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:30.788890 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:35.789296 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:36.098105 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:36.158766 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:36.158809 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:36.199348 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:36.199380 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:36.227902 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:36.227939 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:36.257673 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:36.257711 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:36.288404 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:36.288444 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:36.319721 6868 logs.go:274] 0 containers: [] W0521 14:18:36.319731 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:36.319775 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:36.349518 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:36.349556 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:36.380055 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:36.380072 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:36.380080 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:36.417919 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:36.417932 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:36.459736 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:36.459747 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:36.491108 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:36.491119 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:36.546050 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:36.546060 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:36.571439 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:36.571449 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:36.606148 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:36.606158 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:36.620745 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:36.620756 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:36.672013 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:36.672024 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:36.681389 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:36.681399 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:36.741612 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:36.741621 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:36.774109 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:36.774118 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:36.804354 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:36.804366 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:39.336901 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:44.337810 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:44.598304 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:44.627185 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:44.627222 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:44.659585 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:44.659621 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:44.691012 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:44.691051 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:44.721892 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:44.721931 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:44.750864 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:44.750902 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:44.780308 6868 logs.go:274] 0 containers: [] W0521 14:18:44.780318 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:44.780345 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:44.810099 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:44.810133 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:44.841701 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:44.841719 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:44.841725 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:44.882481 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:44.882492 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:44.891572 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:44.891582 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:44.952026 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:44.952036 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:44.988245 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:44.988255 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:45.023944 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:45.023954 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:45.054036 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:45.054050 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:45.086298 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:45.086310 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:45.135605 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:45.135615 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:45.160962 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:45.160973 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:45.195139 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:45.195148 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:45.224435 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:45.224445 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:45.238599 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:45.238609 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:47.763910 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:18:52.765165 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:18:53.097524 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:18:53.151271 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:18:53.151310 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:18:53.181449 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:18:53.181489 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:18:53.212031 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:18:53.212068 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:18:53.241457 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:18:53.241493 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:18:53.271170 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:18:53.271210 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:18:53.300489 6868 logs.go:274] 0 containers: [] W0521 14:18:53.300498 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:18:53.300524 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:18:53.330949 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:18:53.330991 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:18:53.360786 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:18:53.360804 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:18:53.360812 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:18:53.409315 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:18:53.409325 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:18:53.417784 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:18:53.417795 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:18:53.443218 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:18:53.443229 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:18:53.478797 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:18:53.478806 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:18:53.509508 6868 logs.go:123] Gathering logs for Docker ... I0521 14:18:53.509520 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:18:53.523326 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:18:53.523335 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:18:53.587748 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:18:53.587766 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:18:53.630365 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:18:53.630375 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:18:53.664281 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:18:53.664292 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:18:53.693977 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:18:53.693988 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:18:53.726674 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:18:53.726684 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:18:53.778638 6868 logs.go:123] Gathering logs for container status ... I0521 14:18:53.778648 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:18:56.303945 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:01.305265 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:01.597930 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:01.659091 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:01.659140 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:01.688959 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:01.688996 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:01.720059 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:01.720102 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:01.749496 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:01.749536 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:01.781327 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:01.781370 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:01.810218 6868 logs.go:274] 0 containers: [] W0521 14:19:01.810228 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:01.810253 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:01.839665 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:01.839703 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:01.869327 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:01.869345 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:01.869353 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:01.910072 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:01.910082 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:01.944933 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:01.944942 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:01.977873 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:01.977883 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:02.032030 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:02.032039 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:02.045993 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:02.046005 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:02.098116 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:02.098130 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:02.107266 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:02.107278 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:02.165119 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:02.165130 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:02.189777 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:02.189788 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:02.219795 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:02.219805 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:02.250502 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:02.250515 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:02.281316 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:02.281329 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:04.820481 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:09.821153 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:10.097672 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:10.158357 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:10.158393 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:10.188795 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:10.188830 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:10.218152 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:10.218194 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:10.248306 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:10.248342 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:10.277971 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:10.278017 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:10.307384 6868 logs.go:274] 0 containers: [] W0521 14:19:10.307394 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:10.307425 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:10.337170 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:10.337207 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:10.368489 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:10.368504 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:10.368511 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:10.399810 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:10.399821 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:10.433815 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:10.433825 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:10.462751 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:10.462761 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:10.472080 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:10.472090 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:10.539544 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:10.539556 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:10.568710 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:10.568720 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:10.606340 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:10.606349 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:10.636177 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:10.636189 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:10.677429 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:10.677439 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:10.690948 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:10.690958 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:10.737266 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:10.737276 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:10.768740 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:10.768749 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:13.303937 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:18.304452 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:18.598105 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:18.656080 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:18.656117 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:18.685766 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:18.685806 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:18.716827 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:18.716879 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:18.748746 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:18.748781 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:18.778065 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:18.778107 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:18.808284 6868 logs.go:274] 0 containers: [] W0521 14:19:18.808295 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:18.808324 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:18.837784 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:18.837828 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:18.867131 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:18.867151 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:18.867161 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:18.898513 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:18.898523 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:18.913470 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:18.913480 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:18.938291 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:18.938302 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:18.996697 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:18.996707 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:19.031239 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:19.031249 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:19.066622 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:19.066633 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:19.098841 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:19.098853 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:19.134066 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:19.134077 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:19.177317 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:19.177326 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:19.223645 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:19.223654 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:19.232408 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:19.232421 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:19.259054 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:19.259068 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:21.797883 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:26.798244 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:27.098126 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:27.161175 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:27.161208 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:27.191602 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:27.191644 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:27.222410 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:27.222445 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:27.252188 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:27.252224 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:27.281997 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:27.282035 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:27.311424 6868 logs.go:274] 0 containers: [] W0521 14:19:27.311433 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:27.311463 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:27.342510 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:27.342558 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:27.372800 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:27.372820 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:27.372829 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:27.406013 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:27.406029 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:27.438158 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:27.438170 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:27.472288 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:27.472301 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:27.516343 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:27.516354 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:27.530500 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:27.530510 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:27.540519 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:27.540529 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:27.576045 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:27.576055 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:27.611606 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:27.611617 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:27.637447 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:27.637462 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:27.668362 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:27.668374 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:27.717991 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:27.718001 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:27.773414 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:27.773423 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:30.309644 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:35.310990 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:35.597589 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:35.661191 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:35.661236 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:35.690425 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:35.690465 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:35.723240 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:35.723287 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:35.754350 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:35.754389 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:35.784786 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:35.784826 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:35.814480 6868 logs.go:274] 0 containers: [] W0521 14:19:35.814490 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:35.814518 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:35.844303 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:35.844346 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:35.875116 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:35.875131 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:35.875138 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:35.906843 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:35.906853 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:35.921851 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:35.921862 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:35.946567 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:35.946578 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:36.007716 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:36.007726 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:36.040566 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:36.040576 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:36.077488 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:36.077498 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:36.112543 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:36.112556 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:36.150271 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:36.150281 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:36.181748 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:36.181759 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:36.213079 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:36.213091 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:36.266237 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:36.266247 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:36.312307 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:36.312317 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:38.820497 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:43.820960 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:44.097487 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:44.161399 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:44.161437 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:44.190947 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:44.190988 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:44.222214 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:44.222253 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:44.252388 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:44.252429 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:44.281227 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:44.281264 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:44.310793 6868 logs.go:274] 0 containers: [] W0521 14:19:44.310802 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:44.310830 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:44.341079 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:44.341113 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:44.371733 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:44.371748 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:44.371764 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:44.381148 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:44.381161 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:44.416867 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:44.416877 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:44.446553 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:44.446565 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:44.478062 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:44.478072 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:44.512764 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:44.512774 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:44.546374 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:44.546384 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:44.597684 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:44.597694 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:44.654010 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:44.654037 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:44.691996 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:44.692006 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:44.724352 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:44.724366 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:44.763035 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:44.763046 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:44.805372 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:44.805382 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:47.319408 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:19:52.320656 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:19:52.598415 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:19:52.660613 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:19:52.660647 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:19:52.695856 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:19:52.695895 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:19:52.730199 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:19:52.730236 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:19:52.761676 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:19:52.761713 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:19:52.791680 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:19:52.791717 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:19:52.824595 6868 logs.go:274] 0 containers: [] W0521 14:19:52.824603 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:19:52.824632 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:19:52.854475 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:19:52.854510 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:19:52.885141 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:19:52.885172 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:19:52.885180 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:19:52.931870 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:19:52.931881 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:19:52.990800 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:19:52.990809 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:19:53.025622 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:19:53.025632 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:19:53.056677 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:19:53.056691 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:19:53.088140 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:19:53.088150 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:19:53.099904 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:19:53.099918 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:19:53.141503 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:19:53.141514 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:19:53.171247 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:19:53.171261 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:19:53.209480 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:19:53.209491 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:19:53.241766 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:19:53.241776 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:19:53.283955 6868 logs.go:123] Gathering logs for Docker ... I0521 14:19:53.283965 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:19:53.297507 6868 logs.go:123] Gathering logs for container status ... I0521 14:19:53.297517 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:19:55.833090 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:20:00.834013 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:20:01.097619 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:20:01.159572 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:20:01.159609 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:20:01.195483 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:20:01.195525 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:20:01.226562 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:20:01.226606 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:20:01.257071 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:20:01.257110 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:20:01.288017 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:20:01.288058 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:20:01.318475 6868 logs.go:274] 0 containers: [] W0521 14:20:01.318484 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:20:01.318515 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:20:01.347716 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:20:01.347766 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:20:01.377642 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:20:01.377659 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:20:01.377666 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:20:01.414474 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:20:01.414484 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:20:01.444767 6868 logs.go:123] Gathering logs for container status ... I0521 14:20:01.444781 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:20:01.472259 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:20:01.472270 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:20:01.536453 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:20:01.536463 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:20:01.545597 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:20:01.545606 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:20:01.579586 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:20:01.579596 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:20:01.609590 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:20:01.609601 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:20:01.647002 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:20:01.647012 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:20:01.677571 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:20:01.677581 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:20:01.708384 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:20:01.708393 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:20:01.769207 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:20:01.769217 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:20:01.816623 6868 logs.go:123] Gathering logs for Docker ... I0521 14:20:01.816634 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:20:04.329325 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:20:09.329843 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:20:09.597445 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:20:09.661371 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:20:09.661407 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:20:09.691334 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:20:09.691375 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:20:09.725272 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:20:09.725318 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:20:09.755432 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:20:09.755476 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:20:09.785362 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:20:09.785398 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:20:09.816501 6868 logs.go:274] 0 containers: [] W0521 14:20:09.816510 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:20:09.816538 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:20:09.846519 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:20:09.846558 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:20:09.878601 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:20:09.878620 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:20:09.878629 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:20:09.927000 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:20:09.927010 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:20:09.954932 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:20:09.954941 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:20:09.985507 6868 logs.go:123] Gathering logs for Docker ... I0521 14:20:09.985517 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:20:09.999651 6868 logs.go:123] Gathering logs for container status ... I0521 14:20:09.999663 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:20:10.028065 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:20:10.028077 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:20:10.058686 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:20:10.058701 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:20:10.097706 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:20:10.097717 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:20:10.138862 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:20:10.138872 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:20:10.148088 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:20:10.148100 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:20:10.208222 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:20:10.208231 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:20:10.243100 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:20:10.243110 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:20:10.277134 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:20:10.277145 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:20:12.807822 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:20:17.809144 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:20:18.097721 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:20:18.160936 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:20:18.160971 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:20:18.190962 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:20:18.191007 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:20:18.221972 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:20:18.222012 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:20:18.251730 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:20:18.251783 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:20:18.281951 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:20:18.281994 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:20:18.312069 6868 logs.go:274] 0 containers: [] W0521 14:20:18.312079 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:20:18.312107 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:20:18.341908 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:20:18.341944 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:20:18.371691 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:20:18.371707 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:20:18.371715 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:20:18.408408 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:20:18.408418 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:20:18.445627 6868 logs.go:123] Gathering logs for container status ... I0521 14:20:18.445642 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:20:18.477282 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:20:18.477293 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:20:18.541918 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:20:18.541928 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:20:18.551077 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:20:18.551087 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:20:18.586223 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:20:18.586233 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:20:18.618451 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:20:18.618462 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:20:18.650809 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:20:18.650820 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:20:18.688669 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:20:18.688680 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:20:18.721866 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:20:18.721879 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:20:18.763946 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:20:18.763956 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:20:18.811488 6868 logs.go:123] Gathering logs for Docker ... I0521 14:20:18.811497 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:20:21.323750 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:20:26.325168 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:20:26.325318 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}} I0521 14:20:26.386757 6868 logs.go:274] 1 containers: [f5ac5d10e710] I0521 14:20:26.386798 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}} I0521 14:20:26.417029 6868 logs.go:274] 1 containers: [45aac8c1ba3a] I0521 14:20:26.417073 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}} I0521 14:20:26.446765 6868 logs.go:274] 2 containers: [e61a98684262 4671c63b56a6] I0521 14:20:26.446799 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}} I0521 14:20:26.476056 6868 logs.go:274] 1 containers: [a834ad6712d2] I0521 14:20:26.476093 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}} I0521 14:20:26.505819 6868 logs.go:274] 1 containers: [61f87c5d0ee3] I0521 14:20:26.505873 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kubernetes-dashboard --format={{.ID}} I0521 14:20:26.535552 6868 logs.go:274] 0 containers: [] W0521 14:20:26.535562 6868 logs.go:276] No container was found matching "kubernetes-dashboard" I0521 14:20:26.535590 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_storage-provisioner --format={{.ID}} I0521 14:20:26.565889 6868 logs.go:274] 1 containers: [caa057bd325d] I0521 14:20:26.565924 6868 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}} I0521 14:20:26.597396 6868 logs.go:274] 1 containers: [a411deccc107] I0521 14:20:26.597414 6868 logs.go:123] Gathering logs for coredns [e61a98684262] ... I0521 14:20:26.597420 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 e61a98684262" I0521 14:20:26.629798 6868 logs.go:123] Gathering logs for kube-scheduler [a834ad6712d2] ... I0521 14:20:26.629809 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a834ad6712d2" I0521 14:20:26.667982 6868 logs.go:123] Gathering logs for kube-controller-manager [a411deccc107] ... I0521 14:20:26.667992 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a411deccc107" I0521 14:20:26.709367 6868 logs.go:123] Gathering logs for Docker ... I0521 14:20:26.709377 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -n 400" I0521 14:20:26.723182 6868 logs.go:123] Gathering logs for dmesg ... I0521 14:20:26.723193 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400" I0521 14:20:26.732226 6868 logs.go:123] Gathering logs for describe nodes ... I0521 14:20:26.732239 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.23.3/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" I0521 14:20:26.793246 6868 logs.go:123] Gathering logs for kube-apiserver [f5ac5d10e710] ... I0521 14:20:26.793256 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f5ac5d10e710" I0521 14:20:26.826000 6868 logs.go:123] Gathering logs for etcd [45aac8c1ba3a] ... I0521 14:20:26.826010 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 45aac8c1ba3a" I0521 14:20:26.860560 6868 logs.go:123] Gathering logs for container status ... I0521 14:20:26.860571 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a" I0521 14:20:26.885702 6868 logs.go:123] Gathering logs for kubelet ... I0521 14:20:26.885713 6868 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400" I0521 14:20:26.931374 6868 logs.go:123] Gathering logs for coredns [4671c63b56a6] ... I0521 14:20:26.931384 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 4671c63b56a6" I0521 14:20:26.957664 6868 logs.go:123] Gathering logs for kube-proxy [61f87c5d0ee3] ... I0521 14:20:26.957675 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 61f87c5d0ee3" I0521 14:20:26.987988 6868 logs.go:123] Gathering logs for storage-provisioner [caa057bd325d] ... I0521 14:20:26.987998 6868 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 caa057bd325d" I0521 14:20:29.519908 6868 api_server.go:240] Checking apiserver healthz at https://192.168.58.2:8443/healthz ... I0521 14:20:34.520992 6868 api_server.go:256] stopped: https://192.168.58.2:8443/healthz: Get "https://192.168.58.2:8443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) I0521 14:20:34.523640 6868 out.go:176] W0521 14:20:34.523736 6868 out.go:241] ❌ Exiting due to GUEST_START: wait 6m0s for node: wait for healthy API server: apiserver healthz never reported healthy: timed out waiting for the condition W0521 14:20:34.523748 6868 out.go:241] W0521 14:20:34.524668 6868 out.go:241] ╭───────────────────────────────────────────────────────────────────────────────────────────╮ │ │ │ 😿 If the above advice does not help, please let us know: │ │ 👉 https://github.com/kubernetes/minikube/issues/new/choose │ │ │ │ Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue. │ │ │ ╰───────────────────────────────────────────────────────────────────────────────────────────╯ * * ==> Docker <== * -- Logs begin at Sat 2022-05-21 08:43:01 UTC, end at Sat 2022-05-21 09:20:56 UTC. -- May 21 08:43:01 minikube systemd[1]: Starting Docker Application Container Engine... May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.769277591Z" level=info msg="Starting up" May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.774877824Z" level=info msg="parsed scheme: \"unix\"" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.774902475Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.774919081Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.774926767Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.779510357Z" level=info msg="parsed scheme: \"unix\"" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.779569657Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.779588875Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.779603513Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.787034818Z" level=info msg="[graphdriver] using prior storage driver: overlay2" May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.816887879Z" level=info msg="Loading containers: start." May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.888357013Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.929358868Z" level=info msg="Loading containers: done." May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.948581224Z" level=info msg="Docker daemon" commit=459d0df graphdriver(s)=overlay2 version=20.10.12 May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.948755443Z" level=info msg="Daemon has completed initialization" May 21 08:43:01 minikube systemd[1]: Started Docker Application Container Engine. May 21 08:43:01 minikube dockerd[134]: time="2022-05-21T08:43:01.997326899Z" level=info msg="API listen on /run/docker.sock" May 21 08:43:03 minikube systemd[1]: docker.service: Current command vanished from the unit file, execution of the command list won't be resumed. May 21 08:43:03 minikube dockerd[134]: time="2022-05-21T08:43:03.738676277Z" level=info msg="Processing signal 'terminated'" May 21 08:43:03 minikube dockerd[134]: time="2022-05-21T08:43:03.739247024Z" level=info msg="stopping event stream following graceful shutdown" error="" module=libcontainerd namespace=moby May 21 08:43:03 minikube dockerd[134]: time="2022-05-21T08:43:03.739482904Z" level=info msg="Daemon shutdown complete" May 21 08:43:03 minikube systemd[1]: Stopping Docker Application Container Engine... May 21 08:43:03 minikube systemd[1]: docker.service: Succeeded. May 21 08:43:03 minikube systemd[1]: Stopped Docker Application Container Engine. May 21 08:43:03 minikube systemd[1]: Starting Docker Application Container Engine... May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.780247504Z" level=info msg="Starting up" May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.781793309Z" level=info msg="parsed scheme: \"unix\"" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.781816647Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.781841719Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.781854666Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.782820990Z" level=info msg="parsed scheme: \"unix\"" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.782837367Z" level=info msg="scheme \"unix\" not registered, fallback to default scheme" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.782856479Z" level=info msg="ccResolverWrapper: sending update to cc: {[{unix:///run/containerd/containerd.sock 0 }] }" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.782864638Z" level=info msg="ClientConn switching balancer to \"pick_first\"" module=grpc May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.793843414Z" level=info msg="[graphdriver] using prior storage driver: overlay2" May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.804259707Z" level=info msg="Loading containers: start." May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.866510376Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address" May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.892334695Z" level=info msg="Loading containers: done." May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.901882853Z" level=info msg="Docker daemon" commit=459d0df graphdriver(s)=overlay2 version=20.10.12 May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.901923691Z" level=info msg="Daemon has completed initialization" May 21 08:43:03 minikube systemd[1]: Started Docker Application Container Engine. May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.926755200Z" level=info msg="API listen on [::]:2376" May 21 08:43:03 minikube dockerd[381]: time="2022-05-21T08:43:03.940072319Z" level=info msg="API listen on /var/run/docker.sock" * * ==> container status <== * CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID caa057bd325d9 6e38f40d628db 34 minutes ago Running storage-provisioner 0 bd3eeb7d8f163 e61a986842621 a4ca41631cc7a 37 minutes ago Running coredns 0 7a5699700d0e3 4671c63b56a60 a4ca41631cc7a 37 minutes ago Running coredns 0 9f098cb4744a1 61f87c5d0ee36 9b7cc99821098 37 minutes ago Running kube-proxy 0 24d5e659047c0 45aac8c1ba3a0 25f8c7f3da61c 37 minutes ago Running etcd 0 d184486f2bc19 a411deccc107b b07520cd7ab76 37 minutes ago Running kube-controller-manager 0 a395affbfc7a5 f5ac5d10e7102 f40be0088a83e 37 minutes ago Running kube-apiserver 0 c2c56462dfe9b a834ad6712d2c 99a3486be4f28 37 minutes ago Running kube-scheduler 0 7590b8168a09d * * ==> coredns [4671c63b56a6] <== * .:53 [INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7 CoreDNS-1.8.6 linux/amd64, go1.17.1, 13a9191 [INFO] Reloading [INFO] plugin/health: Going into lameduck mode for 5s [INFO] plugin/reload: Running configuration MD5 = 7cb80d9b13c0af3fa1ba04fc3eef5f89 [INFO] Reloading complete * * ==> coredns [e61a98684262] <== * .:53 [INFO] plugin/reload: Running configuration MD5 = db32ca3650231d74073ff4cf814959a7 CoreDNS-1.8.6 linux/amd64, go1.17.1, 13a9191 [INFO] Reloading [INFO] plugin/health: Going into lameduck mode for 5s [INFO] plugin/reload: Running configuration MD5 = 7cb80d9b13c0af3fa1ba04fc3eef5f89 [INFO] Reloading complete * * ==> describe nodes <== * Name: minikube Roles: control-plane,master Labels: beta.kubernetes.io/arch=amd64 beta.kubernetes.io/os=linux kubernetes.io/arch=amd64 kubernetes.io/hostname=minikube kubernetes.io/os=linux minikube.k8s.io/commit=362d5fdc0a3dbee389b3d3f1034e8023e72bd3a7 minikube.k8s.io/name=minikube minikube.k8s.io/primary=true minikube.k8s.io/updated_at=2022_05_21T14_13_16_0700 minikube.k8s.io/version=v1.25.2 node-role.kubernetes.io/control-plane= node-role.kubernetes.io/master= node.kubernetes.io/exclude-from-external-load-balancers= Annotations: kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock node.alpha.kubernetes.io/ttl: 0 volumes.kubernetes.io/controller-managed-attach-detach: true CreationTimestamp: Sat, 21 May 2022 08:43:13 +0000 Taints: Unschedulable: false Lease: HolderIdentity: minikube AcquireTime: RenewTime: Sat, 21 May 2022 09:20:47 +0000 Conditions: Type Status LastHeartbeatTime LastTransitionTime Reason Message ---- ------ ----------------- ------------------ ------ ------- MemoryPressure False Sat, 21 May 2022 09:19:06 +0000 Sat, 21 May 2022 08:43:10 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available DiskPressure False Sat, 21 May 2022 09:19:06 +0000 Sat, 21 May 2022 08:43:10 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure PIDPressure False Sat, 21 May 2022 09:19:06 +0000 Sat, 21 May 2022 08:43:10 +0000 KubeletHasSufficientPID kubelet has sufficient PID available Ready True Sat, 21 May 2022 09:19:06 +0000 Sat, 21 May 2022 08:43:16 +0000 KubeletReady kubelet is posting ready status Addresses: InternalIP: 192.168.58.2 Hostname: minikube Capacity: cpu: 4 ephemeral-storage: 65792556Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 7883940Ki pods: 110 Allocatable: cpu: 4 ephemeral-storage: 65792556Ki hugepages-1Gi: 0 hugepages-2Mi: 0 memory: 7883940Ki pods: 110 System Info: Machine ID: b6a262faae404a5db719705fd34b5c8b System UUID: b6a262faae404a5db719705fd34b5c8b Boot ID: b45b4988-ff7d-415d-b121-910dfadd5006 Kernel Version: 5.10.104-linuxkit OS Image: Ubuntu 20.04.2 LTS Operating System: linux Architecture: amd64 Container Runtime Version: docker://20.10.12 Kubelet Version: v1.23.3 Kube-Proxy Version: v1.23.3 PodCIDR: 10.244.0.0/24 PodCIDRs: 10.244.0.0/24 Non-terminated Pods: (8 in total) Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age --------- ---- ------------ ---------- --------------- ------------- --- kube-system coredns-64897985d-l7zqb 100m (2%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 37m kube-system coredns-64897985d-wbrqr 100m (2%!)(MISSING) 0 (0%!)(MISSING) 70Mi (0%!)(MISSING) 170Mi (2%!)(MISSING) 37m kube-system etcd-minikube 100m (2%!)(MISSING) 0 (0%!)(MISSING) 100Mi (1%!)(MISSING) 0 (0%!)(MISSING) 37m kube-system kube-apiserver-minikube 250m (6%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 37m kube-system kube-controller-manager-minikube 200m (5%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 37m kube-system kube-proxy-fpmwt 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 37m kube-system kube-scheduler-minikube 100m (2%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 37m kube-system storage-provisioner 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 0 (0%!)(MISSING) 34m Allocated resources: (Total limits may be over 100 percent, i.e., overcommitted.) Resource Requests Limits -------- -------- ------ cpu 850m (21%!)(MISSING) 0 (0%!)(MISSING) memory 240Mi (3%!)(MISSING) 340Mi (4%!)(MISSING) ephemeral-storage 0 (0%!)(MISSING) 0 (0%!)(MISSING) hugepages-1Gi 0 (0%!)(MISSING) 0 (0%!)(MISSING) hugepages-2Mi 0 (0%!)(MISSING) 0 (0%!)(MISSING) Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Starting 37m kube-proxy Normal NodeHasSufficientMemory 37m (x5 over 37m) kubelet Node minikube status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 37m (x5 over 37m) kubelet Node minikube status is now: NodeHasNoDiskPressure Normal NodeHasSufficientPID 37m (x5 over 37m) kubelet Node minikube status is now: NodeHasSufficientPID Normal NodeAllocatableEnforced 37m kubelet Updated Node Allocatable limit across pods Normal NodeHasSufficientMemory 37m kubelet Node minikube status is now: NodeHasSufficientMemory Normal NodeHasNoDiskPressure 37m kubelet Node minikube status is now: NodeHasNoDiskPressure Normal NodeHasSufficientPID 37m kubelet Node minikube status is now: NodeHasSufficientPID Normal NodeReady 37m kubelet Node minikube status is now: NodeReady Normal Starting 37m kubelet Starting kubelet. * * ==> dmesg <== * [May21 08:39] #2 [ +0.000969] #3 [ +1.217182] Hangcheck: starting hangcheck timer 0.9.1 (tick is 180 seconds, margin is 60 seconds). [ +0.003825] the cryptoloop driver has been deprecated and will be removed in in Linux 5.16 [ +4.715233] grpcfuse: loading out-of-tree module taints kernel. * * ==> etcd [45aac8c1ba3a] <== * {"level":"info","ts":"2022-05-21T08:43:10.403Z","caller":"etcdmain/etcd.go:72","msg":"Running: ","args":["etcd","--advertise-client-urls=https://192.168.58.2:2379","--cert-file=/var/lib/minikube/certs/etcd/server.crt","--client-cert-auth=true","--data-dir=/var/lib/minikube/etcd","--initial-advertise-peer-urls=https://192.168.58.2:2380","--initial-cluster=minikube=https://192.168.58.2:2380","--key-file=/var/lib/minikube/certs/etcd/server.key","--listen-client-urls=https://127.0.0.1:2379,https://192.168.58.2:2379","--listen-metrics-urls=http://127.0.0.1:2381","--listen-peer-urls=https://192.168.58.2:2380","--name=minikube","--peer-cert-file=/var/lib/minikube/certs/etcd/peer.crt","--peer-client-cert-auth=true","--peer-key-file=/var/lib/minikube/certs/etcd/peer.key","--peer-trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt","--proxy-refresh-interval=70000","--snapshot-count=10000","--trusted-ca-file=/var/lib/minikube/certs/etcd/ca.crt"]} {"level":"info","ts":"2022-05-21T08:43:10.404Z","caller":"embed/etcd.go:131","msg":"configuring peer listeners","listen-peer-urls":["https://192.168.58.2:2380"]} {"level":"info","ts":"2022-05-21T08:43:10.404Z","caller":"embed/etcd.go:478","msg":"starting with peer TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/peer.crt, key = /var/lib/minikube/certs/etcd/peer.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]} {"level":"info","ts":"2022-05-21T08:43:10.404Z","caller":"embed/etcd.go:139","msg":"configuring client listeners","listen-client-urls":["https://127.0.0.1:2379","https://192.168.58.2:2379"]} {"level":"info","ts":"2022-05-21T08:43:10.404Z","caller":"embed/etcd.go:307","msg":"starting an etcd server","etcd-version":"3.5.1","git-sha":"e8732fb5f","go-version":"go1.16.3","go-os":"linux","go-arch":"amd64","max-cpu-set":4,"max-cpu-available":4,"member-initialized":false,"name":"minikube","data-dir":"/var/lib/minikube/etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"/var/lib/minikube/etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":10000,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["https://192.168.58.2:2380"],"listen-peer-urls":["https://192.168.58.2:2380"],"advertise-client-urls":["https://192.168.58.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.58.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"],"cors":["*"],"host-whitelist":["*"],"initial-cluster":"minikube=https://192.168.58.2:2380","initial-cluster-state":"new","initial-cluster-token":"etcd-cluster","quota-size-bytes":2147483648,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","auto-compaction-mode":"periodic","auto-compaction-retention":"0s","auto-compaction-interval":"0s","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"} {"level":"info","ts":"2022-05-21T08:43:10.408Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"/var/lib/minikube/etcd/member/snap/db","took":"3.556304ms"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","caller":"etcdserver/raft.go:448","msg":"starting local member","local-member-id":"b2c6679ac05f2cf1","cluster-id":"3a56e4ca95e2355c"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 switched to configuration voters=()"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 became follower at term 0"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft b2c6679ac05f2cf1 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 became follower at term 1"} {"level":"info","ts":"2022-05-21T08:43:10.418Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 switched to configuration voters=(12882097698489969905)"} {"level":"warn","ts":"2022-05-21T08:43:10.422Z","caller":"auth/store.go:1220","msg":"simple token is not cryptographically signed"} {"level":"info","ts":"2022-05-21T08:43:10.424Z","caller":"mvcc/kvstore.go:415","msg":"kvstore restored","current-rev":1} {"level":"info","ts":"2022-05-21T08:43:10.426Z","caller":"etcdserver/quota.go:94","msg":"enabled backend quota with default value","quota-name":"v3-applier","quota-size-bytes":2147483648,"quota-size":"2.1 GB"} {"level":"info","ts":"2022-05-21T08:43:10.428Z","caller":"etcdserver/server.go:843","msg":"starting etcd server","local-member-id":"b2c6679ac05f2cf1","local-server-version":"3.5.1","cluster-version":"to_be_decided"} {"level":"info","ts":"2022-05-21T08:43:10.431Z","caller":"etcdserver/server.go:728","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"b2c6679ac05f2cf1","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"} {"level":"info","ts":"2022-05-21T08:43:10.437Z","caller":"embed/etcd.go:687","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]} {"level":"info","ts":"2022-05-21T08:43:10.437Z","caller":"embed/etcd.go:276","msg":"now serving peer/client/metrics","local-member-id":"b2c6679ac05f2cf1","initial-advertise-peer-urls":["https://192.168.58.2:2380"],"listen-peer-urls":["https://192.168.58.2:2380"],"advertise-client-urls":["https://192.168.58.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.58.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]} {"level":"info","ts":"2022-05-21T08:43:10.437Z","caller":"embed/etcd.go:762","msg":"serving metrics","address":"http://127.0.0.1:2381"} {"level":"info","ts":"2022-05-21T08:43:10.437Z","caller":"embed/etcd.go:580","msg":"serving peer traffic","address":"192.168.58.2:2380"} {"level":"info","ts":"2022-05-21T08:43:10.437Z","caller":"embed/etcd.go:552","msg":"cmux::serve","address":"192.168.58.2:2380"} {"level":"info","ts":"2022-05-21T08:43:10.438Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 switched to configuration voters=(12882097698489969905)"} {"level":"info","ts":"2022-05-21T08:43:10.438Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"3a56e4ca95e2355c","local-member-id":"b2c6679ac05f2cf1","added-peer-id":"b2c6679ac05f2cf1","added-peer-peer-urls":["https://192.168.58.2:2380"]} {"level":"info","ts":"2022-05-21T08:43:11.218Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 is starting a new election at term 1"} {"level":"info","ts":"2022-05-21T08:43:11.218Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 became pre-candidate at term 1"} {"level":"info","ts":"2022-05-21T08:43:11.218Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 received MsgPreVoteResp from b2c6679ac05f2cf1 at term 1"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 became candidate at term 2"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 received MsgVoteResp from b2c6679ac05f2cf1 at term 2"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b2c6679ac05f2cf1 became leader at term 2"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: b2c6679ac05f2cf1 elected leader b2c6679ac05f2cf1 at term 2"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","caller":"etcdserver/server.go:2027","msg":"published local member to cluster through raft","local-member-id":"b2c6679ac05f2cf1","local-member-attributes":"{Name:minikube ClientURLs:[https://192.168.58.2:2379]}","request-path":"/0/members/b2c6679ac05f2cf1/attributes","cluster-id":"3a56e4ca95e2355c","publish-timeout":"7s"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","caller":"etcdserver/server.go:2476","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"} {"level":"info","ts":"2022-05-21T08:43:11.219Z","caller":"embed/serve.go:98","msg":"ready to serve client requests"} {"level":"info","ts":"2022-05-21T08:43:11.220Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"192.168.58.2:2379"} {"level":"info","ts":"2022-05-21T08:43:11.224Z","caller":"embed/serve.go:188","msg":"serving client traffic securely","address":"127.0.0.1:2379"} {"level":"info","ts":"2022-05-21T08:43:11.227Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"3a56e4ca95e2355c","local-member-id":"b2c6679ac05f2cf1","cluster-version":"3.5"} {"level":"info","ts":"2022-05-21T08:43:11.227Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"} {"level":"info","ts":"2022-05-21T08:43:11.227Z","caller":"etcdserver/server.go:2500","msg":"cluster version is updated","cluster-version":"3.5"} {"level":"info","ts":"2022-05-21T08:43:11.227Z","caller":"etcdmain/main.go:47","msg":"notifying init daemon"} {"level":"info","ts":"2022-05-21T08:43:11.227Z","caller":"etcdmain/main.go:53","msg":"successfully notified init daemon"} {"level":"info","ts":"2022-05-21T08:53:11.652Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":589} {"level":"info","ts":"2022-05-21T08:53:11.654Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":589,"took":"1.245258ms"} {"level":"info","ts":"2022-05-21T08:58:11.659Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":799} {"level":"info","ts":"2022-05-21T08:58:11.662Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":799,"took":"1.7395ms"} {"level":"info","ts":"2022-05-21T09:03:11.652Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1008} {"level":"info","ts":"2022-05-21T09:03:11.653Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1008,"took":"385.334µs"} {"level":"info","ts":"2022-05-21T09:08:11.644Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1217} {"level":"info","ts":"2022-05-21T09:08:11.646Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1217,"took":"921.144µs"} {"level":"info","ts":"2022-05-21T09:13:11.647Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1428} {"level":"info","ts":"2022-05-21T09:13:11.647Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1428,"took":"336.853µs"} {"level":"info","ts":"2022-05-21T09:18:11.508Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1636} {"level":"info","ts":"2022-05-21T09:18:11.510Z","caller":"mvcc/kvstore_compaction.go:57","msg":"finished scheduled compaction","compact-revision":1636,"took":"1.133362ms"} * * ==> kernel <== * 09:20:57 up 41 min, 0 users, load average: 1.43, 1.05, 0.63 Linux minikube 5.10.104-linuxkit #1 SMP Thu Mar 17 17:08:06 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux PRETTY_NAME="Ubuntu 20.04.2 LTS" * * ==> kube-apiserver [f5ac5d10e710] <== * W0521 08:43:12.492366 1 genericapiserver.go:538] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. I0521 08:43:12.494951 1 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. I0521 08:43:12.494962 1 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. W0521 08:43:12.515202 1 genericapiserver.go:538] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. I0521 08:43:13.205903 1 dynamic_cafile_content.go:156] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt" I0521 08:43:13.206004 1 dynamic_serving_content.go:131] "Starting controller" name="serving-cert::/var/lib/minikube/certs/apiserver.crt::/var/lib/minikube/certs/apiserver.key" I0521 08:43:13.206281 1 secure_serving.go:266] Serving securely on [::]:8443 I0521 08:43:13.206399 1 autoregister_controller.go:141] Starting autoregister controller I0521 08:43:13.206407 1 cache.go:32] Waiting for caches to sync for autoregister controller I0521 08:43:13.206443 1 apf_controller.go:317] Starting API Priority and Fairness config controller I0521 08:43:13.206673 1 dynamic_serving_content.go:131] "Starting controller" name="aggregator-proxy-cert::/var/lib/minikube/certs/front-proxy-client.crt::/var/lib/minikube/certs/front-proxy-client.key" I0521 08:43:13.207049 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" I0521 08:43:13.205911 1 dynamic_cafile_content.go:156] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt" I0521 08:43:13.224610 1 apiservice_controller.go:97] Starting APIServiceRegistrationController I0521 08:43:13.224629 1 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller I0521 08:43:13.224665 1 available_controller.go:491] Starting AvailableConditionController I0521 08:43:13.224674 1 cache.go:32] Waiting for caches to sync for AvailableConditionController controller I0521 08:43:13.224712 1 controller.go:83] Starting OpenAPI AggregationController I0521 08:43:13.224742 1 crdregistration_controller.go:111] Starting crd-autoregister controller I0521 08:43:13.224752 1 shared_informer.go:240] Waiting for caches to sync for crd-autoregister I0521 08:43:13.229332 1 controller.go:85] Starting OpenAPI controller I0521 08:43:13.229369 1 naming_controller.go:291] Starting NamingConditionController I0521 08:43:13.229391 1 establishing_controller.go:76] Starting EstablishingController I0521 08:43:13.229424 1 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController I0521 08:43:13.229448 1 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController I0521 08:43:13.229465 1 crd_finalizer.go:266] Starting CRDFinalizer I0521 08:43:13.229477 1 customresource_discovery_controller.go:209] Starting DiscoveryController I0521 08:43:13.232066 1 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller I0521 08:43:13.232113 1 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller I0521 08:43:13.232584 1 dynamic_cafile_content.go:156] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt" I0521 08:43:13.242462 1 dynamic_cafile_content.go:156] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt" I0521 08:43:13.324746 1 cache.go:39] Caches are synced for AvailableConditionController controller I0521 08:43:13.324765 1 cache.go:39] Caches are synced for APIServiceRegistrationController controller I0521 08:43:13.324777 1 shared_informer.go:247] Caches are synced for crd-autoregister I0521 08:43:13.332164 1 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller I0521 08:43:13.335131 1 shared_informer.go:247] Caches are synced for node_authorizer I0521 08:43:13.337434 1 controller.go:611] quota admission added evaluator for: namespaces I0521 08:43:13.407605 1 cache.go:39] Caches are synced for autoregister controller I0521 08:43:13.407615 1 apf_controller.go:322] Running API Priority and Fairness config worker I0521 08:43:14.206387 1 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue). I0521 08:43:14.206443 1 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue). I0521 08:43:14.232336 1 storage_scheduling.go:93] created PriorityClass system-node-critical with value 2000001000 I0521 08:43:14.241603 1 storage_scheduling.go:93] created PriorityClass system-cluster-critical with value 2000000000 I0521 08:43:14.241741 1 storage_scheduling.go:109] all system priority classes are created successfully or already exist. I0521 08:43:14.546608 1 controller.go:611] quota admission added evaluator for: roles.rbac.authorization.k8s.io I0521 08:43:14.575470 1 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io I0521 08:43:14.646341 1 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs=map[IPv4:10.96.0.1] W0521 08:43:14.652922 1 lease.go:233] Resetting endpoints for master service "kubernetes" to [192.168.58.2] I0521 08:43:14.653880 1 controller.go:611] quota admission added evaluator for: endpoints I0521 08:43:14.659125 1 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io I0521 08:43:15.374555 1 controller.go:611] quota admission added evaluator for: serviceaccounts I0521 08:43:16.330338 1 controller.go:611] quota admission added evaluator for: deployments.apps I0521 08:43:16.342862 1 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.96.0.10] I0521 08:43:16.355649 1 controller.go:611] quota admission added evaluator for: daemonsets.apps I0521 08:43:16.493413 1 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io I0521 08:43:29.702735 1 controller.go:611] quota admission added evaluator for: controllerrevisions.apps I0521 08:43:29.767306 1 controller.go:611] quota admission added evaluator for: replicasets.apps I0521 08:43:30.382470 1 controller.go:611] quota admission added evaluator for: events.events.k8s.io W0521 09:04:10.591854 1 watcher.go:229] watch chan error: etcdserver: mvcc: required revision has been compacted W0521 09:19:52.999984 1 watcher.go:229] watch chan error: etcdserver: mvcc: required revision has been compacted * * ==> kube-controller-manager [a411deccc107] <== * I0521 08:43:29.411156 1 node_ipam_controller.go:154] Starting ipam controller I0521 08:43:29.411182 1 shared_informer.go:240] Waiting for caches to sync for node I0521 08:43:29.418583 1 controllermanager.go:605] Started "root-ca-cert-publisher" I0521 08:43:29.418880 1 publisher.go:107] Starting root CA certificate configmap publisher I0521 08:43:29.418906 1 shared_informer.go:240] Waiting for caches to sync for crt configmap I0521 08:43:29.422928 1 shared_informer.go:240] Waiting for caches to sync for resource quota I0521 08:43:29.435402 1 shared_informer.go:247] Caches are synced for cronjob W0521 08:43:29.436483 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="minikube" does not exist I0521 08:43:29.443890 1 shared_informer.go:240] Waiting for caches to sync for garbage collector I0521 08:43:29.471611 1 shared_informer.go:247] Caches are synced for TTL after finished I0521 08:43:29.509317 1 shared_informer.go:247] Caches are synced for certificate-csrapproving I0521 08:43:29.511791 1 shared_informer.go:247] Caches are synced for node I0521 08:43:29.511829 1 range_allocator.go:173] Starting range CIDR allocator I0521 08:43:29.511854 1 shared_informer.go:240] Waiting for caches to sync for cidrallocator I0521 08:43:29.511865 1 shared_informer.go:247] Caches are synced for cidrallocator I0521 08:43:29.514446 1 shared_informer.go:247] Caches are synced for TTL I0521 08:43:29.514624 1 shared_informer.go:247] Caches are synced for PV protection I0521 08:43:29.516467 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator I0521 08:43:29.516476 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving I0521 08:43:29.516433 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client I0521 08:43:29.517167 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client I0521 08:43:29.517928 1 range_allocator.go:374] Set node minikube PodCIDR to [10.244.0.0/24] I0521 08:43:29.518409 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown I0521 08:43:29.518410 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring I0521 08:43:29.518417 1 shared_informer.go:247] Caches are synced for expand I0521 08:43:29.562731 1 shared_informer.go:247] Caches are synced for service account I0521 08:43:29.579068 1 shared_informer.go:247] Caches are synced for namespace I0521 08:43:29.660604 1 shared_informer.go:247] Caches are synced for bootstrap_signer I0521 08:43:29.692578 1 shared_informer.go:247] Caches are synced for daemon sets I0521 08:43:29.704870 1 shared_informer.go:247] Caches are synced for HPA I0521 08:43:29.708947 1 event.go:294] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-fpmwt" I0521 08:43:29.711545 1 shared_informer.go:247] Caches are synced for stateful set I0521 08:43:29.717368 1 shared_informer.go:247] Caches are synced for GC I0521 08:43:29.717767 1 shared_informer.go:247] Caches are synced for job I0521 08:43:29.718685 1 shared_informer.go:247] Caches are synced for persistent volume I0521 08:43:29.718979 1 shared_informer.go:247] Caches are synced for crt configmap I0521 08:43:29.723153 1 shared_informer.go:247] Caches are synced for endpoint_slice I0521 08:43:29.723229 1 shared_informer.go:247] Caches are synced for resource quota I0521 08:43:29.727953 1 shared_informer.go:247] Caches are synced for ReplicaSet I0521 08:43:29.759542 1 shared_informer.go:247] Caches are synced for disruption I0521 08:43:29.759559 1 disruption.go:371] Sending events to api server. I0521 08:43:29.759599 1 shared_informer.go:247] Caches are synced for ephemeral I0521 08:43:29.759756 1 shared_informer.go:247] Caches are synced for deployment I0521 08:43:29.761757 1 shared_informer.go:247] Caches are synced for ReplicationController I0521 08:43:29.763870 1 shared_informer.go:247] Caches are synced for attach detach I0521 08:43:29.766374 1 shared_informer.go:247] Caches are synced for taint I0521 08:43:29.766411 1 taint_manager.go:187] "Starting NoExecuteTaintManager" I0521 08:43:29.766523 1 node_lifecycle_controller.go:1397] Initializing eviction metric for zone: W0521 08:43:29.766607 1 node_lifecycle_controller.go:1012] Missing timestamp for Node minikube. Assuming now as a timestamp. I0521 08:43:29.766679 1 node_lifecycle_controller.go:1213] Controller detected that zone is now in state Normal. I0521 08:43:29.766881 1 shared_informer.go:247] Caches are synced for endpoint I0521 08:43:29.766890 1 event.go:294] "Event occurred" object="minikube" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node minikube event: Registered Node minikube in Controller" I0521 08:43:29.771393 1 shared_informer.go:247] Caches are synced for resource quota I0521 08:43:29.775920 1 event.go:294] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-64897985d to 2" I0521 08:43:29.779808 1 shared_informer.go:247] Caches are synced for PVC protection I0521 08:43:29.788508 1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-wbrqr" I0521 08:43:29.798527 1 event.go:294] "Event occurred" object="kube-system/coredns-64897985d" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-64897985d-l7zqb" I0521 08:43:30.144199 1 shared_informer.go:247] Caches are synced for garbage collector I0521 08:43:30.210182 1 shared_informer.go:247] Caches are synced for garbage collector I0521 08:43:30.210199 1 garbagecollector.go:155] Garbage collector: all resource monitors have synced. Proceeding to collect garbage * * ==> kube-proxy [61f87c5d0ee3] <== * I0521 08:43:30.354764 1 node.go:163] Successfully retrieved node IP: 192.168.58.2 I0521 08:43:30.354813 1 server_others.go:138] "Detected node IP" address="192.168.58.2" I0521 08:43:30.354833 1 server_others.go:561] "Unknown proxy mode, assuming iptables proxy" proxyMode="" I0521 08:43:30.379520 1 server_others.go:206] "Using iptables Proxier" I0521 08:43:30.379545 1 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4 I0521 08:43:30.379552 1 server_others.go:214] "Creating dualStackProxier for iptables" I0521 08:43:30.379561 1 server_others.go:491] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6" I0521 08:43:30.379832 1 server.go:656] "Version info" version="v1.23.3" I0521 08:43:30.380720 1 config.go:317] "Starting service config controller" I0521 08:43:30.380743 1 shared_informer.go:240] Waiting for caches to sync for service config I0521 08:43:30.381259 1 config.go:226] "Starting endpoint slice config controller" I0521 08:43:30.381269 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config I0521 08:43:30.481312 1 shared_informer.go:247] Caches are synced for service config I0521 08:43:30.482088 1 shared_informer.go:247] Caches are synced for endpoint slice config * * ==> kube-scheduler [a834ad6712d2] <== * I0521 08:43:11.028690 1 serving.go:348] Generated self-signed cert in-memory W0521 08:43:13.240461 1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system. Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA' W0521 08:43:13.240545 1 authentication.go:345] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system" W0521 08:43:13.240603 1 authentication.go:346] Continuing without authentication configuration. This may treat all requests as anonymous. W0521 08:43:13.240648 1 authentication.go:347] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false I0521 08:43:13.258163 1 server.go:139] "Starting Kubernetes Scheduler" version="v1.23.3" I0521 08:43:13.260036 1 secure_serving.go:200] Serving securely on 127.0.0.1:10259 I0521 08:43:13.260440 1 configmap_cafile_content.go:201] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" I0521 08:43:13.260471 1 shared_informer.go:240] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file I0521 08:43:13.260660 1 tlsconfig.go:240] "Starting DynamicServingCertificateController" W0521 08:43:13.314380 1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" E0521 08:43:13.314601 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" W0521 08:43:13.320568 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope E0521 08:43:13.320755 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope W0521 08:43:13.321013 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope E0521 08:43:13.321130 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope W0521 08:43:13.321239 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope E0521 08:43:13.321255 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope W0521 08:43:13.321350 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope E0521 08:43:13.321364 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope W0521 08:43:13.321436 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope E0521 08:43:13.321464 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope W0521 08:43:13.321518 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope E0521 08:43:13.321530 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope W0521 08:43:13.321569 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope E0521 08:43:13.321582 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope W0521 08:43:13.321616 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope E0521 08:43:13.321628 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope W0521 08:43:13.321654 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope E0521 08:43:13.321663 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope W0521 08:43:13.321698 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope E0521 08:43:13.321711 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope W0521 08:43:13.321746 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope E0521 08:43:13.321757 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope W0521 08:43:13.321797 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope E0521 08:43:13.321809 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope W0521 08:43:13.321139 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope E0521 08:43:13.324323 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope W0521 08:43:13.321184 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope E0521 08:43:13.324437 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope W0521 08:43:14.229654 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope E0521 08:43:14.229791 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope W0521 08:43:14.310113 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope E0521 08:43:14.310358 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope W0521 08:43:14.356329 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope E0521 08:43:14.356467 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope W0521 08:43:14.382702 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope E0521 08:43:14.382845 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope W0521 08:43:14.406896 1 reflector.go:324] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" E0521 08:43:14.406914 1 reflector.go:138] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:205: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system" W0521 08:43:14.417739 1 reflector.go:324] k8s.io/client-go/informers/factory.go:134: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope E0521 08:43:14.417815 1 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope E0521 08:43:15.484245 1 plugin.go:138] "getting namespace, assuming empty set of namespace labels" err="namespace \"kube-system\" not found" namespace="kube-system" I0521 08:43:16.361689 1 shared_informer.go:247] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file * * ==> kubelet <== * -- Logs begin at Sat 2022-05-21 08:43:01 UTC, end at Sat 2022-05-21 09:20:57 UTC. -- May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.616984 1720 kubelet_node_status.go:70] "Attempting to register node" node="minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.628837 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.628911 1720 kubelet_node_status.go:108] "Node was previously registered" node="minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.628942 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.628977 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.628978 1720 kubelet_node_status.go:73] "Successfully registered node" node="minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.629055 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:16 minikube kubelet[1720]: E0521 08:43:16.636236 1720 kubelet.go:1711] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-minikube\" already exists" pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.696998 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-ca-certs\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697063 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-usr-share-ca-certificates\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697084 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b7b1a80caec341a470c95988d72c0626-usr-local-share-ca-certificates\") pod \"kube-apiserver-minikube\" (UID: \"b7b1a80caec341a470c95988d72c0626\") " pod="kube-system/kube-apiserver-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697103 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b7b1a80caec341a470c95988d72c0626-usr-share-ca-certificates\") pod \"kube-apiserver-minikube\" (UID: \"b7b1a80caec341a470c95988d72c0626\") " pod="kube-system/kube-apiserver-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697133 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-etc-ca-certificates\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697152 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-share-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-usr-local-share-ca-certificates\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697169 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/be132fe5c6572cb34d93f5e05ce2a540-kubeconfig\") pod \"kube-scheduler-minikube\" (UID: \"be132fe5c6572cb34d93f5e05ce2a540\") " pod="kube-system/kube-scheduler-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697184 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"flexvolume-dir\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-flexvolume-dir\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697211 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-kubeconfig\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697247 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-certs\" (UniqueName: \"kubernetes.io/host-path/b7b1a80caec341a470c95988d72c0626-ca-certs\") pod \"kube-apiserver-minikube\" (UID: \"b7b1a80caec341a470c95988d72c0626\") " pod="kube-system/kube-apiserver-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697285 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b7b1a80caec341a470c95988d72c0626-k8s-certs\") pod \"kube-apiserver-minikube\" (UID: \"b7b1a80caec341a470c95988d72c0626\") " pod="kube-system/kube-apiserver-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697301 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"k8s-certs\" (UniqueName: \"kubernetes.io/host-path/b965983ec05322d0973594a01d5e8245-k8s-certs\") pod \"kube-controller-manager-minikube\" (UID: \"b965983ec05322d0973594a01d5e8245\") " pod="kube-system/kube-controller-manager-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697316 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-certs\" (UniqueName: \"kubernetes.io/host-path/482305b50d4b0d3dbab5b9f1be9b0b18-etcd-certs\") pod \"etcd-minikube\" (UID: \"482305b50d4b0d3dbab5b9f1be9b0b18\") " pod="kube-system/etcd-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697330 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-data\" (UniqueName: \"kubernetes.io/host-path/482305b50d4b0d3dbab5b9f1be9b0b18-etcd-data\") pod \"etcd-minikube\" (UID: \"482305b50d4b0d3dbab5b9f1be9b0b18\") " pod="kube-system/etcd-minikube" May 21 08:43:16 minikube kubelet[1720]: I0521 08:43:16.697358 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ca-certificates\" (UniqueName: \"kubernetes.io/host-path/b7b1a80caec341a470c95988d72c0626-etc-ca-certificates\") pod \"kube-apiserver-minikube\" (UID: \"b7b1a80caec341a470c95988d72c0626\") " pod="kube-system/kube-apiserver-minikube" May 21 08:43:17 minikube kubelet[1720]: I0521 08:43:17.469158 1720 apiserver.go:52] "Watching apiserver" May 21 08:43:17 minikube kubelet[1720]: I0521 08:43:17.703971 1720 reconciler.go:157] "Reconciler: start to sync state" May 21 08:43:18 minikube kubelet[1720]: E0521 08:43:18.084470 1720 kubelet.go:1711] "Failed creating a mirror pod for" err="pods \"kube-controller-manager-minikube\" already exists" pod="kube-system/kube-controller-manager-minikube" May 21 08:43:18 minikube kubelet[1720]: E0521 08:43:18.278851 1720 kubelet.go:1711] "Failed creating a mirror pod for" err="pods \"etcd-minikube\" already exists" pod="kube-system/etcd-minikube" May 21 08:43:18 minikube kubelet[1720]: E0521 08:43:18.484669 1720 kubelet.go:1711] "Failed creating a mirror pod for" err="pods \"kube-scheduler-minikube\" already exists" pod="kube-system/kube-scheduler-minikube" May 21 08:43:18 minikube kubelet[1720]: I0521 08:43:18.668410 1720 request.go:665] Waited for 1.115596023s due to client-side throttling, not priority and fairness, request: POST:https://control-plane.minikube.internal:8443/api/v1/namespaces/kube-system/pods May 21 08:43:18 minikube kubelet[1720]: E0521 08:43:18.676109 1720 kubelet.go:1711] "Failed creating a mirror pod for" err="pods \"kube-apiserver-minikube\" already exists" pod="kube-system/kube-apiserver-minikube" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.589645 1720 kuberuntime_manager.go:1098] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.590245 1720 docker_service.go:364] "Docker cri received runtime config" runtimeConfig="&RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.244.0.0/24,},}" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.590485 1720 kubelet_network.go:76] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.713630 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.790616 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/b8301fef-9ad2-414c-a118-0d3a4d790479-xtables-lock\") pod \"kube-proxy-fpmwt\" (UID: \"b8301fef-9ad2-414c-a118-0d3a4d790479\") " pod="kube-system/kube-proxy-fpmwt" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.790813 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8301fef-9ad2-414c-a118-0d3a4d790479-lib-modules\") pod \"kube-proxy-fpmwt\" (UID: \"b8301fef-9ad2-414c-a118-0d3a4d790479\") " pod="kube-system/kube-proxy-fpmwt" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.790850 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz2zn\" (UniqueName: \"kubernetes.io/projected/b8301fef-9ad2-414c-a118-0d3a4d790479-kube-api-access-tz2zn\") pod \"kube-proxy-fpmwt\" (UID: \"b8301fef-9ad2-414c-a118-0d3a4d790479\") " pod="kube-system/kube-proxy-fpmwt" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.790873 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/b8301fef-9ad2-414c-a118-0d3a4d790479-kube-proxy\") pod \"kube-proxy-fpmwt\" (UID: \"b8301fef-9ad2-414c-a118-0d3a4d790479\") " pod="kube-system/kube-proxy-fpmwt" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.796719 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.805213 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.892020 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwl2g\" (UniqueName: \"kubernetes.io/projected/01c06341-fbd6-44e5-994b-c57990fe4aad-kube-api-access-xwl2g\") pod \"coredns-64897985d-wbrqr\" (UID: \"01c06341-fbd6-44e5-994b-c57990fe4aad\") " pod="kube-system/coredns-64897985d-wbrqr" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.892501 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b53bdd0-eaa7-48ac-9ed0-67879df3dbc1-config-volume\") pod \"coredns-64897985d-l7zqb\" (UID: \"4b53bdd0-eaa7-48ac-9ed0-67879df3dbc1\") " pod="kube-system/coredns-64897985d-l7zqb" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.892792 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnnpd\" (UniqueName: \"kubernetes.io/projected/4b53bdd0-eaa7-48ac-9ed0-67879df3dbc1-kube-api-access-nnnpd\") pod \"coredns-64897985d-l7zqb\" (UID: \"4b53bdd0-eaa7-48ac-9ed0-67879df3dbc1\") " pod="kube-system/coredns-64897985d-l7zqb" May 21 08:43:29 minikube kubelet[1720]: I0521 08:43:29.893071 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01c06341-fbd6-44e5-994b-c57990fe4aad-config-volume\") pod \"coredns-64897985d-wbrqr\" (UID: \"01c06341-fbd6-44e5-994b-c57990fe4aad\") " pod="kube-system/coredns-64897985d-wbrqr" May 21 08:43:30 minikube kubelet[1720]: I0521 08:43:30.650998 1720 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="9f098cb4744a1feac036b143a7414d7e2a2205a764ccf1cd24f43ab58864e993" May 21 08:43:30 minikube kubelet[1720]: I0521 08:43:30.652295 1720 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-64897985d-wbrqr through plugin: invalid network status for" May 21 08:43:30 minikube kubelet[1720]: I0521 08:43:30.673262 1720 pod_container_deletor.go:79] "Container not found in pod's containers" containerID="7a5699700d0e33d8e5cf796520c63fc892b3b8e57e1cb7fa87427ecf91c02945" May 21 08:43:30 minikube kubelet[1720]: I0521 08:43:30.673371 1720 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-64897985d-l7zqb through plugin: invalid network status for" May 21 08:43:31 minikube kubelet[1720]: I0521 08:43:31.690472 1720 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-64897985d-wbrqr through plugin: invalid network status for" May 21 08:43:31 minikube kubelet[1720]: I0521 08:43:31.706097 1720 docker_sandbox.go:402] "Failed to read pod IP from plugin/docker" err="Couldn't find network status for kube-system/coredns-64897985d-l7zqb through plugin: invalid network status for" May 21 08:46:19 minikube kubelet[1720]: I0521 08:46:19.752705 1720 topology_manager.go:200] "Topology Admit Handler" May 21 08:46:19 minikube kubelet[1720]: I0521 08:46:19.855965 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xftqn\" (UniqueName: \"kubernetes.io/projected/770c4429-7342-48d0-833e-746a8a96e920-kube-api-access-xftqn\") pod \"storage-provisioner\" (UID: \"770c4429-7342-48d0-833e-746a8a96e920\") " pod="kube-system/storage-provisioner" May 21 08:46:19 minikube kubelet[1720]: I0521 08:46:19.856106 1720 reconciler.go:221] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/770c4429-7342-48d0-833e-746a8a96e920-tmp\") pod \"storage-provisioner\" (UID: \"770c4429-7342-48d0-833e-746a8a96e920\") " pod="kube-system/storage-provisioner" May 21 08:48:16 minikube kubelet[1720]: W0521 08:48:16.557892 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 08:53:16 minikube kubelet[1720]: W0521 08:53:16.592286 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 08:58:16 minikube kubelet[1720]: W0521 08:58:16.587386 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 09:03:16 minikube kubelet[1720]: W0521 09:03:16.581991 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 09:08:16 minikube kubelet[1720]: W0521 09:08:16.558145 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 09:13:16 minikube kubelet[1720]: W0521 09:13:16.548642 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology May 21 09:18:16 minikube kubelet[1720]: W0521 09:18:16.401536 1720 sysinfo.go:203] Nodes topology is not available, providing CPU topology * * ==> storage-provisioner [caa057bd325d] <== * I0521 08:46:20.326472 1 storage_provisioner.go:116] Initializing the minikube storage provisioner... I0521 08:46:20.335468 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service! I0521 08:46:20.335506 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath... I0521 08:46:20.348279 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath I0521 08:46:20.348414 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_minikube_1304d423-2afe-4c96-91f3-34234d30a3b9! I0521 08:46:20.348380 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"c3a35451-2de3-402e-8d2d-6818ee8fed9e", APIVersion:"v1", ResourceVersion:"509", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' minikube_1304d423-2afe-4c96-91f3-34234d30a3b9 became leader I0521 08:46:20.449447 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_minikube_1304d423-2afe-4c96-91f3-34234d30a3b9!