Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

minikube v1.33.0 + Cilium is broken on Mac (CrashLoopBackOff) #18857

Closed
ofirc opened this issue May 11, 2024 · 3 comments
Closed

minikube v1.33.0 + Cilium is broken on Mac (CrashLoopBackOff) #18857

ofirc opened this issue May 11, 2024 · 3 comments

Comments

@ofirc
Copy link

ofirc commented May 11, 2024 •
edited
Loading

What Happened?

On my MacBook Air M2 (Sonoma 14.1.2 (23B92)), mininkube doesn't work with Cilium as CNI plugin.

Minikube version:

$ minikube version
minikube version: v1.33.0
commit: 86fc9d54fca63f295d8737c8eacdbb7987e89c67
$

The Cilium DaemonSet Pod and CoreDNS enter an infinite CrashLoopBackOff loop:

Events:
  Type     Reason               Age                   From               Message
  ----     ------               ----                  ----               -------
  Normal   Scheduled            23m                   default-scheduler  Successfully assigned kube-system/cilium-b6m22 to minikube
  Normal   Pulling              23m                   kubelet            Pulling image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4"
  Normal   Pulled               23m                   kubelet            Successfully pulled image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4" in 17.914s (17.914s including waiting). Image size: 555410445 bytes.
  Normal   Created              23m                   kubelet            Created container mount-cgroup
  Normal   Started              23m                   kubelet            Started container mount-cgroup
  Normal   Pulling              23m                   kubelet            Pulling image "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826"
  Normal   Pulled               23m                   kubelet            Successfully pulled image "quay.io/cilium/cilium:v1.12.3@sha256:30de50c4dc0a1e1077e9e7917a54d5cab253058b3f779822aec00f5c817ca826" in 12.603s (20.23s including waiting). Image size: 430545865 bytes.
  Normal   Created              23m                   kubelet            Created container clean-cilium-state
  Normal   Started              23m                   kubelet            Started container clean-cilium-state
  Normal   Killing              23m (x2 over 23m)     kubelet            FailedPostStartHook
  Normal   Pulled               22m (x3 over 23m)     kubelet            Container image "quay.io/cilium/cilium:v1.15.1@sha256:351d6685dc6f6ffbcd5451043167cfa8842c6decf80d8c8e426a417c73fb56d4" already present on machine
  Normal   Created              22m (x3 over 23m)     kubelet            Created container cilium-agent
  Normal   Started              22m (x3 over 23m)     kubelet            Started container cilium-agent
  Warning  FailedPostStartHook  22m (x3 over 23m)     kubelet            PostStartHook failed
  Warning  BackOff              3m53s (x98 over 23m)  kubelet            Back-off restarting failed container cilium-agent in pod cilium-b6m22_kube-system(b675dfc2-5dbd-4733-9b47-f99bf7828aa0)

The logs don't show anything useful:

$ kubectl logs cilium-b6m22 -n kube-system
Defaulted container "cilium-agent" out of: cilium-agent, mount-cgroup (init), clean-cilium-state (init)
$

The kubectl describe pod cilium-b6m22 -n kube-system reveal the symptom - PostStartHook failed.

This is how the Pods status look like:

$ kubectl get pod -n kube-system
NAME                               READY   STATUS             RESTARTS      AGE
cilium-b6m22                       0/1     CrashLoopBackOff   7 (79s ago)   12m
cilium-operator-86f4c5579c-dx799   1/1     Running            0             12m
coredns-7db6d8ff4d-q2wgd           0/1     CrashLoopBackOff   9 (29s ago)   12m
etcd-minikube                      1/1     Running            0             12m
kube-apiserver-minikube            1/1     Running            0             12m
kube-controller-manager-minikube   1/1     Running            0             12m
kube-proxy-xmhgn                   1/1     Running            0             12m
kube-scheduler-minikube            1/1     Running            0             12m
storage-provisioner                1/1     Running            1 (12m ago)   12m
$

To reproduce:

brew update
brew upgrade
brew install minikube
minikube start --cni=cilium

This seems like a regression as it used to work without any problems on this machine.

It also reproduces on my other MacBook Pro 16' M2.

Attach the log file

==> Audit <==
|---------|--------------|----------|-----------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------|----------|-----------|---------|---------------------|---------------------|
| start | --cni=cilium | minikube | ofircohen | v1.33.0 | 11 May 24 16:55 IDT | 11 May 24 16:56 IDT |
|---------|--------------|----------|-----------|---------|---------------------|---------------------|

==> Last Start <==
Log file created at: 2024/05/11 16:55:01
Running on machine: Ofirs-MacBook-Air
Binary: Built with gc go1.22.2 for darwin/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0511 16:55:01.631231 98749 out.go:291] Setting OutFile to fd 1 ...
I0511 16:55:01.631710 98749 out.go:343] isatty.IsTerminal(1) = true
I0511 16:55:01.631712 98749 out.go:304] Setting ErrFile to fd 2...
I0511 16:55:01.631714 98749 out.go:343] isatty.IsTerminal(2) = true
I0511 16:55:01.631861 98749 root.go:338] Updating PATH: /Users/ofircohen/.minikube/bin
W0511 16:55:01.631969 98749 root.go:314] Error reading config file at /Users/ofircohen/.minikube/config/config.json: open /Users/ofircohen/.minikube/config/config.json: no such file or directory
I0511 16:55:01.632698 98749 out.go:298] Setting JSON to false
I0511 16:55:01.650178 98749 start.go:129] hostinfo: {"hostname":"Ofirs-MacBook-Air.local","uptime":13356969,"bootTime":1702078732,"procs":594,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.1.2","kernelVersion":"23.1.0","kernelArch":"arm64","virtualizationSystem":"","virtualizationRole":"","hostId":"c8b5fb5b-b925-566d-b723-1c23ead5117c"}
W0511 16:55:01.650234 98749 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0511 16:55:01.661248 98749 out.go:177] 😄 minikube v1.33.0 on Darwin 14.1.2 (arm64)
W0511 16:55:01.674706 98749 preload.go:294] Failed to list preload files: open /Users/ofircohen/.minikube/cache/preloaded-tarball: no such file or directory
I0511 16:55:01.674857 98749 notify.go:220] Checking for updates...
I0511 16:55:01.675171 98749 driver.go:392] Setting default libvirt URI to qemu:///system
I0511 16:55:01.675201 98749 global.go:112] Querying for installed drivers using PATH=/Users/ofircohen/.minikube/bin:/opt/homebrew/bin:/opt/homebrew/sbin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/local/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/bin:/var/run/com.apple.security.cryptexd/codex.system/bootstrap/usr/appleinternal/bin:/usr/local/go/bin
I0511 16:55:01.675713 98749 global.go:133] qemu2 default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "qemu-system-aarch64": executable file not found in $PATH Reason: Fix:Install qemu-system Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/qemu/ Version:}
I0511 16:55:01.675774 98749 global.go:133] virtualbox default: true priority: 6, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:unable to find VBoxManage in $PATH Reason: Fix:Install VirtualBox Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/virtualbox/ Version:}
I0511 16:55:01.675829 98749 global.go:133] vmware default: false priority: 5, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "vmrun": executable file not found in $PATH Reason: Fix:Install vmrun Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/vmware/ Version:}
I0511 16:55:01.772138 98749 docker.go:122] docker version: linux-26.0.0:Docker Desktop 4.29.0 (145265)
I0511 16:55:01.772399 98749 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0511 16:55:02.058000 98749 info.go:266] docker info: {ID:b35012e7-6720-4de9-95f2-2935200ad1d1 Containers:10 ContainersRunning:0 ContainersPaused:0 ContainersStopped:10 Images:14 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:95 SystemTime:2024-05-11 13:55:02.044439013 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:23 KernelVersion:6.6.22-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:8222072832 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=unix:///Users/ofircohen/Library/Containers/com.docker.docker/Data/docker-cli.sock] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/ofircohen/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:/Users/ofircohen/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:/Users/ofircohen/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:/Users/ofircohen/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:/Users/ofircohen/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:/Users/ofircohen/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/ofircohen/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:/Users/ofircohen/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:/Users/ofircohen/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:}}
I0511 16:55:02.058093 98749 global.go:133] docker default: true priority: 9, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:}
I0511 16:55:02.058210 98749 global.go:133] podman default: true priority: 3, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "podman": executable file not found in $PATH Reason: Fix:Install Podman Doc:https://minikube.sigs.k8s.io/docs/drivers/podman/ Version:}
I0511 16:55:02.058224 98749 global.go:133] ssh default: false priority: 4, state: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:}
I0511 16:55:02.058525 98749 global.go:133] hyperkit default: true priority: 8, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "hyperkit": executable file not found in $PATH Reason: Fix:Run 'brew install hyperkit' Doc:https://minikube.sigs.k8s.io/docs/reference/drivers/hyperkit/ Version:}
I0511 16:55:02.058569 98749 global.go:133] parallels default: true priority: 7, state: {Installed:false Healthy:false Running:false NeedsImprovement:false Error:exec: "prlctl": executable file not found in $PATH Reason: Fix:Install Parallels Desktop for Mac Doc:https://minikube.sigs.k8s.io/docs/drivers/parallels/ Version:}
I0511 16:55:02.058581 98749 driver.go:314] not recommending "ssh" due to default: false
I0511 16:55:02.058590 98749 driver.go:349] Picked: docker
I0511 16:55:02.058593 98749 driver.go:350] Alternatives: [ssh]
I0511 16:55:02.058594 98749 driver.go:351] Rejects: [qemu2 virtualbox vmware podman hyperkit parallels]
I0511 16:55:02.063128 98749 out.go:177] ✨ Automatically selected the docker driver
I0511 16:55:02.071368 98749 start.go:297] selected driver: docker
I0511 16:55:02.071370 98749 start.go:901] validating driver "docker" against
I0511 16:55:02.071376 98749 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error: Reason: Fix: Doc: Version:}
I0511 16:55:02.071684 98749 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0511 16:55:02.148986 98749 info.go:266] docker info: {ID:b35012e7-6720-4de9-95f2-2935200ad1d1 Containers:10 ContainersRunning:0 ContainersPaused:0 ContainersStopped:10 Images:14 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus: Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization: Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:62 OomKillDisable:false NGoroutines:95 SystemTime:2024-05-11 13:55:02.135646263 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:23 KernelVersion:6.6.22-linuxkit OperatingSystem:Docker Desktop OSType:linux Architecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:8222072832 GenericResources: DockerRootDir:/var/lib/docker HTTPProxy:http.docker.internal:3128 HTTPSProxy:http.docker.internal:3128 NoProxy:hubproxy.docker.internal Name:docker-desktop Labels:[com.docker.desktop.address=unix:///Users/ofircohen/Library/Containers/com.docker.docker/Data/docker-cli.sock] ExperimentalBuild:false ServerVersion:26.0.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=seccomp,profile=unconfined name=cgroupns] ProductLicense: Warnings:[WARNING: daemon is not using the default seccomp profile] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/Users/ofircohen/.docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.13.1-desktop.1] map[Name:compose Path:/Users/ofircohen/.docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.26.1-desktop.1] map[Name:debug Path:/Users/ofircohen/.docker/cli-plugins/docker-debug SchemaVersion:0.1.0 ShortDescription:Get a shell into any image or container. Vendor:Docker Inc. Version:0.0.27] map[Name:dev Path:/Users/ofircohen/.docker/cli-plugins/docker-dev SchemaVersion:0.1.0 ShortDescription:Docker Dev Environments Vendor:Docker Inc. Version:v0.1.2] map[Name:extension Path:/Users/ofircohen/.docker/cli-plugins/docker-extension SchemaVersion:0.1.0 ShortDescription:Manages Docker extensions Vendor:Docker Inc. Version:v0.2.23] map[Name:feedback Path:/Users/ofircohen/.docker/cli-plugins/docker-feedback SchemaVersion:0.1.0 ShortDescription:Provide feedback, right in your terminal! Vendor:Docker Inc. Version:v1.0.4] map[Name:init Path:/Users/ofircohen/.docker/cli-plugins/docker-init SchemaVersion:0.1.0 ShortDescription:Creates Docker-related starter files for your project Vendor:Docker Inc. Version:v1.1.0] map[Name:sbom Path:/Users/ofircohen/.docker/cli-plugins/docker-sbom SchemaVersion:0.1.0 ShortDescription:View the packaged-based Software Bill Of Materials (SBOM) for an image URL:https://github.com/docker/sbom-cli-plugin Vendor:Anchore Inc. Version:0.6.0] map[Name:scout Path:/Users/ofircohen/.docker/cli-plugins/docker-scout SchemaVersion:0.1.0 ShortDescription:Docker Scout Vendor:Docker Inc. Version:v1.6.3]] Warnings:}}
I0511 16:55:02.149104 98749 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0511 16:55:02.149188 98749 start_flags.go:393] Using suggested 4000MB memory alloc based on sys=16384MB, container=7841MB
I0511 16:55:02.149778 98749 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
I0511 16:55:02.154361 98749 out.go:177] 📌 Using Docker Desktop driver with root privileges
I0511 16:55:02.158263 98749 cni.go:84] Creating CNI manager for "cilium"
I0511 16:55:02.158267 98749 start_flags.go:319] Found "Cilium" CNI - setting NetworkPlugin=cni
I0511 16:55:02.158504 98749 start.go:340] cluster config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0511 16:55:02.162139 98749 out.go:177] 👍 Starting "minikube" primary control-plane node in "minikube" cluster
I0511 16:55:02.170311 98749 cache.go:121] Beginning downloading kic base image for docker with docker
I0511 16:55:02.174296 98749 out.go:177] 🚜 Pulling base image v0.0.43 ...
I0511 16:55:02.182364 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I0511 16:55:02.182379 98749 image.go:79] Checking for gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 in local docker daemon
I0511 16:55:02.226121 98749 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 to local cache
I0511 16:55:02.226319 98749 image.go:63] Checking for gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 in local cache directory
I0511 16:55:02.226425 98749 image.go:118] Writing gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 to local cache
I0511 16:55:02.342987 98749 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.0/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4
I0511 16:55:02.343002 98749 cache.go:56] Caching tarball of preloaded images
I0511 16:55:02.345701 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I0511 16:55:02.351060 98749 out.go:177] 💾 Downloading Kubernetes v1.30.0 preload ...
I0511 16:55:02.359014 98749 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ...
I0511 16:55:02.599202 98749 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.30.0/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4?checksum=md5:677034533668c42fec962cc52f9b3c42 -> /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4
I0511 16:55:29.461266 98749 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ...
I0511 16:55:29.461430 98749 preload.go:255] verifying checksum of /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4 ...
I0511 16:55:30.051953 98749 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on docker
I0511 16:55:30.054001 98749 profile.go:143] Saving config to /Users/ofircohen/.minikube/profiles/minikube/config.json ...
I0511 16:55:30.055425 98749 lock.go:35] WriteFile acquiring /Users/ofircohen/.minikube/profiles/minikube/config.json: {Name:mk6e349d582ba5a26886ffe6b9463f994887af5d Clock:{} Delay:500ms Timeout:1m0s Cancel:}
I0511 16:55:38.538964 98749 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 as a tarball
I0511 16:55:38.538987 98749 cache.go:162] Loading gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 from local cache
I0511 16:55:47.970644 98749 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 from cached tarball
I0511 16:55:47.970770 98749 cache.go:194] Successfully downloaded all kic artifacts
I0511 16:55:47.983362 98749 start.go:360] acquireMachinesLock for minikube: {Name:mkfc5d3164d093f043553b55467a8e775ae5153f Clock:{} Delay:500ms Timeout:10m0s Cancel:}
I0511 16:55:47.990075 98749 start.go:364] duration metric: took 5.055291ms to acquireMachinesLock for "minikube"
I0511 16:55:47.990546 98749 start.go:93] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:minikube Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:cilium} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}
I0511 16:55:47.993326 98749 start.go:125] createHost starting for "" (driver="docker")
I0511 16:55:48.246378 98749 out.go:204] 🔥 Creating docker container (CPUs=2, Memory=4000MB) ...
I0511 16:55:48.278746 98749 start.go:159] libmachine.API.Create for "minikube" (driver="docker")
I0511 16:55:48.283727 98749 client.go:168] LocalClient.Create starting
I0511 16:55:48.297873 98749 main.go:141] libmachine: Creating CA: /Users/ofircohen/.minikube/certs/ca.pem
I0511 16:55:48.550963 98749 main.go:141] libmachine: Creating client certificate: /Users/ofircohen/.minikube/certs/cert.pem
I0511 16:55:48.673567 98749 cli_runner.go:164] Run: docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0511 16:55:48.717468 98749 cli_runner.go:211] docker network inspect minikube --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0511 16:55:48.717550 98749 network_create.go:281] running [docker network inspect minikube] to gather additional debugging logs...
I0511 16:55:48.717562 98749 cli_runner.go:164] Run: docker network inspect minikube
W0511 16:55:48.755720 98749 cli_runner.go:211] docker network inspect minikube returned with exit code 1
I0511 16:55:48.755762 98749 network_create.go:284] error running [docker network inspect minikube]: docker network inspect minikube: exit status 1
stdout:
[]

stderr:
Error response from daemon: network minikube not found
I0511 16:55:48.755775 98749 network_create.go:286] output of [docker network inspect minikube]: -- stdout --
[]

-- /stdout --
** stderr **
Error response from daemon: network minikube not found

** /stderr **
I0511 16:55:48.756098 98749 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0511 16:55:48.796049 98749 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x14016ba8270}
I0511 16:55:48.796397 98749 network_create.go:124] attempt to create docker network minikube 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 65535 ...
I0511 16:55:48.796694 98749 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=65535 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=minikube minikube
I0511 16:55:48.885290 98749 network_create.go:108] docker network minikube 192.168.49.0/24 created
I0511 16:55:48.890561 98749 kic.go:121] calculated static IP "192.168.49.2" for the "minikube" container
I0511 16:55:48.895953 98749 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0511 16:55:48.937230 98749 cli_runner.go:164] Run: docker volume create minikube --label name.minikube.sigs.k8s.io=minikube --label created_by.minikube.sigs.k8s.io=true
I0511 16:55:48.981526 98749 oci.go:103] Successfully created a docker volume minikube
I0511 16:55:48.981612 98749 cli_runner.go:164] Run: docker run --rm --name minikube-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --entrypoint /usr/bin/test -v minikube:/var gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -d /var/lib
I0511 16:55:49.741363 98749 oci.go:107] Successfully prepared a docker volume minikube
I0511 16:55:49.747926 98749 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker
I0511 16:55:49.758598 98749 kic.go:194] Starting extracting preloaded images to volume ...
I0511 16:55:49.763643 98749 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -I lz4 -xf /preloaded.tar -C /extractDir
I0511 16:55:53.335200 98749 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /Users/ofircohen/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v minikube:/extractDir gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 -I lz4 -xf /preloaded.tar -C /extractDir: (3.571360916s)
I0511 16:55:53.335306 98749 kic.go:203] duration metric: took 3.5766885s to extract preloaded images to volume ...
I0511 16:55:53.335522 98749 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0511 16:55:53.923417 98749 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname minikube --name minikube --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=minikube --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=minikube --network minikube --ip 192.168.49.2 --volume minikube:/var --security-opt apparmor=unconfined --memory=4000mb --memory-swap=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737
I0511 16:55:54.559333 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Running}}
I0511 16:55:54.609398 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}}
I0511 16:55:54.649289 98749 cli_runner.go:164] Run: docker exec minikube stat /var/lib/dpkg/alternatives/iptables
I0511 16:55:54.716272 98749 oci.go:144] the created container "minikube" has a running status.
I0511 16:55:54.716315 98749 kic.go:225] Creating ssh key for kic: /Users/ofircohen/.minikube/machines/minikube/id_rsa...
I0511 16:55:54.897063 98749 kic_runner.go:191] docker (temp): /Users/ofircohen/.minikube/machines/minikube/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0511 16:55:54.973609 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}}
I0511 16:55:55.025494 98749 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0511 16:55:55.025519 98749 kic_runner.go:114] Args: [docker exec --privileged minikube chown docker:docker /home/docker/.ssh/authorized_keys]
I0511 16:55:55.103460 98749 cli_runner.go:164] Run: docker container inspect minikube --format={{.State.Status}}
I0511 16:55:55.148186 98749 machine.go:94] provisionDockerMachine start ...
I0511 16:55:55.149092 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:55.191386 98749 main.go:141] libmachine: Using SSH client type: native
I0511 16:55:55.191993 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 }
I0511 16:55:55.191999 98749 main.go:141] libmachine: About to run SSH command:
hostname
I0511 16:55:55.319090 98749 main.go:141] libmachine: SSH cmd err, output: : minikube

I0511 16:55:55.319553 98749 ubuntu.go:169] provisioning hostname "minikube"
I0511 16:55:55.320033 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:55.362621 98749 main.go:141] libmachine: Using SSH client type: native
I0511 16:55:55.362790 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 }
I0511 16:55:55.362795 98749 main.go:141] libmachine: About to run SSH command:
sudo hostname minikube && echo "minikube" | sudo tee /etc/hostname
I0511 16:55:55.495109 98749 main.go:141] libmachine: SSH cmd err, output: : minikube

I0511 16:55:55.495429 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:55.548342 98749 main.go:141] libmachine: Using SSH client type: native
I0511 16:55:55.548560 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 }
I0511 16:55:55.548568 98749 main.go:141] libmachine: About to run SSH command:

	if ! grep -xq '.*\sminikube' /etc/hosts; then
		if grep -xq '127.0.1.1\s.*' /etc/hosts; then
			sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 minikube/g' /etc/hosts;
		else 
			echo '127.0.1.1 minikube' | sudo tee -a /etc/hosts; 
		fi
	fi

I0511 16:55:55.680494 98749 main.go:141] libmachine: SSH cmd err, output: :
I0511 16:55:55.680516 98749 ubuntu.go:175] set auth options {CertDir:/Users/ofircohen/.minikube CaCertPath:/Users/ofircohen/.minikube/certs/ca.pem CaPrivateKeyPath:/Users/ofircohen/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/Users/ofircohen/.minikube/machines/server.pem ServerKeyPath:/Users/ofircohen/.minikube/machines/server-key.pem ClientKeyPath:/Users/ofircohen/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/Users/ofircohen/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/Users/ofircohen/.minikube}
I0511 16:55:55.680552 98749 ubuntu.go:177] setting up certificates
I0511 16:55:55.680952 98749 provision.go:84] configureAuth start
I0511 16:55:55.681248 98749 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" minikube
I0511 16:55:55.728737 98749 provision.go:143] copyHostCerts
I0511 16:55:55.729150 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/ca.pem --> /Users/ofircohen/.minikube/ca.pem (1086 bytes)
I0511 16:55:55.729351 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/cert.pem --> /Users/ofircohen/.minikube/cert.pem (1131 bytes)
I0511 16:55:55.729604 98749 exec_runner.go:151] cp: /Users/ofircohen/.minikube/certs/key.pem --> /Users/ofircohen/.minikube/key.pem (1679 bytes)
I0511 16:55:55.729928 98749 provision.go:117] generating server cert: /Users/ofircohen/.minikube/machines/server.pem ca-key=/Users/ofircohen/.minikube/certs/ca.pem private-key=/Users/ofircohen/.minikube/certs/ca-key.pem org=ofircohen.minikube san=[127.0.0.1 192.168.49.2 localhost minikube]
I0511 16:55:55.767575 98749 provision.go:177] copyRemoteCerts
I0511 16:55:55.768316 98749 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0511 16:55:55.768364 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:55.808435 98749 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:51346 SSHKeyPath:/Users/ofircohen/.minikube/machines/minikube/id_rsa Username:docker}
I0511 16:55:55.896118 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1086 bytes)
I0511 16:55:55.912423 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/machines/server.pem --> /etc/docker/server.pem (1188 bytes)
I0511 16:55:55.932639 98749 ssh_runner.go:362] scp /Users/ofircohen/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0511 16:55:55.950592 98749 provision.go:87] duration metric: took 269.623958ms to configureAuth
I0511 16:55:55.950613 98749 ubuntu.go:193] setting minikube options for container-runtime
I0511 16:55:55.954251 98749 config.go:182] Loaded profile config "minikube": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.30.0
I0511 16:55:55.954476 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:56.017676 98749 main.go:141] libmachine: Using SSH client type: native
I0511 16:55:56.017884 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 }
I0511 16:55:56.017893 98749 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0511 16:55:56.142251 98749 main.go:141] libmachine: SSH cmd err, output: : overlay

I0511 16:55:56.142262 98749 ubuntu.go:71] root file system type: overlay
I0511 16:55:56.142719 98749 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0511 16:55:56.142830 98749 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
I0511 16:55:56.194548 98749 main.go:141] libmachine: Using SSH client type: native
I0511 16:55:56.195532 98749 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x102963280] 0x102965ae0 [] 0s} 127.0.0.1 51346 }
I0511 16:55:56.195564 98749 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60

[Service]
Type=notify
Restart=on-failure

Operating System

Mac OS X Sonoma 14.1.2 (23B92)

Driver

Docker
@ofirc
Copy link
Author

ofirc commented May 11, 2024

I can confirm it is a regression and it works in v1.32.0 from Nov 8, 2023:
https://github.com/kubernetes/minikube/releases

➜  Downloads kubectl get pod -n kube-system
NAME                               READY   STATUS    RESTARTS        AGE
cilium-c75mg                       1/1     Running   0               4m59s
cilium-operator-7d98fd79fc-fz669   1/1     Running   0               4m58s
coredns-5dd5756b68-jlptm           1/1     Running   2 (4m31s ago)   4m58s
etcd-minikube                      1/1     Running   0               5m11s
kube-apiserver-minikube            1/1     Running   0               5m11s
kube-controller-manager-minikube   1/1     Running   0               5m11s
kube-proxy-t4vt9                   1/1     Running   0               4m59s
kube-scheduler-minikube            1/1     Running   0               5m12s
storage-provisioner                1/1     Running   0               5m10s
➜  Downloads

@spowelljr
Copy link
Member

Resolved by #18846

@spowelljr
Copy link
Member

Fix is included in latest release of minikube: https://github.com/kubernetes/minikube/releases/tag/v1.33.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ofirc @spowelljr