Eclipse Che: Workspace is not getting created - DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)

[debkantap]

Summary

I am running Eclipse che verion 7.82 on k8s. This is using workspace template from devfile.io.
While creating the devworksapces from the devfile hosted on devfile.io, I am getting the timeout error. This is the error coming in close: "DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)"
I am not able to get any error from log from backend (my bad probably).

However if I try to create the devworkspace from the devfile hosted in embedded devfile registry, it is working.

Relevant information

No response

[RomanNikitenko]

@debkantap
Hello,
could you share what devfile from the devfile.io you use to start a workspace?

[tolusha]

@debkantap
What you can do:

• inspect events in a user namespace kubectl get events -n <...>
• inspect DWO logs kubectl logs -n devworkspace-controller deploy/devworkspace-controller-manager -f

[debkantap]

@RomanNikitenko ..I am using "Maven Java" from devfile.io
@tolusha ...
I tried the options that you suggested, it is getting timeout due to 502 error. I am not able to understand why it is happening for devfile, but not for embedded devfile registry. here is the output

kubectl logs -n devworkspace-controller deploy/devworkspace-controller-manager -f

--output------
{"level":"info","ts":"2024-03-19T08:20:08Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:08Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:09Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:09Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:10Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:10Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:11Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:11Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:12Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:12Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:13Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:13Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:14Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:15Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:16Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:16Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:17Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:17Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:18Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:18Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:19Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:19Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:20Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:20Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:21Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:21Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:22Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:22Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:23Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:23Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:24Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:24Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:25Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:25Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:26Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:26Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:27Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:27Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:29Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:29Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"DevWorkspace failed to start: DevWorkspace failed to progress past step 'Waiting for editor to start' for longer than timeout (300s)","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Stopping workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:30Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}
{"level":"info","ts":"2024-03-19T08:20:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","resolvedConfig":"workspace.progressTimeout=300s"}

--output----

kubectl get events -n debkanta-pramanick-pil-com-che-p0nfvh

----------------------------output-----------------------

LAST SEEN TYPE REASON OBJECT MESSAGE
9m59s Normal Scheduled pod/cleanup-workspace739eb88e4b0e4068-m8mgk Successfully assigned debkanta-pramanick-pil-com-che-p0nfvh/cleanup-workspace739eb88e4b0e4068-m8mgk to k8sworker1.example.net
9m56s Normal Pulled pod/cleanup-workspace739eb88e4b0e4068-m8mgk Container image "registry.access.redhat.com/ubi8-micro:8.8-1" already present on machine
9m56s Normal Created pod/cleanup-workspace739eb88e4b0e4068-m8mgk Created container cleanup-workspace739eb88e4b0e4068
9m55s Normal Started pod/cleanup-workspace739eb88e4b0e4068-m8mgk Started container cleanup-workspace739eb88e4b0e4068
9m59s Normal SuccessfulCreate job/cleanup-workspace739eb88e4b0e4068 Created pod: cleanup-workspace739eb88e4b0e4068-m8mgk
9m37s Normal Completed job/cleanup-workspace739eb88e4b0e4068 Job completed
7m42s Normal Scheduled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully assigned debkanta-pramanick-pil-com-che-p0nfvh/workspace908729b913c849de-85fb56f559-h7968 to k8sworker1.example.net
7m41s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "quay.io/che-incubator/che-code@sha256:715c65869811e1f8ae3f337af014fa90eb64e9909c6d426eea990c5563ae92c6"
7m41s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "quay.io/che-incubator/che-code@sha256:715c65869811e1f8ae3f337af014fa90eb64e9909c6d426eea990c5563ae92c6" in 265ms (265ms including waiting)
7m41s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container che-code-injector
7m41s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container che-code-injector
7m31s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "quay.io/devfile/project-clone:v0.25.0"
7m31s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "quay.io/devfile/project-clone:v0.25.0" in 231ms (231ms including waiting)
7m31s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container project-clone
7m31s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container project-clone
7m29s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248"
7m29s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248" in 484ms (484ms including waiting)
7m29s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container tools
7m29s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container tools
7m28s Normal Pulling pod/workspace908729b913c849de-85fb56f559-h7968 Pulling image "docker.io/library/traefik:latest"
7m24s Normal Pulled pod/workspace908729b913c849de-85fb56f559-h7968 Successfully pulled image "docker.io/library/traefik:latest" in 4.028s (4.028s including waiting)
7m24s Normal Created pod/workspace908729b913c849de-85fb56f559-h7968 Created container che-gateway
7m24s Normal Started pod/workspace908729b913c849de-85fb56f559-h7968 Started container che-gateway
2m24s Normal Killing pod/workspace908729b913c849de-85fb56f559-h7968 Stopping container tools
2m24s Normal Killing pod/workspace908729b913c849de-85fb56f559-h7968 Stopping container che-gateway
7m42s Normal SuccessfulCreate replicaset/workspace908729b913c849de-85fb56f559 Created pod: workspace908729b913c849de-85fb56f559-h7968
2m24s Normal SuccessfulDelete replicaset/workspace908729b913c849de-85fb56f559 Deleted pod: workspace908729b913c849de-85fb56f559-h7968
7m Normal Sync ingress/workspace908729b913c849de-tools-13131-code-redirect-1 Scheduled for sync
7m Normal Sync ingress/workspace908729b913c849de-tools-13132-code-redirect-2 Scheduled for sync
7m Normal Sync ingress/workspace908729b913c849de-tools-13133-code-redirect-3 Scheduled for sync
7m Normal Sync ingress/workspace908729b913c849de-tools-8080-http-maven Scheduled for sync
7m42s Normal ScalingReplicaSet deployment/workspace908729b913c849de Scaled up replica set workspace908729b913c849de-85fb56f559 to 1
2m24s Normal ScalingReplicaSet deployment/workspace908729b913c849de Scaled down replica set workspace908729b913c849de-85fb56f559 to 0 from 1

----------------------------output-----------------------

[tolusha]

{"level":"info","ts":"2024-03-19T08:20:28Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"debkanta-pramanick-pil-com-che-p0nfvh","Request.Name":"java-maven","devworkspace_id":"workspace908729b913c849de","status-code":502}

@RomanNikitenko
The same for me. I can't start a workspace from Maven Java on Kubernetes (minikube) but it works fine on OpenShift (Dogfooding cluster).

[RomanNikitenko]

there is an error in logs:

we need investigate what's the cause of the problem...

[RomanNikitenko]

I think it fails here at userInfo() step.
@vitaliy-guliy

in my case there is something wrong with user:

[monaka]

registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248 is used by "Maven Java" from devfile.io

$ kubectl run --image registry.access.redhat.com/ubi9/openjdk-17:1.17-1.1705573248 delme -- tail -f /dev/null
pod/delme created

$ kubectl exec -it delme -- bash
[default@delme ~]$ ls -la /etc/passwd
-rw-r--r-- 1 root root 590 Jan 18  2024 /etc/passwd

Only the root user can write /etc/passwd.
So init-scripts will skip adding uid:1234.

# Add current (arbitrary) user to /etc/passwd and /etc/group
if ! whoami &> /dev/null; then
  if [ -w /etc/passwd ]; then
    echo "${USER_NAME:-user}:x:$(id -u):0:${USER_NAME:-user} user:${HOME}:/bin/bash" >> /etc/passwd
    echo "${USER_NAME:-user}:x:$(id -u):" >> /etc/group
  fi
fi

As @tolusha commented, this issue will be reproduced only on vanilla Kubernetes.
OpenShift version of CRI-O will edit /etc/passwd before container running.
refs: cri-o/cri-o@77408ef

[agarciadom]

I believe I'm running into this issue - I can start a VS Code workspace by cloning an existing Github repo without a devfile, and it also works fine when I start an empty workspace, but trying to start the "Maven + Java" example or the "Python" example will produce these errors in the devworkspace-controller-manager deployment:

{"level":"info","ts":"2024-10-04T16:24:41Z","logger":"controllers.DevWorkspace","msg":"Reconciling Workspace","Request.Namespace":"user1-che","Request.Name":"java-maven","devworkspace_id":"workspace9cf55cc9565d4421","resolvedConfig":"workspace.progressTimeout=3000s,workspace.ignoredUnrecoverableEvents=FailedScheduling"}
{"level":"info","ts":"2024-10-04T16:24:41Z","logger":"controllers.DevWorkspace","msg":"Main URL server not ready","Request.Namespace":"user1-che","Request.Name":"java-maven","devworkspace_id":"workspace9cf55cc9565d4421","status-code":502}

I am running Che on Minikube in an Apple Silicon machine (using https://github.com/chipmk/docker-mac-net-connect to resolve the Minikube ingress issues on MacOS).

Is there anything we can do, besides running OpenShift instead of Minikube?

[agarciadom]

I tried OpenShift Local, and I saw the same behaviour where the "Python" / "Maven + Java" examples would be stuck with the same messages as above, whereas creating an empty workspace worked as usual. OpenShift's console was a bit more helpful and did show the hook that was being executed at PostStart time, so I looked at the /checode/entrypoint-logs.txt file and saw this:

[INFO] Node.js dir for running VS Code: /checode/checode-linux-libc/ubi9
qemu-x86_64-static: Could not open '/lib64/ld-linux-x86-64.so.2': No such file or directory

It seems to be due to my use of an Apple Silicon machine, which may be complicating things. I verified the same problem in Minikube:

[INFO] Node.js dir for running VS Code: /checode/checode-linux-libc/ubi9
rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2
 /checode/entrypoint-volume.sh: line 122:    34 Trace/breakpoint trap   (core dumped) "$VSCODE_NODEJS_RUNTIME_DIR/node" ./launcher/entrypoint.js

I'll remove myself from this discussion then, as it seems my issue is different than the one in this issue.

[AObuchow]

@agarciadom the issue you're describing above seems to reassemble a bug I've been trying to figure out: #23179. I think that bug may be a better place to discuss your issue.

I'm not certain, but the issue you're encountering might have to do with the UBI9 image used for the workspace (in the devfile) since you reported that the empty workspace sample works (which uses the UDI image instead).

Thank you so much for reporting your findings!