-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
upgrade ks app for E2E test to 0.3.0 #2338
Conversation
/test kubeflow-presubmit |
It looks like there was a problem starting the tests. You can follow these instructions To use the prow jobs UI to get pod logs to see what went wrong. |
/test kubeflow-presubmit |
@jlewi tried to get pod logs but not enough information. I tried to setup a local kubeflow-test-infra and ran a debug pod to check and found that ks-13 binary is missing in /usr/local/bin. Do you have access to debug pod on prow? Update: found that ks-13 tarball was not downloaded. Will check the Dockerfile and open a fix. |
gcr.io/kubeflow-ci/test-worker:latest is old and doesn't have the ks-13 binaries. Should we update the tag? |
@stpabhi You can update the image. You should pin to a specific image like we do here As opposed to using a relative tag. Did you run The reason I ask is because I would have thought upgrading to 0.13 made other changes such as the location of .libsonnet files. |
Yes, I did run |
@jlewi Image has to be updated and merged before updating app? |
@stpabhi It shouldn't. The presubmits will use whatever workflow you have defined on the PR. So if your PR updates the image used for the worker then that's what should get used. |
@jlewi Got it. I’m not sure what else I have missed. Is it possible to run on Minikube without gcloud services so that it’s easy to debug? |
Your test failed.
I think its refering to binary I think your image is too old. try using |
@jlewi I did use the new images. Let me try again using tags instead of sha checksum |
I think the sha you were using was pointing to a different image from the one I pasted. The one I pasted should be used by our mnist example which is why I have confidence its up to date. |
c43ea3d
to
5e9cf13
Compare
Still seems like its not running. I think to debug it you should submit the test; and then use the prow jobs dashboard to fetch pod logs to see what's failing. I'm going to mark this WIP while you work on fixing the test; when its fixed please remove WIP from the title. If you need help lets chat on kubeflow.slack.com |
/test kubeflow-presubmit |
@jlewi App version 0.2.0 worked. I tried on my gke instance with ks-13 but ran into another issue. |
@jlewi Weird, App version 0.3.0 works now. Could you please review and add the appropriate labels? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reviewed 14 of 14 files at r1.
Reviewable status: complete! all files reviewed, all discussions resolved (waiting on @abhi-g and @ellis-bigelow)
/lgtm |
/test kubeflow-presubmit |
Signed-off-by: Abhilash Pallerlamudi <stp.abhi@gmail.com>
/lgtm |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: jlewi The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
/test kubeflow-presubmit |
Why do we change back to old test-worker image? |
It breaks to deployapp test since it needs the new change in test worker |
@lluunn Is this specific to #2463? Notebooks test did not fail in the presubmit test for this PR https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/kubeflow_kubeflow/2338/kubeflow-presubmit/5676/ |
no, it's periodic test. |
Signed-off-by: Abhilash Pallerlamudi <stp.abhi@gmail.com>
This PR updates api version to 0.3.0 so that test infra ksonnet version is upgraded to v0.13.1 as we are recommending the same in the docs.
Signed-off-by: Abhilash Pallerlamudi stp.abhi@gmail.com
This change is