You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The problem is the retry is on the function wait_for_workflows. With a maximum retry of 20 minutes.
That means we won't retry the error if wait_for_workflows takes longer than 20 minutes and the error occurs after wait_for_workflows was running for more than 20 minutes.
We should be applying the retry just to the call to K8s API
Test flake:
https://k8s-gubernator.appspot.com/build/kubernetes-jenkins/pr-logs/pull/kubeflow_kubeflow/1579/kubeflow-presubmit/3421/?log#log
Here's the exception
This should be a retryable error. We can see from the stack trace the retrying module is invoked.
We add retries to wait_for_workflows
testing/py/kubeflow/testing/argo_client.py
Line 39 in a3a472b
The problem is the retry is on the function wait_for_workflows. With a maximum retry of 20 minutes.
That means we won't retry the error if wait_for_workflows takes longer than 20 minutes and the error occurs after wait_for_workflows was running for more than 20 minutes.
We should be applying the retry just to the call to K8s API
testing/py/kubeflow/testing/argo_client.py
Line 69 in a3a472b
The text was updated successfully, but these errors were encountered: