Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests (test_mlflow) failing on Master #1896

Closed
glindsell opened this issue May 29, 2020 · 1 comment · Fixed by #1897
Closed

Integration tests (test_mlflow) failing on Master #1896

glindsell opened this issue May 29, 2020 · 1 comment · Fixed by #1897
Labels
bug triage Needs to be triaged and prioritised accordingly

Comments

@glindsell
Copy link
Contributor

The following test from e2e is failing:

test_prepackaged_servers.py::TestPrepack::test_mlflow

https://github.com/SeldonIO/seldon-core/blob/master/testing/scripts/test_prepackaged_servers.py#L85

$ kubectl rollout status deployment mlflow-default-0-classifier -n seldon
Waiting for deployment "mlflow-default-0-classifier" rollout to finish: 0 of 1 updated replicas are available...
error: deployment "mlflow-default-0-classifier" exceeded its progress deadline
$ kubectl logs mlflow-default-0-classifier-85855f78b4-8469b -n seldon seldon-container-engine -f
{"level":"error","ts":1590763424.93948,"logger":"SeldonRestApi","msg":"Ready check failed","error":"dial tcp [::1]:9000: connect: connection refused","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/pkg/mod/github.com/go-logr/zapr@v0.1.0/zapr.go:128\ngit.luolix.top/seldonio/seldon-core/executor/api/rest.(*SeldonRestApi).checkReady\n\t/workspace/api/rest/server.go:161\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2007\ngit.luolix.top/seldonio/seldon-core/executor/api/rest.xssMiddleware.func1\n\t/workspace/api/rest/middlewares.go:61\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2007\ngit.luolix.top/seldonio/seldon-core/executor/api/rest.(*CloudeventHeaderMiddleware).Middleware.func1\n\t/workspace/api/rest/middlewares.go:38\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2007\ngit.luolix.top/seldonio/seldon-core/executor/api/rest.puidHeader.func1\n\t/workspace/api/rest/middlewares.go:53\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2007\ngit.luolix.top/gorilla/mux.(*Router).ServeHTTP\n\t/go/pkg/mod/github.com/gorilla/mux@v1.7.3/mux.go:212\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2802\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:1890"}
@glindsell glindsell added bug triage Needs to be triaged and prioritised accordingly labels May 29, 2020
@RafalSkolasinski
Copy link
Contributor

Conda installation takes too long. Submitting PR to increase liveness and readiness probe settings for this example.

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug triage Needs to be triaged and prioritised accordingly
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants