Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deployment in new state for 2 days #16962

Closed
smarterclayton opened this issue Oct 19, 2017 · 2 comments
Closed

Deployment in new state for 2 days #16962

smarterclayton opened this issue Oct 19, 2017 · 2 comments
Assignees
Labels
component/apps kind/bug Categorizes issue or PR as related to a bug. priority/P2

Comments

@smarterclayton
Copy link
Contributor

Unusual deployment, in "new" for 2 days on a 3.7 cluster:

oc describe dc -n XX X-staging
Name:		X-staging
Namespace:	pc2
Created:	2 days ago
Labels:		<none>
Annotations:	<none>
Latest Version:	1
Selector:	deploymentconfig=X-staging
Replicas:	1
Triggers:	Config
Strategy:	Rolling
Template:
Pod Template:
  Labels:	deploymentconfig=X-staging
  Containers:
   X-staging:
    Image:	3scale-amp20/apicast-gateway:1.0-3
    Ports:	8080/TCP, 8090/TCP
    Liveness:	http-get http://:8090/status/live delay=10s timeout=5s period=10s #success=1 #failure=3
    Readiness:	http-get http://:8090/status/ready delay=15s timeout=5s period=30s #success=1 #failure=3
    Environment:
      APICAST_CONFIGURATION_LOADER:	lazy
      APICAST_CONFIGURATION_CACHE:	0
      THREESCALE_DEPLOYMENT_ENV:	sandbox
      APICAST_MANAGEMENT_API:		status
      OPENSSL_VERIFY:			false
      APICAST_RESPONSE_CODES:		true
    Mounts:				<none>
  Volumes:				<none>

Deployment #1 (latest):
	Name:		X-staging-1
	Created:	2 days ago
	Status:		New
	Replicas:	0 current / 0 desired
	Selector:	deployment=X-staging-1,deploymentconfig=X-staging
	Labels:		openshift.io/deployment-config.name=X-staging
	Pods Status:	0 Running / 0 Waiting / 0 Succeeded / 0 Failed

Events:	<none>

This deployment should be failed or complete, not New.

@openshift/sig-master

@pweil- pweil- added component/apps kind/bug Categorizes issue or PR as related to a bug. priority/P2 labels Oct 19, 2017
@tnozicka
Copy link
Contributor

@smarterclayton can you pls dump YAML for the DC,RC and deployer pod?

@mfojtik mfojtik assigned tnozicka and unassigned mfojtik Oct 23, 2017
@mfojtik
Copy link
Contributor

mfojtik commented Oct 23, 2017

Whatever happened here, we should always respect the timeoutSeconds which defaults to 10 minutes. After 10 minutes this should transition from New to Failed since there was no progress. It would be interesting to know why this got stuck, I assume it failed to create the deployer pod because of quota(?) or some other non-transient error. Maybe we should print the last condition here to see where it got stuck.

openshift-merge-robot added a commit that referenced this issue Oct 25, 2017
Automatic merge from submit-queue (batch tested with PRs 17020, 17026, 17000, 17010).

apps: deployment config stuck in the new state should respect timeoutSeconds

Fixes: #16962

With this patch the deployment config controller will set the deployment as failed (timeout) after it reaches timeoutSeconds and the status of the deployment is 'new'. This generally happens when the deployment is not able to create the deployer pod (quota). We should not wait infinitely to have the quota.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/apps kind/bug Categorizes issue or PR as related to a bug. priority/P2
Projects
None yet
Development

No branches or pull requests

4 participants