Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

Add tolerations for nodes tainted with NoExecute #3655

Merged
merged 1 commit into from
Aug 28, 2019

Conversation

tanishq-dubey
Copy link

@tanishq-dubey tanishq-dubey commented Jun 30, 2019

If you add nodes with the following taint:

kubectl taint nodes node1 key1=value1:NoExecute

Weave is evicted from the node, and thus, the node will not be able to start any new pods due to it not being able to resolve network endpoints. By allowing the Weave DaemonSet to tolerate a NoExecute taint, Weave will run on these tainted nodes marked to avoid execution, as it should.


This is was found because I have a set of nodes that are marked with NoExecute so only certain applications that tolerate the taint can run on them. Turns out one of those certain applications became Weave. Pods that were running before I applied the taint were fine, but pods that were schedule after Weave was evicted from the node were unable to start and left in a Pending state.

Copy link
Contributor

@murali-reddy murali-reddy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Ignore the CI failure. CI can not be run for the branches on forked repos.

@tanishq-dubey
Copy link
Author

Just for completeness, I did not modify https://github.com/weaveworks/weave/blob/master/prog/weave-kube/weave-daemonset.yaml#L22 and was wondering if that needed to be changed to include the NoExecute?

@murali-reddy
Copy link
Contributor

Just for completeness, I did not modify https://github.com/weaveworks/weave/blob/master/prog/weave-kube/weave-daemonset.yaml#L22 and was wondering if that needed to be changed to include the NoExecute?

@tanishq-dubey its old manifest (though naming is counter-intutuve) for kubernetes cluster < 1.6. So no need to change.

@bboreham bboreham merged commit b07db64 into weaveworks:master Aug 28, 2019
@bboreham bboreham added this to the 2.6 milestone Nov 4, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants