Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

POD log is flooded with warning message from aws cli. #6596

Closed
3 of 5 tasks
lalat-das opened this issue Dec 7, 2021 · 2 comments
Closed
3 of 5 tasks

POD log is flooded with warning message from aws cli. #6596

lalat-das opened this issue Dec 7, 2021 · 2 comments
Labels
eks guidance Question that needs advice or information. third-party This issue is related to third-party libraries or applications.

Comments

@lalat-das
Copy link

Confirm by changing [ ] to [x] below:

Issue is about usage on:

  • Service API : I want to do X using Y service, what should I do?
  • CLI : passing arguments or cli configurations.
  • Other/Not sure.

Platform/OS/Hardware/Device
centos VM using EKS 1.19 & EKS 1.21

Describe the question
When I am deploying various application pod in EKS 1.19 version cluster. After a API call to k8s cluster is done as part of application , The POD log is flooded with below error message.

W1207 14:08:21.496434 1 exec.go:282] constructing many client instances from the same exec auth config can cause performance problems during cert rotation and can exhaust available network connections; 27556 clients constructed calling "aws"

I did some homework and found out that any binary(may be aws-cli here) using client-go version below 1.21 will have this issue because there is a warning message present in exec.go file which will appear neumerous times.
[https://github.com/kubernetes/client-go/blob/release-1.20/plugin/pkg/client/auth/exec/exec.go#L282](exec.go of 1.20 ver)

So is it that aws-cli is using k8s client-go version below 1.20 ? I couldn't find out as the aws-cli is in python hence not sure how the code trace landing in exec.go from python. The issue is seen with EKS1.19 onwards.

This warning earlier used to come from "aws-iam-authenticator" calling binary. how to get rid of this warning?
Any clue would be greatly appreciated. Thanks in advance.

@lalat-das lalat-das added guidance Question that needs advice or information. needs-triage This issue or PR still needs to be triaged. labels Dec 7, 2021
@kdaily kdaily added investigating This issue is being investigated and/or work is in progress to resolve the issue. and removed needs-triage This issue or PR still needs to be triaged. labels Dec 8, 2021
@kdaily
Copy link
Member

kdaily commented Dec 8, 2021

Hi @lalat-das,

Thanks for your post. The AWS CLI does not have any code written in Go, and is not using client-go for anything. Some AWS CLI customizations make subprocess calls to other code that may be written in Go (for example, the AWS Session Manager plugin is written in Go), but a Go client is not shipped with the CLI for usage. As far as I know EKS supports Kubernetes 1.16 to 1.21 (reference: #6476).

Previous issues with similar warnings indicate this is a Kubernetes issue, so you may need to take it up with them.

kubernetes-sigs/aws-iam-authenticator#308 (comment)

For further assistance, I would ask this in the AWS Developer Forum for EKS:

https://forums.aws.amazon.com/forum.jspa?forumID=303

@kdaily kdaily closed this as completed Dec 8, 2021
@kdaily kdaily added third-party This issue is related to third-party libraries or applications. eks and removed investigating This issue is being investigated and/or work is in progress to resolve the issue. labels Dec 8, 2021
@github-actions
Copy link

github-actions bot commented Dec 8, 2021

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one. If you wish to keep having a conversation with other community members under this issue feel free to do so.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
eks guidance Question that needs advice or information. third-party This issue is related to third-party libraries or applications.
Projects
None yet
Development

No branches or pull requests

2 participants