Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🌱 test/e2e/in-memory: improve performance by fixing locking issues #8895

Merged
merged 1 commit into from
Jun 21, 2023

Conversation

sbueringer
Copy link
Member

@sbueringer sbueringer commented Jun 21, 2023

Signed-off-by: Stefan Büringer buringerst@vmware.com

What this PR does / why we need it:
Currently the in-memory provider gets slow if we're getting to very high cluster numbers.

Basically the problem was that when we create a new apiserver we locked the global lock. This was slowing down all requests served by the apiserver because that lock is used during every tls handshake and in every request (to get the resourceGroup).

Kudos to @fabriziopandini for the collaboration on this.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Related to #8814

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jun 21, 2023
@k8s-ci-robot k8s-ci-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Jun 21, 2023
key, err := certs.NewPrivateKey()
var key *rsa.PrivateKey

func init() {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generating a private key is slow. Now we only do it once on startup and share it across clusters

m.log.Error(startErr, "Failed to start WorkloadClusterListener", "listenerName", wclName, "address", wcl.Address())
// Wait until the sever is working.
var pollErr error
err = wait.PollUntilContextTimeout(context.TODO(), 10*time.Millisecond, 1*time.Second, true, func(ctx context.Context) (done bool, err error) {
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With this change we wait until the listener serves (at least a tls handshake). This is quicker than always waiting 100 ms

Signed-off-by: Stefan Büringer buringerst@vmware.com
Copy link
Member

@fabriziopandini fabriziopandini left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

Thanks for moving forward this change!

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jun 21, 2023
@k8s-ci-robot
Copy link
Contributor

LGTM label has been added.

Git tree hash: 7f6f978ad91e61315f0694c16b486c0dfb11666f

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: fabriziopandini

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 21, 2023
@k8s-ci-robot k8s-ci-robot merged commit 125ee96 into kubernetes-sigs:main Jun 21, 2023
14 checks passed
@k8s-ci-robot k8s-ci-robot added this to the v1.5 milestone Jun 21, 2023
@sbueringer sbueringer deleted the pr-im-fix-mux branch June 21, 2023 13:47
@killianmuldoon
Copy link
Contributor

/area provider/infrastructure-in-memory

@k8s-ci-robot k8s-ci-robot added the area/provider/infrastructure-in-memory Issues or PRs related to the in-memory infrastructure provider label Jun 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/provider/infrastructure-in-memory Issues or PRs related to the in-memory infrastructure provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants