Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support --page-size and --page-buffer-size for snapshot export #619

Conversation

AhmedGrati
Copy link
Contributor

@AhmedGrati AhmedGrati commented May 29, 2023

What type of PR is this?

/kind feature

What this PR does / why we need it:

This PR adds the support of -page-size and -page-buffer-size when executing kowkctl snapshot export

Previously, the list pager had the default page size of 500 and 10 as the default page buffer size. Therefore, this PR aims to introduce the tuning of these parameters to users, so they can adjust them accordingly to their needs, which can increase the performance in some cases.

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewer:

Does this PR introduce a user-facing change?

Introduce flags `--page-size` and `--page-buffer-size` for `kowkctl snapshot export`.

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:


TessaIO added 2 commits May 29, 2023 11:40
… k8s and snapshot export

Signed-off-by: AhmedGrati <ahmedgrati1999@gmail.com>
… k8s and snapshot export

Signed-off-by: AhmedGrati <ahmedgrati1999@gmail.com>
@k8s-ci-robot k8s-ci-robot added the kind/feature Categorizes issue or PR as related to a new feature. label May 29, 2023
@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label May 29, 2023
@netlify
Copy link

netlify bot commented May 29, 2023

Deploy Preview for k8s-kwok canceled.

Name Link
🔨 Latest commit ff50e6c
🔍 Latest deploy log https://app.netlify.com/sites/k8s-kwok/deploys/6475c94a3bd807000701f132

@k8s-ci-robot k8s-ci-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label May 29, 2023
@wzshiming
Copy link
Member

/ok-to-test

@k8s-ci-robot k8s-ci-robot added the ok-to-test Indicates a non-member PR verified by an org member that is safe to test. label May 29, 2023
@wzshiming
Copy link
Member

It looks like the CI cluster is abnormal

@AhmedGrati
Copy link
Contributor Author

@wzshiming It seems that there's a problem in kubernetes/test-infra

@wzshiming
Copy link
Member

Yep, It is.

kubernetes/test-infra#29622

pkg/kwokctl/snapshot/save.go Show resolved Hide resolved
pkg/kwokctl/runtime/cluster_snapshot.go Outdated Show resolved Hide resolved
@AhmedGrati AhmedGrati force-pushed the feat-support-pagesize-and-pagebuffersize branch 3 times, most recently from 26054f1 to 1f81572 Compare May 30, 2023 09:39
pkg/kwokctl/snapshot/save.go Show resolved Hide resolved
pkg/kwokctl/snapshot/save.go Outdated Show resolved Hide resolved
@AhmedGrati AhmedGrati force-pushed the feat-support-pagesize-and-pagebuffersize branch 2 times, most recently from 8ce9a0e to 3b1c2e7 Compare May 30, 2023 09:59
@AhmedGrati AhmedGrati requested a review from wzshiming May 30, 2023 09:59
Signed-off-by: AhmedGrati <ahmedgrati1999@gmail.com>
@AhmedGrati AhmedGrati force-pushed the feat-support-pagesize-and-pagebuffersize branch from 3b1c2e7 to ff50e6c Compare May 30, 2023 10:00
Copy link
Member

@wzshiming wzshiming left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve
/lgtm
/label tide/merge-method-squash

@k8s-ci-robot k8s-ci-robot added the tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges. label May 31, 2023
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label May 31, 2023
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: AhmedGrati, wzshiming

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 31, 2023
@wzshiming wzshiming changed the title feat: support -page-size and page-buffer-size for snapshot export and save feat: support --page-size and --page-buffer-size for snapshot export and save May 31, 2023
@k8s-ci-robot k8s-ci-robot merged commit 4340fd4 into kubernetes-sigs:main May 31, 2023
@Huang-Wei
Copy link
Contributor

/lgtm still

Thanks.

@AhmedGrati AhmedGrati changed the title feat: support --page-size and --page-buffer-size for snapshot export and save feat: support --page-size and --page-buffer-size for snapshot export May 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. kind/feature Categorizes issue or PR as related to a new feature. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. tide/merge-method-squash Denotes a PR that should be squashed by tide when it merges.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants