Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Baseline Testing: Scale testing #954

Closed
Tracked by #616
mpstefan opened this issue Aug 10, 2023 · 2 comments · Fixed by #1115
Closed
Tracked by #616

Baseline Testing: Scale testing #954

mpstefan opened this issue Aug 10, 2023 · 2 comments · Fixed by #1115
Assignees
@kate-osborn
Labels
refined Requirements are refined and the issue is ready to be implemented. size/medium Estimated to be completed within a week tests Pull requests that update tests
Milestone
v1.0.0

Comments

@mpstefan
Copy link
Collaborator

mpstefan commented Aug 10, 2023 •
edited
Loading

  • Scaling the number of resources (HTTPRoutes, Gateways, Secrets, Pods )
  • Ensure NKG can process those resources and handle the traffic
  • Ensure a new version doesn't increase resource usage compared with the previous one.

Acceptance

  • A process is documented for deploying a large number of Gateway Resources resources with NKG installed to test for when NKG stop working correctly.
  • Traffic is generated and sent through NKG to an upstream as a part of this test.
  • The resource utilization (CPU, memory, disk) of NKG, errors from the NKG pod(s), and errors from the client, are measured and reported as a result of this test.
  • No element of the test is randomized.
  • The test is carried out manually and the results are reported in a static document within the NKG repo.
@mpstefan mpstefan mentioned this issue Aug 10, 2023
Closed
@mpstefan mpstefan changed the title Scale testing Baseline Testing: Scale testing Aug 10, 2023
@mpstefan mpstefan added this to the v1.0.0 milestone Aug 10, 2023
@mpstefan mpstefan added the tests Pull requests that update tests label Aug 10, 2023
@mpstefan
Copy link
Collaborator Author

See #952 for potential overlap

@mpstefan mpstefan added refined Requirements are refined and the issue is ready to be implemented. size/medium Estimated to be completed within a week labels Aug 30, 2023
@kate-osborn kate-osborn self-assigned this Sep 20, 2023
@vepatel
Copy link
Contributor

vepatel commented Sep 21, 2023

  • All the scaling tests(incl. NGF, tea/coffee) should ideally be localised to this ticket so as no to have overlap with Longevity tests.
  • Baseline Testing: Reload Count #955 can be a subcase of this

@kate-osborn kate-osborn mentioned this issue Oct 6, 2023
Merged
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kate-osborn kate-osborn

Labels
refined Requirements are refined and the issue is ready to be implemented. size/medium Estimated to be completed within a week tests Pull requests that update tests
Projects
NGINX Gateway Fabric
Archived in project
Milestone
v1.0.0
Development

Successfully merging a pull request may close this issue.

Scale test kate-osborn/nginx-gateway-fabric
3 participants
@mpstefan @kate-osborn @vepatel