Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate performance testing into release workflow #693

Closed
8 tasks
dblock opened this issue Oct 5, 2021 · 3 comments
Closed
8 tasks

Integrate performance testing into release workflow #693

dblock opened this issue Oct 5, 2021 · 3 comments
Labels

Comments

@dblock
Copy link
Member

dblock commented Oct 5, 2021

Is your feature request related to a problem? Please describe

Integrate performance testing workflow into https://github.com/opensearch-project/opensearch-build/blob/main/.github/ISSUE_TEMPLATE/release_template.md

Describe the solution you'd like

Pre-requisites:

  • Performance tests are run continuously
  • Test results are published for every bundle build
  • Test results include delta between this build and previously released versions of OpenSearch
  • Plugins have a way to do performance tests within a framework, similarly to backwards compatibility tests

We need a series of steps in the release template around performance tests. This issue should answer, what are those steps?

  • Ensure that there are no performance regressions
  • Ensure that the error rate is stable/comparable
  • Publish/include a performance footprint summary, release notes?
  • ... something else?

Describe alternatives you've considered

No response

Additional context

No response

@dblock dblock added enhancement New Enhancement untriaged Issues that have not yet been triaged labels Oct 5, 2021
@dblock
Copy link
Member Author

dblock commented Oct 5, 2021

@bbarani Add your thoughts please?

@dblock dblock added performance v1.2.0 OpenSearch 1.2 version and removed untriaged Issues that have not yet been triaged labels Oct 5, 2021
@saratvemulapalli
Copy link
Member

@dblock some of the answers to questions above would be taken care by #126.
I would rather have granular issues created and link it to the meta issue to understand where we are on performance testing.

@peternied peternied removed the v1.2.0 OpenSearch 1.2 version label Nov 16, 2021
@dblock
Copy link
Member Author

dblock commented Jan 11, 2022

This is a different cut of #126, closing as dup.

@dblock dblock closed this as completed Jan 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants