Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(e2e): add benchmarking #1903

Closed
wants to merge 12 commits into from
Closed

feat(e2e): add benchmarking #1903

wants to merge 12 commits into from

Conversation

csatib02
Copy link
Member

@csatib02 csatib02 commented Jul 15, 2024

Description

  • Adds benchmark tests.

Type of Change

  • Bug Fix
  • New Feature
  • Breaking Change
  • Refactor
  • Documentation
  • Other (please describe)

Checklist

  • I have read the contributing guidelines
  • Existing issues have been referenced (where applicable)
  • I have verified this change is not present in other open pull requests
  • Functionality is documented
  • All code style checks pass
  • New code contribution is covered by automated tests
  • All new and existing tests pass

@csatib02 csatib02 self-assigned this Jul 15, 2024
@csatib02 csatib02 changed the title Feat/add benchmarking feat(e2e): add benchmarking Jul 15, 2024
@csatib02 csatib02 added enhancement New feature or request go Pull requests that update Go code ci Continious Integration related PRs labels Jul 15, 2024
@csatib02 csatib02 force-pushed the feat/add-benchmarking branch 2 times, most recently from 351bf8d to 0c85152 Compare July 15, 2024 09:24
}

rows = append(rows, []string{
fmt.Sprintf("%s (%s)", famType, n.scannerName[famType]),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
fmt.Sprintf("%s (%s)", famType, n.scannerName[famType]),
fmt.Sprintf("%s/%s", famType, n.scannerName[famType]),

Copy link
Member

@ramizpolic ramizpolic Jul 15, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

makes it clearer that there is a subtask running, while we can also have a breakdown of the family and overall scan too, for example:

Family/Scanner Start time End time Findings Total time
plugins/kics 2024-07-15 08:44:32 2024-07-15 08:44:49 - 18s
plugins/* 2024-07-15 08:44:32 2024-07-15 08:44:49 23 18s
malware/yara 2024-07-15 08:44:32 2024-07-15 08:44:49 - 18s
malware/* 2024-07-15 08:44:32 2024-07-15 08:44:49 0 18s
Scan summary 2024-07-15 08:44:32 2024-07-15 08:44:49 23 18s

Note: family/* indicate total time to execute a specific family, family/scanner indicate how long specific scanner within a family took.

For family summary, the start time is the time of the earliest family scanner to start, while end time is the time of the last family scanner to finish.

For overall summary, the start and end times are the same, but across all notifications.

@csatib02 csatib02 force-pushed the feat/add-benchmarking branch 2 times, most recently from 59071c3 to 999e105 Compare July 16, 2024 10:09
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>

refactor(benchmark): refactor from e2e to normal go test

Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
Signed-off-by: Bence Csati <bcsati@cisco.com>
@ramizpolic
Copy link
Member

Closing due to unification, can be resumed in the new repo once everything is ready

@ramizpolic ramizpolic closed this Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Continious Integration related PRs enhancement New feature or request go Pull requests that update Go code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants