Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added a 100 GB corpus to the big5 workload that models a more realistic time series and updated mappings #242

Merged
merged 1 commit into from
Mar 22, 2024

Conversation

gkamat
Copy link
Collaborator

@gkamat gkamat commented Mar 20, 2024

Description

Several enhancements to the big5 workload.

Testing

Ran OSB integration tests. Tested the workload against 2.11 and 7.10 cluster versions.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…eries.

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Comment on lines +35 to 37
"request-timeout": 7200{%- if max_num_segments is defined %},
"max-num-segments": {{ max_num_segments | tojson }}
{%- endif %}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch! It's better that we consolidate to one variable

Copy link
Collaborator

@IanHoang IanHoang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@IanHoang IanHoang added backport 2 Backport to the "2" branch backport 1 backport 3 Backport to the "3" branch labels Mar 21, 2024
Copy link

@rishabhmaurya rishabhmaurya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this looks great, thanks @gkamat

@gkamat gkamat merged commit 47be332 into opensearch-project:main Mar 22, 2024
5 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
(cherry picked from commit 47be332)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
(cherry picked from commit 47be332)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
(cherry picked from commit 47be332)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
gkamat pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242) (#244)

Updated mappings and included several improvements.


(cherry picked from commit 47be332)

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
gkamat pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242) (#245)

Updated mappings and included several improvements.


(cherry picked from commit 47be332)

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
gkamat pushed a commit that referenced this pull request Mar 22, 2024
…eries. (#242) (#246)

Updated mappings and included several improvements.


(cherry picked from commit 47be332)

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
gkamat added a commit to gkamat/opensearch-benchmark-workloads that referenced this pull request Mar 22, 2024
…eries. (opensearch-project#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
gkamat added a commit to gkamat/opensearch-benchmark-workloads that referenced this pull request Mar 22, 2024
…eries. (opensearch-project#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
gkamat added a commit that referenced this pull request Mar 22, 2024
* Added the "big5" workload based on Elastic's comparison benchmark.

Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Added license file to big5 workload and parameterized some fields.

Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Add quick fix to Big5 Workload for integration tests (#168)

Signed-off-by: Ian Hoang <hoangia@amazon.com>
Co-authored-by: Ian Hoang <hoangia@amazon.com>
Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Added a data corpus to the big5 workload and included several enhancements. (#199)

Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Added attribution and change notification.

Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Canonicalized big5 mapping files.

Signed-off-by: Govind Kamat <govkamat@amazon.com>

* Added support for a 100 GB corpus that models a more realistic time series. (#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>

---------

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Signed-off-by: Ian Hoang <hoangia@amazon.com>
Co-authored-by: Ian Hoang <51065478+IanHoang@users.noreply.github.com>
Co-authored-by: Ian Hoang <hoangia@amazon.com>
@gkamat gkamat deleted the big5-restored branch June 20, 2024 16:38
harshavamsi pushed a commit to harshavamsi/opensearch-benchmark-workloads that referenced this pull request Jul 16, 2024
…eries. (opensearch-project#242)

Updated mappings and included several improvements.

Signed-off-by: Govind Kamat <govkamat@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 1 backport 2 Backport to the "2" branch backport 3 Backport to the "3" branch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants