-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unmute nested sort related ITs #11377
Conversation
❌ Gradle check result for 7d7d798: null Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Compatibility status:Checks if related components are compatible with change 919c33d Incompatible componentsSkipped componentsCompatible componentsCompatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/performance-analyzer.git] |
Signed-off-by: Jay Deng <jayd0104@gmail.com>
❌ Gradle check result for 919c33d: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
I guess you can update the Description as root cause is now known.
|
❕ Gradle check result for 919c33d: UNSTABLE
Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure. |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #11377 +/- ##
============================================
- Coverage 71.37% 71.31% -0.06%
- Complexity 58964 58966 +2
============================================
Files 4890 4890
Lines 277468 277468
Branches 40313 40313
============================================
- Hits 198029 197873 -156
- Misses 62945 63125 +180
+ Partials 16494 16470 -24 ☔ View full report in Codecov by Sentry. |
Signed-off-by: Jay Deng <jayd0104@gmail.com> (cherry picked from commit 530a93b) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
(cherry picked from commit 530a93b) Signed-off-by: Jay Deng <jayd0104@gmail.com> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Jay Deng <jayd0104@gmail.com>
Signed-off-by: Jay Deng <jayd0104@gmail.com>
Signed-off-by: Jay Deng <jayd0104@gmail.com>
Signed-off-by: Jay Deng <jayd0104@gmail.com> Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Description
Unmuting nested sort related tests for concurrent segment search. It's not super obvious why but both these tests and the underlying race condition itself was addressed by #11249.
The race condition comes from when
SortBuilder::buildSort
is called simultaneously by multiple threads which results in theLinkedListed
inNestedScope
being accessed concurrently leading to the stack traces found in #11187 & #11258.In #11249 this was changed here to instead pass in the same
SortAndFormats
from the search context instead of rebuilding it on each thread. This means that we won't run into this same race condition anymore for nested sorts and I also verified thatSortBuilder::buildSort
is not called in a multi-threaded fashion from anywhere else.Thus since the underlying problem has been addressed, unmuting these tests.
Related Issues
Resolves #11187
Resolves #11258
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.