Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updating Ip fields to use doc_values to search #11508

Merged
merged 12 commits into from
Jan 30, 2024

Conversation

harshavamsi
Copy link
Contributor

@harshavamsi harshavamsi commented Dec 7, 2023

Description

Fixes term and range queries on IpFields to be able to perform searches when only doc_values is enabled.

Related Issues

Resolves #11144

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions github-actions bot added enhancement Enhancement or improvement to existing feature or request Search:Performance v2.12.0 Issues and PRs related to version 2.12.0 labels Dec 7, 2023
Copy link
Contributor

github-actions bot commented Dec 7, 2023

Compatibility status:

Checks if related components are compatible with change 407b723

Incompatible components

Incompatible components: [https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/cross-cluster-replication.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/sql.git]

Copy link
Contributor

github-actions bot commented Dec 7, 2023

❌ Gradle check result for 4b2b0c5: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Dec 7, 2023

❌ Gradle check result for f15a2ae: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Copy link
Contributor

❕ Gradle check result for 407b723: UNSTABLE

  • TEST FAILURES:
      1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing
      1 org.opensearch.action.admin.cluster.node.tasks.ResourceAwareTasksTests.testTaskResourceTrackingDuringTaskCancellation

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

@reta
Copy link
Collaborator

reta commented Jan 29, 2024

@andrross LGTY? :-)

@andrross andrross added the backport 2.x Backport to 2.x branch label Jan 30, 2024
@andrross andrross merged commit cc9ee9d into opensearch-project:main Jan 30, 2024
34 of 35 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jan 30, 2024
* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
(cherry picked from commit cc9ee9d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
reta pushed a commit that referenced this pull request Jan 30, 2024
* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
(cherry picked from commit cc9ee9d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
reta pushed a commit that referenced this pull request Jan 30, 2024
* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
(cherry picked from commit cc9ee9d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
reta pushed a commit that referenced this pull request Jan 31, 2024
* Updating Ip fields to use doc_values to search



* Fix IP tests



* Fix skip to allow yaml test to pass on main



* Update tests to use existing test file



* Changing skip version to match bwc



* Using exact match instead of range



* Spotless



* Fix IP field tests



* Fix spotless + precommit failure



* Get point out of query and into value



* Fix term tests



* Add skip test logic to only doc_values test



---------


(cherry picked from commit cc9ee9d)

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
peteralfonsi pushed a commit to peteralfonsi/OpenSearch that referenced this pull request Mar 1, 2024
)

* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
rayshrey pushed a commit to rayshrey/OpenSearch that referenced this pull request Mar 18, 2024
)

* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
)

* Updating Ip fields to use doc_values to search

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix skip to allow yaml test to pass on main

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Update tests to use existing test file

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Changing skip version to match bwc

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Using exact match instead of range

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Spotless

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix IP field tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix spotless + precommit failure

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Get point out of query and into value

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix term tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Add skip test logic to only doc_values test

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
@mkhludnev
Copy link
Contributor

I'm afraid there is an edge case cc9ee9d#r148997353

@msfroh
Copy link
Collaborator

msfroh commented Nov 12, 2024

I'm afraid there is an edge case

@mkhludnev -- are you able to fix that as part of #16391 ? If not, we can open a separate issue for it.

@mkhludnev mkhludnev mentioned this pull request Nov 13, 2024
2 tasks
@mkhludnev
Copy link
Contributor

#16628 here we go. #16391 turns out deeper than I though. tbc

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch enhancement Enhancement or improvement to existing feature or request Search:Performance v2.12.0 Issues and PRs related to version 2.12.0 v3.0.0 Issues and PRs related to version 3.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

IpFieldMapper should use IndexOrDocValuesQuery where possible
5 participants