create investigation test of max dim for NGT

[vankichi]

Signed-off-by: vankichi kyukawa315@gmail.com

Description:

I implemented the test for investigating the max dimension limit of vald-agent-ngt in any environment.
NGT can handle up to the 1 << 32 -1 dimension, but the real max dimension may not be the same depending on the environment.
This test can get the real max dimension for any environment.
For the time being, I set the limit of remaining free memory as 500MB to avoid such OOM kill or memory leak.
When the remaining free memory becomes 500MB or less, the test will finish and we can get the max bit in the environment.
In my environment (32GB Mem and free memory at the beginning is about 24GB), both results (max bit) are29 bit.

Related Issue:

How Has This Been Tested?:

Environment:

• Go Version: 1.18.1
• Docker Version: 20.10.8
• Kubernetes Version: 1.22.0
• NGT Version: 1.14.3

Types of changes:

• Bug fix [type/bug]
• New feature [type/feature]
• Add tests [type/test]
• Security related changes [type/security]
• Add documents [type/documentation]
• Refactoring [type/refactoring]
• Update dependencies [type/dependency]
• Update benchmarks and performances [type/bench]
• Update CI [type/ci]

Changes to Core Features:

• Have you added an explanation of what your changes do and why you'd like us to include them?
• Have you written new tests for your core changes, as applicable?
• Have you successfully ran tests with your changes locally?

Checklist:

• I have read the CONTRIBUTING document.
• I have checked open Pull Requests for the similar feature or fixes?
• I have added tests and benchmarks to cover my changes.
• I have ensured all new and existing tests passed.
• I have commented my code, particularly in hard-to-understand areas
• I have updated the documentation accordingly.

[vdaas-ci]

[CHATOPS:HELP] ChatOps commands.

• 🙆‍♀️ /approve - approve
• 💌 /changelog - replace the PR body by changelog details
• 🍱 /format - format codes and add licenses
• ✅ /gen-test - generate test codes
• 🏷️ /label - add labels
• ⏪ /rebase - rebase master
• 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

[codecov]

Codecov Report

Merging #1633 (e0fd7ff) into master (87679e9) will increase coverage by 0.05%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1633      +/-   ##
==========================================
+ Coverage   30.67%   30.73%   +0.05%     
==========================================
  Files         372      372              
  Lines       32234    32234              
==========================================
+ Hits         9889     9907      +18     
+ Misses      21975    21962      -13     
+ Partials      370      365       -5     

Impacted Files	Coverage Δ
internal/core/algorithm/ngt/ngt.go	64.70% <100.00%> (ø)
internal/core/algorithm/ngt/option.go	67.22% <100.00%> (ø)
internal/worker/worker.go	82.81% <0.00%> (-0.79%)	⬇️
internal/worker/queue.go	100.00% <0.00%> (+1.26%)	⬆️
pkg/agent/core/ngt/service/option.go	91.41% <0.00%> (+1.84%)	⬆️
...ent/core/ngt/service/vqueue/undeleted_index_map.go	71.11% <0.00%> (+2.77%)	⬆️
...nt/core/ngt/service/vqueue/uninserted_index_map.go	78.68% <0.00%> (+5.46%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 87679e9...e0fd7ff. Read the comment docs.

[vankichi]

@kpango
Since I got the approval from CRE members, please review this PR?

[kpango]

/format

[vdaas-ci]

[FORMAT] Updating license headers and formatting go codes triggered by kpango.

[github-actions]

[FOSSA] The scan result will be available at https://app.fossa.com/projects/custom%2B21465%2Fvald/refs/branch/test%2Ftests%2Fimpl-investigate-max-bit-for-ngt/f7f0cff244a710956d827b70b547babcef1d3f02