Bugfix grpc status handling for idle connection

[hlts2]

Description:

WHAT

When a connection status becomes IDLE, create a new connection and discard the old one.

WHY

If for some reason the component dropped (scale down ...etc.), the connection remains in an IDLE state at the origin (for a few minutes or so).
Due to the above, attempts to issue a request to a connection in the IDLE state will fail.

Related Issue:

Versions:

• Go Version: 1.19.4
• Docker Version: 20.10.8
• Kubernetes Version: 1.22.0
• NGT Version: 2.0.9

Checklist:

• I have read the CONTRIBUTING document and completed our CLA agreement.
• I have checked open Pull Requests for the similar feature or fixes?

Special notes for your reviewer:

[vdaas-ci]

[CHATOPS:HELP] ChatOps commands.

• 🙆‍♀️ /approve - approve
• 💌 /changelog - replace the PR body by changelog details
• 🍱 /format - format codes and add licenses
• ✅ /gen-test - generate test codes
• 🏷️ /label - add labels
• ⏪ /rebase - rebase main
• 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

[kpango]

LGTM

[codecov]

Codecov Report

Base: 50.23% // Head: 30.01% // Decreases project coverage by -20.22% ⚠️

Coverage data is based on head (b0d517f) compared to base (97eed29).
Patch has no changes to coverable lines.

Additional details and impacted files

@@             Coverage Diff             @@
##             main    #1921       +/-   ##
===========================================
- Coverage   50.23%   30.01%   -20.23%     
===========================================
  Files         231      365      +134     
  Lines       13464    33704    +20240     
===========================================
+ Hits         6764    10115     +3351     
- Misses       6499    23181    +16682     
- Partials      201      408      +207     

Impacted Files	Coverage Δ
cmd/agent/core/ngt/main.go	0.00% <ø> (ø)
cmd/agent/sidecar/main.go	0.00% <ø> (ø)
cmd/discoverer/k8s/main.go	0.00% <ø> (ø)
cmd/gateway/filter/main.go	0.00% <ø> (ø)
cmd/gateway/lb/main.go	0.00% <ø> (ø)
cmd/manager/index/main.go	0.00% <ø> (ø)
cmd/tools/cli/loadtest/main.go	0.00% <ø> (ø)
cmd/tools/cli/vdctl/main.go	0.00% <ø> (ø)
internal/observability/metrics/info/info.go	0.00% <0.00%> (-100.00%)	⬇️
internal/errors/vald.go	50.00% <0.00%> (-16.67%)	⬇️
... and 257 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[github-actions]

[FOSSA] The scan result will be available at https://app.fossa.com/projects/custom%2B21465%2Fvald/refs/branch/bugfix%2Finternal%2Fnet-grpc-connection-handling/50bc14979e8f7c33ec5079221d47bb7f6c64c3e8

[vdaas-ci]

Profile Report

type	vald-agent-ngt	vald-lb-gateway	vald-discoverer	vald-manager-index
cpu
heap

other images