Add mirror gateway definitions and Implementations #2262

hlts2 · 2023-12-07T05:10:25Z

Description:

WHAT

I have added a new component(Vald Mirror Gateway) for BCP.
Vald Mirror Gateway is an optional component of the Vald, allowing the vector data to be synchronized across multiple Vald clusters. This component makes it possible to enhance availability during a cluster failure.
The following RPCs will be added in this PR. The CRUD RPCs remain unchanged.

Register RPC: Register mirror servers.

WHY

we need to support request mirroring for BCP

⚠️ FYI

Although there are many differences, most of them are due to automatic generation.
The following is the main addition.

Related PR:

#1792
#1948
#2237

Versions:

Go Version: 1.19.5
Docker Version: 20.10.8
Kubernetes Version: 1.22.0
NGT Version: 2.0.9

Checklist:

I have read the CONTRIBUTING document and completed our CLA agreement.
I have checked open Pull Requests for the similar feature or fixes?

Special notes for your reviewer:

How to deploy

Update helm repo for monitoring

helm repo update

Create k3d cluster

make k3d/restart

Deploy monitoring stack

 make k8s/external/cert-manager/deploy k8s/monitoring/deploy

Deploy multiple vald clusters

 make k8s/multi/vald/deploy

4.1. The following resources(MirrorTarget) is deployed using above command.

---
apiVersion: vald.vdaas.org/v1
kind: ValdMirrorTarget
metadata:
  name: mirror-target-01
  labels:
    group: mirror-group-01
spec:
  colocation: dc1
  target:
    host: vald-mirror-gateway.vald-01.svc.cluster.local
    port: 8081
---
apiVersion: vald.vdaas.org/v1
kind: ValdMirrorTarget
metadata:
  name: mirror-target-02
  labels:
    group: mirror-group-01
spec:
  colocation: dc1
  target:
    host: vald-mirror-gateway.vald-02.svc.cluster.local
    port: 8081

(E2E test)

Please execute the following command if you want to perform the e2e test.

E2E_TARGET_NAME=vald-mirror-gateway E2E_TARGET_NAMESPACE=vald-03 make e2e

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com>

* fix field name and yaml indent Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/add format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

This reverts commit 53ab94f.

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* add mirror definition and update proto dependencies Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway component (#1949) * add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add discovery logic for other mirror target Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add k8s template file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add crd for mirror target resource Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new values for mirror discovery logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * fix schema register error and fix manifest to multi vald cluster Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * bugfix: adapt the service account and add early return Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: usage of errors join Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: type conversion bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix metadata hash logic and add mirror group function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status handling for network connection Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactoring Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: status update handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: update status using status writer Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status timestamp Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix yaml field format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * improve status changes handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * reduced number of status updates Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * added status check handling before changing status Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update vald mirror target definition and add new cluster role Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * deploy multiple vald clusters and mirror target resource to connect with each other Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix e2d test to mirror-gateway and crd view field Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * define mirror app name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix golangci warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * crd generate command for mirror target using mirror-target-values Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add string field validation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add configuration comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * add image tag for debug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix rebase error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix wait timeout option Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new option to set mirror address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix for ingress configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create lb ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create filter ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for unimplemented codes error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix register addr process Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "update docker file for build error" This reverts commit f40986d. * add new package for docker build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway example (#2082) * add example code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute search and getobject request to all vald clusters Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fixed to send data to each cluster based on the dataset Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror target metrics Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix example ngt dimension Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com>

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* add mirror document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix svg to png Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Apply suggestions from code review * Update docs/overview/component/mirror-gateway.md * fix expand bug for mirror tutorial Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix filename typo Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add cluster role settings for mirror gateway Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add hdf5 installation section Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * update link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * delete quote Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> * Update docs/overview/component/mirror-gateway.md * Update docs/api/mirror-gateway.md Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * Update docs/api/mirror-gateway.md * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com> Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com>

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

This reverts commit 7ece16f.

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

hlts2 · 2024-01-19T05:48:57Z

Thank you for the review!! 🙏
I will merge this PR!!!

* add mirror definition and update proto dependencies Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway component (#1949) * add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Rename ip to host of proto payload field for mirror gateway (#2031) * fix field name and yaml indent Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/add format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/add & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix docker build for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "fix docker build for mirror" This reverts commit 53ab94f. * fix docker build error for mirror gateway Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add Custom Resource for mirror target (#2023) * add mirror definition and update proto dependencies Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway component (#1949) * add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add discovery logic for other mirror target Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add k8s template file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add crd for mirror target resource Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new values for mirror discovery logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * fix schema register error and fix manifest to multi vald cluster Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * bugfix: adapt the service account and add early return Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: usage of errors join Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: type conversion bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix metadata hash logic and add mirror group function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status handling for network connection Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactoring Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: status update handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: update status using status writer Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status timestamp Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix yaml field format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * improve status changes handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * reduced number of status updates Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * added status check handling before changing status Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update vald mirror target definition and add new cluster role Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * deploy multiple vald clusters and mirror target resource to connect with each other Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix e2d test to mirror-gateway and crd view field Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * define mirror app name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix golangci warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * crd generate command for mirror target using mirror-target-values Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add string field validation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add configuration comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * add image tag for debug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix rebase error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix wait timeout option Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new option to set mirror address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix for ingress configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create lb ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create filter ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for unimplemented codes error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix register addr process Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "update docker file for build error" This reverts commit f40986d. * add new package for docker build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway example (#2082) * add example code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute search and getobject request to all vald clusters Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fixed to send data to each cluster based on the dataset Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror target metrics Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix example ngt dimension Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * fix mirror image tag Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway document (#2105) * add mirror document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix svg to png Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Apply suggestions from code review * Update docs/overview/component/mirror-gateway.md * fix expand bug for mirror tutorial Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix filename typo Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add cluster role settings for mirror gateway Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add hdf5 installation section Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * update link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * delete quote Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> * Update docs/overview/component/mirror-gateway.md * Update docs/api/mirror-gateway.md Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * Update docs/api/mirror-gateway.md * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com> Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * merge ingress configuration for lb and filter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix duplicate definition error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all & make schema update & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix test execution error for mirror handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all format and update schema and fails build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use resuable workflow to build mirror image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use internal sync package and refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add network policy settings and update deploy command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add default setting logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new fileld to crd schema and update crd Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix make command to deploy vald with mirror components Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add e2e test for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command to get pod status Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * disable sidecar e2e and add mirror e2e command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update cluster role Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add cluster-info dump command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "add cluster-info dump command" This reverts commit 7ece16f. * debug: add logs command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "debug: add logs command" This reverts commit 454eaf3. * add RemoveByTimestamp for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: update sleep time for operator deploy Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update wait time for vmt Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Returns all connection information in the registration rpc (#2199) * fix: returns all connection information in the registration rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: deleted unnecessary parameter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add handler logic to continue processing (#2204) * feat: add new crud logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: error handling logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: bugfix error handling for rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add test for RemoveByTimestamp Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: fails error test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: test logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add new condition and add test case Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: error handling and comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: test case name and test case order Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: execute format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add new comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update Mirror Gateway document (#2207) * fix: update mirror document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add removeByTimestamp section Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning and refactor document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add mirror gateway troubleshooting docs Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 2c492f7 according to the output from Gofumpt and Prettier. Details: #2207 * feat: add contents of troubleshooting document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: link path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: invalid link path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor docs Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary contents Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: status handling logic document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: document refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: bugfix status handling document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor sentence Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * feat: schema and protobuf update Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: reviewdog warning and add comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 7d7a690 according to the output from Gofumpt and Prettier. Details: #2237 * fix: reviewdog warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: reviewdog warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: move mirror client mock definition to internal package Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add new handler base logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor stream list object rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: divide logic to other function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in e62a657 according to the output from Gofumpt and Prettier. Details: #2237 * make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: return grpc error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add mirror service test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add mock definition code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in d6580ec according to the output from Gofumpt and Prettier. Details: #2237 * fix: use internal method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: delete Exist method because it is not needed Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: use address cache insted of connectedAddr method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: improve connection management and add new test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add test for syncronizee based on address and small refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: improve error handling and example image tag Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: schema update and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update charts/vald/values/multi-vald/dev-vald-with-mirror.yaml * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 4c11568 according to the output from Gofumpt and Prettier. Details: #2262 * fix: reviewdog warning and deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: use new command to docker build Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: update schema and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary RPCs due to failure of previous rebasing Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: proto and execute make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: revert unnecessary changes Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: apply feedback for comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add internal hash package to generate hash value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: ignore deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add function and method comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update pkg/gateway/mirror/handler/grpc/handler.go * fix: schema and proto update and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add ingress rule for lb and filter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted wildcard path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: ingress unified into one manifest Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lb ingress port settings and small refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add cluster wide ingress resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add deploy ingress resource using make command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com> Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com>

* Add mirror gateway definitions and Implementations (#2262) * add mirror definition and update proto dependencies Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway component (#1949) * add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Rename ip to host of proto payload field for mirror gateway (#2031) * fix field name and yaml indent Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/add format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/add & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix docker build for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "fix docker build for mirror" This reverts commit 53ab94f. * fix docker build error for mirror gateway Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add Custom Resource for mirror target (#2023) * add mirror definition and update proto dependencies Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway component (#1949) * add mirror component Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror dockerfile path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix insert rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix api resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror service and fix handler logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix values and helm template for new configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with gofumpt and prettier * fix template rendering bug of mirror configmap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix nil pointer error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix to advertize different address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * returns error when there is no other mirror gateways Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add info log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * extract only mirror addresses Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix log variable Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add logging Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix mirror connection logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api proxy implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for register API Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix debug message Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor discover logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add remove api Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * add remove api and remove api rollback logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add update rpc handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor context variable for grpc method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace span name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add getObjects method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor update and remove handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add multi handler implementation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix mirror client trace span Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * rename discover service to mirror service Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error of bidirectional stream Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add more error handling to search handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status code log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix named return bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add force status wrap Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute upsert method to local cluster's lb Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add target debug log Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix delete unwrap of circuitbreaker Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor error handling for new status parse function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Format code with prettier and gofumpt * refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix error handling for broadcast operation of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error join bug of getobject Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix status handling and add address to resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use vald client for update operation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add rollback test for mirror crud Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor mirror servie Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix trace attribute and refactor variable name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling when crud rpc fails Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "make format" This reverts commit f605563. * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * apply suggestion Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix and refactor mirror client Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * add discovery logic for other mirror target Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add k8s template file Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add crd for mirror target resource Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new values for mirror discovery logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * fix schema register error and fix manifest to multi vald cluster Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * bugfix: adapt the service account and add early return Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: usage of errors join Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: type conversion bug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix metadata hash logic and add mirror group function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status handling for network connection Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactoring Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: status update handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix: update status using status writer Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add status timestamp Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix yaml field format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * improve status changes handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * reduced number of status updates Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * added status check handling before changing status Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update vald mirror target definition and add new cluster role Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * deploy multiple vald clusters and mirror target resource to connect with each other Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix e2d test to mirror-gateway and crd view field Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * define mirror app name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * deleted unused code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix golangci warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * crd generate command for mirror target using mirror-target-values Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add string field validation Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add configuration comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with gofumpt and prettier * add image tag for debug Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix rebase error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix wait timeout option Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new option to set mirror address Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix for ingress configuration Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create lb ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * not create filter ingress when mirror is enabled Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add error handling for unimplemented codes error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix register addr process Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "update docker file for build error" This reverts commit f40986d. * add new package for docker build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway example (#2082) * add example code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * execute search and getobject request to all vald clusters Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fixed to send data to each cluster based on the dataset Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add mirror target metrics Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix example ngt dimension Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * fix mirror image tag Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add mirror gateway document (#2105) * add mirror document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix svg to png Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Update docs/api/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Apply suggestions from code review * Update docs/overview/component/mirror-gateway.md * fix expand bug for mirror tutorial Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: Format code with prettier and gofumpt * fix filename typo Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add cluster role settings for mirror gateway Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add hdf5 installation section Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> * update link Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * delete quote Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update mirror component overview image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update docs/overview/component/mirror-gateway.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> * Update docs/overview/component/mirror-gateway.md * Update docs/api/mirror-gateway.md Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * Update docs/api/mirror-gateway.md * Update docs/user-guides/mirroring-configuration.md Co-authored-by: Kevin Diu <kevindiujp@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com> Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * merge ingress configuration for lb and filter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix duplicate definition error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all & make schema update & make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix test execution error for mirror handler Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * make proto/all format and update schema and fails build error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use resuable workflow to build mirror image Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * use internal sync package and refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add network policy settings and update deploy command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add default setting logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add new fileld to crd schema and update crd Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix make command to deploy vald with mirror components Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add e2e test for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add debug command to get pod status Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * bugfix command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * disable sidecar e2e and add mirror e2e command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update cluster role Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * add cluster-info dump command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "add cluster-info dump command" This reverts commit 7ece16f. * debug: add logs command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Revert "debug: add logs command" This reverts commit 454eaf3. * add RemoveByTimestamp for mirror Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: update sleep time for operator deploy Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * update wait time for vmt Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Returns all connection information in the registration rpc (#2199) * fix: returns all connection information in the registration rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: deleted unnecessary parameter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Add handler logic to continue processing (#2204) * feat: add new crud logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: error handling logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: bugfix error handling for rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add test for RemoveByTimestamp Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: fails error test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor: test logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add new condition and add test case Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * refactor code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: error handling and comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: test case name and test case order Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: execute format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add new comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update Mirror Gateway document (#2207) * fix: update mirror document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add removeByTimestamp section Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning and refactor document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add mirror gateway troubleshooting docs Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 2c492f7 according to the output from Gofumpt and Prettier. Details: #2207 * feat: add contents of troubleshooting document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: grammar Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: link path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: invalid link path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor docs Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary contents Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: status handling logic document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: document refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: bugfix status handling document Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor sentence Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * feat: schema and protobuf update Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: reviewdog warning and add comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 7d7a690 according to the output from Gofumpt and Prettier. Details: #2237 * fix: reviewdog warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: reviewdog warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: move mirror client mock definition to internal package Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add new handler base logic Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor stream list object rpc Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: divide logic to other function Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in e62a657 according to the output from Gofumpt and Prettier. Details: #2237 * make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: return grpc error Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add mirror service test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add mock definition code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in d6580ec according to the output from Gofumpt and Prettier. Details: #2237 * fix: use internal method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: delete Exist method because it is not needed Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: use address cache insted of connectedAddr method Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: improve connection management and add new test Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: refactor error handling Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add test for syncronizee based on address and small refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: improve error handling and example image tag Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: schema update and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update charts/vald/values/multi-vald/dev-vald-with-mirror.yaml * fix: lint warnning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in 4c11568 according to the output from Gofumpt and Prettier. Details: #2262 * fix: reviewdog warning and deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: use new command to docker build Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: update schema and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary RPCs due to failure of previous rebasing Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: proto and execute make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: revert unnecessary changes Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted unnecessary code Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make proto/all format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: apply feedback for comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add internal hash package to generate hash value Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: ignore deepsource warning Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add function and method comment Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * Update pkg/gateway/mirror/handler/grpc/handler.go * fix: schema and proto update and format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add ingress rule for lb and filter Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: deleted wildcard path Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: ingress unified into one manifest Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: make format Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: lb ingress port settings and small refactor Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * feat: add cluster wide ingress resource name Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> * fix: add deploy ingress resource using make command Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com> Co-authored-by: Yusuke Kadowaki <yusuke.kadowaki.1231@gmail.com> * Update values-readreplica.yaml with new index path and in-memory mode * Update POD_NAME environment variable in e2e.yml * Add readreplica e2e logic * Refactor e2e test for read replica * Update E2E test name and add read replica rotation * Update E2E test parameters for improved performance * Refactor setup-e2e action.yaml * Refactor * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in a68a83d according to the output from Gofumpt and Prettier. Details: #2298 * Add kubectl package for Kubernetes operations * Remove unused param * Fix function parameter order in kubectl package * Refactor kubectl.go: Add copyright notice and fix error handling * FIx error handling * Prevent command injection * Apply format * Seperate k8s client initialization in TestE2EReadReplica * Fix comment * style: format code with Gofumpt and Prettier This commit fixes the style issues introduced in d127dbc according to the output from Gofumpt and Prettier. Details: #2298 --------- Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com> Co-authored-by: Kevin Diu <kevindiujp@gmail.com>

hlts2 and others added 30 commits September 21, 2023 11:20

add mirror definition and update proto dependencies

0fc1949

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

make proto/add & make format

c3f987a

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix docker build for mirror

6347736

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

Revert "fix docker build for mirror"

2c0d146

This reverts commit 53ab94f.

fix docker build error for mirror gateway

e905008

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix mirror image tag

1f24460

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

merge ingress configuration for lb and filter

9d40824

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix duplicate definition error

7e4c2c7

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

make proto/all & make schema update & make format

bd35400

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix test execution error for mirror handler

9fd7fa2

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

make proto/all format and update schema and fails build error

91ea275

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

use resuable workflow to build mirror image

c26ac88

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

use internal sync package and refactor

8a172d9

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix error handling

65af965

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add network policy settings and update deploy command

19558ab

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add default setting logic

3924e8f

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add new fileld to crd schema and update crd

8fabca9

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

fix make command to deploy vald with mirror components

00b9e01

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add e2e test for mirror

6eaba03

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add debug command to get pod status

4fea273

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

bugfix command

b32c705

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

disable sidecar e2e and add mirror e2e command

37923f3

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

update cluster role

b410364

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

add cluster-info dump command

7ece16f

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

Revert "add cluster-info dump command"

2ed49ca

This reverts commit 7ece16f.

debug: add logs command

454eaf3

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

hlts2 dismissed vankichi’s stale review via 1027b47 January 11, 2024 05:57

hlts2 requested review from ykadowak, kpango and vankichi January 11, 2024 05:58

vankichi approved these changes Jan 11, 2024

View reviewed changes

ykadowak approved these changes Jan 11, 2024

View reviewed changes

Merge branch 'main' into feature/mirror-gateway-definition

c5e43ca

hlts2 added actions/e2e-deploy actions/e2e-chaos actions/e2e-max-dim and removed actions/e2e-deploy actions/e2e-chaos actions/e2e-max-dim labels Jan 11, 2024

Merge branch 'main' into feature/mirror-gateway-definition

6ba9f57

kpango approved these changes Jan 17, 2024

View reviewed changes

datelier approved these changes Jan 17, 2024

View reviewed changes

Merge branch 'main' into feature/mirror-gateway-definition

dd370c2

hlts2 merged commit 306f0ef into main Jan 19, 2024
146 of 148 checks passed

hlts2 deleted the feature/mirror-gateway-definition branch January 19, 2024 05:49

This was referenced Feb 15, 2024

[patch] Release v1.7.11 #2355

Merged

[patch] Release v1.7.11 #2358

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add mirror gateway definitions and Implementations #2262

Add mirror gateway definitions and Implementations #2262

hlts2 commented Dec 7, 2023 •

edited

Loading

hlts2 commented Jan 19, 2024

Add mirror gateway definitions and Implementations #2262

Add mirror gateway definitions and Implementations #2262

Conversation

hlts2 commented Dec 7, 2023 • edited Loading

Description:

WHAT

WHY

⚠️ FYI

Related PR:

Versions:

Checklist:

Special notes for your reviewer:

How to deploy

hlts2 commented Jan 19, 2024

hlts2 commented Dec 7, 2023 •

edited

Loading