Refactor/dockers/apply build for 2 platform #2267

vankichi · 2023-12-08T00:37:02Z

Description:

SSIA

Related Issue:

Versions:

Go Version: 1.21.5
Docker Version: 20.10.8
Kubernetes Version: v1.28.4
NGT Version: 2.1.5

Checklist:

I have read the CONTRIBUTING document and completed our CLA agreement.
I have checked open Pull Requests for the similar feature or fixes?

Special notes for your reviewer:

* Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

* Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* ✨ create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ♻️ Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * ✨ Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * 🐛 Fix job function to apply rate limiter * ♻️ Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * create helm template for benchmark operator (#2027) * ✨ create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ♻️ Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * ✨ Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * 🐛 Fix job function to apply rate limiter * ♻️ Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * ✨ create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * 💚 invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert "💚 invest" This reverts commit f0f585c. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * ✨ apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * ✨ add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * ✨ ♻️ add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * ✨ impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * ✨ create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * ✨ impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * ♻️ rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ✨ impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ♻️ Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * ✨ Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * 🐛 Fix job function to apply rate limiter * ♻️ Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * 🐛 Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * ♻️ Add noise to vector when update/upsert and update crd Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ add deepmerge func for override default config by user-defined config Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ refactor deepmerge Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * style: Format code with prettier and gofumpt * ♻️ change add noise func Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ use golang/sync/error for prevent OOM KILL Signed-off-by: vankichi <kyukawa315@gmail.com> * ♻️ fix config adn add test Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

Signed-off-by: vankichi <kyukawa315@gmail.com>

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

Signed-off-by: vankichi <kyukawa315@gmail.com>

vdaas-ci · 2023-12-08T00:37:26Z

[CHATOPS:HELP] ChatOps commands.

🙆‍♀️ /approve - approve
🍱 /format - format codes and add licenses
✅ /gen-test - generate test codes
🏷️ /label - add labels
🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

cloudflare-pages · 2023-12-08T08:07:58Z

Deploying with Cloudflare Pages

Latest commit:	`168a1b2`
Status:	✅ Deploy successful!
Preview URL:	https://9b8036b0.vald.pages.dev
Branch Preview URL:	https://refactore-dockers-apply-buil.vald.pages.dev

View logs

Signed-off-by: vankichi <kyukawa315@gmail.com>

github-actions · 2023-12-11T06:42:23Z

internal/k8s/vald/benchmark/job/job_template_option.go

@@ -67,6 +67,7 @@ type BenchmarkJobOption func(b *jobs.Job) error
 var defaultBenchmarkJobOpts = []BenchmarkJobOption{
 	WithSvcAccountName(svcAccount),
 	WithRestartPolicy(RestartPolicyNever),
+	WithTTLSecondsAfterFinished(int32(600)),


🚫 [golangci] _{reported by reviewdog 🐶}
mnd: Magic number: 600, in detected (gomnd)

codecov · 2023-12-11T06:45:36Z

Codecov Report

All modified and coverable lines are covered by tests ✅

❗ No coverage uploaded for pull request base (feature/continuous-benchmark@f9f569a). Click here to learn what that means.

Additional details and impacted files

@@                       Coverage Diff                       @@
##             feature/continuous-benchmark    #2267   +/-   ##
===============================================================
  Coverage                                ?   30.31%           
===============================================================
  Files                                   ?      377           
  Lines                                   ?    37107           
  Branches                                ?        0           
===============================================================
  Hits                                    ?    11248           
  Misses                                  ?    25301           
  Partials                                ?      558

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

…ply-build-for-2-platform

github-actions · 2023-12-11T08:28:35Z

apis/docs/v1/docs.md

+
+### Help
+
+Provides links to documentation or for performing an out of band action.


[LanguageTool] _{reported by reviewdog 🐶}
Did you mean “out-of-band”? (OUT_OF_PLACE[1])
Suggestions: out-of-band
URL: https://languagetool.org/insights/post/hyphen/#hyphenated-phrases-with-more-than-one-hyphen
Rule: https://community.languagetool.org/rule/show/OUT_OF_PLACE?lang=en-US&subId=1
Category: PUNCTUATION

Makefile.d/build.mk

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

hlts2

LGTM!!

kpango · 2023-12-12T04:44:30Z

go.sum

@@ -219,6 +219,8 @@ github.com/aws/aws-sdk-go-v2/service/sts v1.26.3 h1:KfREzajmHCSYjCaMRtdLr9boUMA7
 github.com/aws/aws-sdk-go-v2/service/sts v1.26.3/go.mod h1:7Ld9eTqocTvJqqJ5K/orbSDwmGcpRdlDiLjz2DO+SL8=
 github.com/aws/smithy-go v1.18.1 h1:pOdBTUfXNazOlxLrgeYalVnuTpKreACHtc62xLwIB3c=
 github.com/aws/smithy-go v1.18.1/go.mod h1:NukqUGpCZIILqqiV0NIjeFh24kd/FAa4beRb6nbIUPE=
+github.com/benbjohnson/clock v1.3.5 h1:VvXlSJBzZpA/zum6Sj74hxwYI2DIxRWuNIoXAzHZz5o=


can you describe about this libs?
go mod why github.com/benbjohnson/clock

@kpango
It is because go.uber.org/ratelimit requires benbjonshon/clock, and I think I missed go.mod file before rebasing.

* Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * create helm template for benchmark operator (#2027) * :sparkles: create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * style: Format code with prettier and gofumpt * Update charts and improvement conbench (#2119) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * create helm template for benchmark operator (#2027) * :sparkles: create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Add noise to vector when update/upsert and update crd Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: add deepmerge func for override default config by user-defined config Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor deepmerge Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * style: Format code with prettier and gofumpt * :recycle: change add noise func Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: use golang/sync/error for prevent OOM KILL Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix config adn add test Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Apply new internal/sync for continous benchmark (#2175) Signed-off-by: vankichi <kyukawa315@gmail.com> * :whale: fix Dockerfile Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix license and format Signed-off-by: vankichi <kyukawa315@gmail.com> * :white_check_mark: add benchmark operator reconcile test Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Refactor from deepsource feedback (#2222) Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: use modulo to calc idx, fix Makefile, add error handling Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: Fix feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :whale: Fix dockerfile Signed-off-by: vankichi <kyukawa315@gmail.com> * :whale: Fix dockerfile Signed-off-by: vankichi <kyukawa315@gmail.com> * Update Makefile.d/build.mk Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Update Makefile.d/build.mk Co-authored-by: Yusuke Kato <kpango@vdaas.org> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>

* Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * create helm template for benchmark operator (#2027) * :sparkles: create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * style: Format code with prettier and gofumpt * Update charts and improvement conbench (#2119) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * create helm template for benchmark operator (#2027) * :sparkles: create helm template for benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: refactor helm template Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with gofumpt and prettier --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * Refactor helm template and operator logic (#2043) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl status handle of continuous benchmark crds (#1955) Signed-off-by: vankichi <kyukawa315@gmail.com> * Impl benchmark jobs (#1977) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix proto Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: add benchmark job image build ci Signed-off-by: vankichi <kyukawa315@gmail.com> * :green_heart: invest Signed-off-by: vankichi <kyukawa315@gmail.com> * Revert ":green_heart: invest" This reverts commit f0f585ccf71b1c95a88559941557a27774096e69. * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply code review Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * :sparkles: apply from feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Update internal/config/benchmark.go Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: change directory path Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> * Add crds for continuous benchmark tools (#1789) * :sparkles: add crds for continuous benchmark operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add benchmark operator/job scheme Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: rename package names and add doc.go Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create runtime object Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> * Add Job reconciler & Change directory constitution of internal/k8s for benchmark (#1825) * :sparkles: :recycle: add Job reconciler & use scenario instead of operator Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format & rename file Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Add benchmark operator framework (#1916) * :sparkles: impl benchmark reconciler Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: create benchmark operator framework Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: remove unness changes Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * impl reconcile logic for create benchmark job (#1923) * :sparkles: impl reconcile logic for create benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark's crds Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: resolve error due to update conn bench crds for pkg/tools/benchmark/job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor continuous benchmark job logic Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: update charts Signed-off-by: vankichi <kyukawa315@gmail.com> * Format code with prettier and gofumpt * :recycle: rafactor con bench config and bug fix reconcile logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Bugfix: fix typo and recall function logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor pkg benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :sparkles: impl benchmark jobs Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: apply feedback Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Refactor helm template and operator logic Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Add download original dataset URL option Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Set docker image location at the benchmark operator configmap and use it when information is set Signed-off-by: vankichi <kyukawa315@gmail.com> * add search algorithm benchmark and update search aggregation algo Signed-off-by: kpango <kpango@vdaas.org> * :sparkles: Add search result aggregation option Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * Improve job performance (#2061) * :bug: Fix job function to apply rate limiter * :recycle: Add pyroscope setting Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix build error Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> * :bug: Fix docker file and add concurrencyLimit for job goroutine Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job_template.go by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix job logic by feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix Signed-off-by: vankichi <kyukawa315@gmail.com> --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Add noise to vector when update/upsert and update crd Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: add deepmerge func for override default config by user-defined config Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor deepmerge Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt * style: Format code with prettier and gofumpt * :recycle: change add noise func Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: use golang/sync/error for prevent OOM KILL Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix config adn add test Signed-off-by: vankichi <kyukawa315@gmail.com> * style: Format code with prettier and gofumpt --------- Signed-off-by: vankichi <kyukawa315@gmail.com> Signed-off-by: kpango <kpango@vdaas.org> Co-authored-by: Yusuke Kato <kpango@vdaas.org> Co-authored-by: Hiroto Funakoshi <hiroto.funakoshi.hiroto@gmail.com> Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com> * :recycle: Apply new internal/sync for continous benchmark (#2175) Signed-off-by: vankichi <kyukawa315@gmail.com> * :whale: fix Dockerfile Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Fix license and format Signed-off-by: vankichi <kyukawa315@gmail.com> * :white_check_mark: add benchmark operator reconcile test Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: Refactor from deepsource feedback (#2222) Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: use modulo to calc idx, fix Makefile, add error handling Signed-off-by: vankichi <kyukawa315@gmail.com> * Apply suggestions from code review Co-authored-by: Yusuke Kato <kpango@vdaas.org> * :recycle: Fix feedback Signed-off-by: vankichi <kyukawa315@gmail.com> * Refactor/dockers/apply build for 2 platform (#2267) * Implement base of continuous benchmark tool (#1776) * Create Continuous Bench Search Job tool (#1733) * :sparkles: create bench job search tools Signed-off-by: vankichi <kyukawa315@gmail.com> * :sparkles: add load hdf5 functions Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix format Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix docker and use hdf5 data Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: refactor benchmark job Signed-off-by: vankichi <kyukawa315@gmail.com> * :recycle: fix Signed…

vankichi and others added 16 commits December 7, 2023 15:56

✨ impl status handle of continuous benchmark crds (#1955)

8364531

Signed-off-by: vankichi <kyukawa315@gmail.com>

style: Format code with prettier and gofumpt

3257500

♻️ Apply new internal/sync for continous benchmark (#2175)

fbebac6

Signed-off-by: vankichi <kyukawa315@gmail.com>

🐳 fix Dockerfile

27b9e9f

Signed-off-by: vankichi <kyukawa315@gmail.com>

♻️ Fix license and format

6fee4cf

Signed-off-by: vankichi <kyukawa315@gmail.com>

✅ add benchmark operator reconcile test

ebb58fb

Signed-off-by: vankichi <kyukawa315@gmail.com>

♻️ Refactor from deepsource feedback (#2222)

2cb4d27

Signed-off-by: vankichi <kyukawa315@gmail.com>

♻️ use modulo to calc idx, fix Makefile, add error handling

f85f4bc

Signed-off-by: vankichi <kyukawa315@gmail.com>

Apply suggestions from code review

5284f39

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

♻️ Fix feedback

3a59386

Signed-off-by: vankichi <kyukawa315@gmail.com>

🐳 Fix dockerfile

a546a5d

Signed-off-by: vankichi <kyukawa315@gmail.com>

github-actions bot added team/sre SRE team area/makefile size/XXXL priority/low labels Dec 8, 2023

🐳 Fix dockerfile

ce7414d

Signed-off-by: vankichi <kyukawa315@gmail.com>

vankichi force-pushed the refactore/dockers/apply-build-for-2-platform branch from c144c29 to ce7414d Compare December 11, 2023 06:38

github-actions bot added the area/internal label Dec 11, 2023

github-actions bot reviewed Dec 11, 2023

View reviewed changes

vankichi requested review from kpango and hlts2 December 11, 2023 08:22

vankichi force-pushed the feature/continuous-benchmark branch from 3a59386 to f9f569a Compare December 11, 2023 08:22

Merge branch 'feature/continuous-benchmark' into refactore/dockers/ap…

643f7a8

…ply-build-for-2-platform

github-actions bot reviewed Dec 11, 2023

View reviewed changes

kpango requested changes Dec 11, 2023

View reviewed changes

Makefile.d/build.mk Outdated Show resolved Hide resolved

Makefile.d/build.mk Outdated Show resolved Hide resolved

vankichi and others added 2 commits December 11, 2023 18:27

Update Makefile.d/build.mk

6f03f03

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

Update Makefile.d/build.mk

168a1b2

Co-authored-by: Yusuke Kato <kpango@vdaas.org>

vankichi requested a review from kpango December 11, 2023 09:27

vankichi changed the title ~~[WIP] Refactor/dockers/apply build for 2 platform~~ Refactor/dockers/apply build for 2 platform Dec 12, 2023

hlts2 approved these changes Dec 12, 2023

View reviewed changes

kpango reviewed Dec 12, 2023

View reviewed changes

vankichi requested a review from kpango December 12, 2023 04:52

kpango approved these changes Dec 12, 2023

View reviewed changes

vankichi merged commit d119482 into feature/continuous-benchmark Dec 12, 2023
120 of 122 checks passed

vankichi deleted the refactore/dockers/apply-build-for-2-platform branch December 12, 2023 04:59

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Refactor/dockers/apply build for 2 platform #2267

Refactor/dockers/apply build for 2 platform #2267

vankichi commented Dec 8, 2023 •

edited

Loading

vdaas-ci commented Dec 8, 2023

cloudflare-pages bot commented Dec 8, 2023 •

edited

Loading

github-actions bot Dec 11, 2023

codecov bot commented Dec 11, 2023 •

edited

Loading

github-actions bot Dec 11, 2023

hlts2 left a comment

kpango Dec 12, 2023

vankichi Dec 12, 2023

kpango Dec 12, 2023


		### Help

		Provides links to documentation or for performing an out of band action.

Refactor/dockers/apply build for 2 platform #2267

Refactor/dockers/apply build for 2 platform #2267

Conversation

vankichi commented Dec 8, 2023 • edited Loading

Description:

Related Issue:

Versions:

Checklist:

Special notes for your reviewer:

vdaas-ci commented Dec 8, 2023

cloudflare-pages bot commented Dec 8, 2023 • edited Loading

Deploying with Cloudflare Pages

github-actions bot Dec 11, 2023

Choose a reason for hiding this comment

codecov bot commented Dec 11, 2023 • edited Loading

Codecov Report

github-actions bot Dec 11, 2023

Choose a reason for hiding this comment

hlts2 left a comment

Choose a reason for hiding this comment

kpango Dec 12, 2023

Choose a reason for hiding this comment

vankichi Dec 12, 2023

Choose a reason for hiding this comment

kpango Dec 12, 2023

Choose a reason for hiding this comment

vankichi commented Dec 8, 2023 •

edited

Loading

cloudflare-pages bot commented Dec 8, 2023 •

edited

Loading

codecov bot commented Dec 11, 2023 •

edited

Loading