Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bugfix] fp16 problems #2049

Merged
merged 3 commits into from
Jun 9, 2023
Merged

Conversation

kpango
Copy link
Collaborator

@kpango kpango commented Jun 6, 2023

Description:

he current vald implementation cannot correctly handle GetObject RPCs because the Go language does not support half-precision floating point.

The next version of NGT will include a new CAPI that can correctly get fp16 arrays as float arrays.

So I've implemented it and Updated NGT version to 2.0.12

Related Issue:

#1781

Versions:

  • Go Version: 1.20.3
  • Docker Version: 20.10.8
  • Kubernetes Version: 1.22.0
  • NGT Version: 2.0.11

Checklist:

Special notes for your reviewer:

@vdaas-ci
Copy link
Collaborator

vdaas-ci commented Jun 6, 2023

[CHATOPS:HELP] ChatOps commands.

  • 🙆‍♀️ /approve - approve
  • 💌 /changelog - replace the PR body by changelog details
  • 🍱 /format - format codes and add licenses
  • /gen-test - generate test codes
  • 🏷️ /label - add labels
  • /rebase - rebase main
  • 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

@codecov
Copy link

codecov bot commented Jun 6, 2023

Codecov Report

Patch coverage: 9.52% and project coverage change: -1.21 ⚠️

Comparison is base (96df080) 29.99% compared to head (f34275c) 28.78%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2049      +/-   ##
==========================================
- Coverage   29.99%   28.78%   -1.21%     
==========================================
  Files         366      344      -22     
  Lines       34797    30015    -4782     
==========================================
- Hits        10436     8641    -1795     
+ Misses      23878    21085    -2793     
+ Partials      483      289     -194     
Impacted Files Coverage Δ
internal/k8s/metrics/node/node.go 0.00% <0.00%> (ø)
internal/k8s/metrics/pod/pod.go 0.00% <0.00%> (ø)
internal/k8s/node/node.go 0.00% <0.00%> (ø)
internal/k8s/pod/pod.go 0.00% <0.00%> (ø)
internal/k8s/reconciler.go 0.00% <ø> (ø)
pkg/gateway/lb/handler/grpc/aggregation.go 0.00% <0.00%> (ø)
pkg/gateway/lb/handler/grpc/handler.go 0.00% <0.00%> (ø)
pkg/gateway/lb/handler/grpc/pairing_heap.go 92.30% <92.30%> (ø)
internal/file/file.go 12.69% <100.00%> (+0.69%) ⬆️
internal/rand/rand.go 83.87% <100.00%> (+1.11%) ⬆️
... and 1 more

... and 29 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Jun 7, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: d7ce12e
Status:⚡️  Build in progress...

View logs

@kpango kpango force-pushed the bugfix/internal-core-ngt/fix-fp16-problems branch 2 times, most recently from cc63a73 to a1e6788 Compare June 7, 2023 02:43
@kpango kpango force-pushed the bugfix/internal-core-ngt/fix-fp16-problems branch 4 times, most recently from 621e6cb to 43a0234 Compare June 8, 2023 02:18
Signed-off-by: kpango <kpango@vdaas.org>
@kpango kpango force-pushed the bugfix/internal-core-ngt/fix-fp16-problems branch from 43a0234 to 829bb4c Compare June 8, 2023 02:29
@kpango kpango changed the title [WIP] fix fp16 problems [bugfix] fp16 problems Jun 8, 2023
@kpango kpango requested review from datelier and ykadowak June 8, 2023 02:35
Comment on lines +137 to +140
fmt.Println("r, t: ", r[i], t[i])
sum += math.Pow(float64(t[i]-r[i]), 2)
}
fmt.Println(sum)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably should refactor these prints

@kpango kpango merged commit ad3507e into main Jun 9, 2023
@kpango kpango deleted the bugfix/internal-core-ngt/fix-fp16-problems branch June 9, 2023 04:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants