Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor: Serialize iceberg table inside engine options to reduce catalog requests #17049

Draft
wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

refactor: Serialize iceberg table inside engine options to reduce catalog requests #17049

wants to merge 4 commits into from
+105 −60

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Dec 13, 2024 •
edited
Loading

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR will serialize iceberg table inside engine options to reduce catalog requests.

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Documentation Update
  • Refactoring
  • Performance Improvement
  • Other (please describe):

This change is Reviewable

@Xuanwo
feat: Bump iceberg-rust to latest commit
439da3a 
Signed-off-by: Xuanwo <github@xuanwo.io>
@github-actions github-actions bot added the pr-feature this PR introduces a new feature to the codebase label Dec 13, 2024
@Xuanwo Xuanwo added the ci-cloud Build docker image for cloud test label Dec 13, 2024
@github-actions GitHub Actions
Copy link
Contributor

Docker Image for PR

  • tag: pr-17049-d91eaca-1734097742

note: this image tag is only available for internal use,
please check the internal doc for more details.

@Xuanwo Xuanwo marked this pull request as draft December 13, 2024 15:04
@Xuanwo
Don't load from catalog everytime
fee2883 
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo Xuanwo changed the title feat: Bump iceberg-rust to latest commit refactor: Serialize iceberg table inside engine options to reduce catalog requests Dec 14, 2024
@github-actions github-actions bot added the pr-refactor this PR changes the code base without new features or bugfix label Dec 14, 2024
@Xuanwo Xuanwo added ci-cloud Build docker image for cloud test and removed ci-cloud Build docker image for cloud test labels Dec 14, 2024
@Xuanwo
Remove not needed deps
3512a8c 
Signed-off-by: Xuanwo <github@xuanwo.io>
@github-actions GitHub Actions
Copy link
Contributor

Docker Image for PR

  • tag: pr-17049-9c956a7-1734174108

note: this image tag is only available for internal use,
please check the internal doc for more details.

@Xuanwo
Fix iceberg
1a67d4d 
Signed-off-by: Xuanwo <github@xuanwo.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ci-cloud Build docker image for cloud test pr-feature this PR introduces a new feature to the codebase pr-refactor this PR changes the code base without new features or bugfix
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Xuanwo