Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow adding a specific field in nested field in iceberg connector #16248

Closed
ebyhr opened this issue Feb 23, 2023 · 2 comments · Fixed by #16321
Closed

Allow adding a specific field in nested field in iceberg connector #16248

ebyhr opened this issue Feb 23, 2023 · 2 comments · Fixed by #16321
Assignees
Labels
enhancement New feature or request iceberg Iceberg connector

Comments

@ebyhr
Copy link
Member

ebyhr commented Feb 23, 2023

We're going to support for dropping nested fields in #15975. It would be nice to support adding nested fields as well.

@grantatspothero
Copy link
Contributor

grantatspothero commented Mar 17, 2023

@ebyhr (or whoever picks this up): IMO adding fields to nested data types is more important than dropping fields of nested data types. But supporting both is of course better 😄

Dropping fields is a backwards incompatible change while adding fields is a backwards compatible change. A workaround for not supporting dropping nested fields is just setting the field as null. There is no workaround for not supporting adding nested fields.

@erichwang
Copy link
Contributor

erichwang commented Mar 31, 2023

Any progress on this? This is actually really important since modifying complex structures is actually a common operation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request iceberg Iceberg connector
Development

Successfully merging a pull request may close this issue.

3 participants