-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Separate file metastore column serialization from internals #18309
Separate file metastore column serialization from internals #18309
Conversation
Ideally the whole file metastore domain model could be seaprate. |
Is it possible to generate data for file based metastore and add it to the tests to make sure it can read old data? Then when changing the internals we could have backward compability tests. WDYT? |
Why do this just for columns? If we want this, we can remove the serialization for the old class. |
import static java.util.Objects.requireNonNull; | ||
|
||
@Immutable | ||
public class Column |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should be able to make this a record. Also, we don’t need to use explicit names for JSON serialization in new code.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would rather not refactor this class, since we have no tests for the file metastore. I don't want to change serialization state inadvertently. From my perspective, this isn't new code.
good question
good point, thanks! |
eae70c3
to
abb3799
Compare
it appears used elsewhere ( |
Introduce separate column class representing column serialized in file metastore.
abb3799
to
6376631
Compare
@electrum please take another look |
replaced with #18343 |
Introduce separate column class representing column serialized in file metastore.