Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Add support for geometry type #2032

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

[WIP] Add support for geometry type #2032

wants to merge 2 commits into from

Conversation

ffacs
Copy link
Contributor

@ffacs ffacs commented Sep 22, 2024

What changes were proposed in this pull request?

POC of geometry type supporting

Why are the changes needed?

Add support for geometry type

How was this patch tested?

UT passed

Was this patch authored or co-authored using generative AI tooling?

NO

@dongjoon-hyun dongjoon-hyun marked this pull request as draft September 22, 2024 21:31
@ffacs
Copy link
Contributor Author

ffacs commented Sep 23, 2024

cc @wgtmac @dongjoon-hyun

@wgtmac
Copy link
Member

wgtmac commented Sep 24, 2024

Thanks for implementing this! I will hold my review until the spec has been finalized.

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Sep 25, 2024

Thank you, @ffacs .

To @wgtmac , do you mean the ORC format PR? Or, Iceberg document? Otherwise, could you provide some pointers to track this part, the spec has been finalized?

Thanks for implementing this! I will hold my review until the spec has been finalized.

@@ -76,7 +76,7 @@
<maven.version>3.9.6</maven.version>

<mockito.version>5.10.0</mockito.version>
<orc-format.version>1.0.0</orc-format.version>
<orc-format.version>1.0.0-SNAPSHOT</orc-format.version>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

? AFAIK, we didn't change anything relevant until now, do we need -SNAPSHOT?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the review. The spec of geometry type haven't been merged into orc format yet, so I created a private package for developing here. Maybe it's a little bit early for code reviewing, let's waiting for the spec finished first.

@@ -85,6 +85,7 @@
<surefire.version>3.0.0-M5</surefire.version>
<test.tmp.dir>${project.build.directory}/testing-tmp</test.tmp.dir>
<zstd-jni.version>1.5.6-4</zstd-jni.version>
<jts.version>1.19.0</jts.version>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems to be too old because it's released on Jun 21, 2022.

Why don't we use the latest one? Is there any incompatibility issue with something?

@dongjoon-hyun dongjoon-hyun added this to the 2.1.0 milestone Sep 25, 2024
@wgtmac
Copy link
Member

wgtmac commented Sep 25, 2024

apache/parquet-format#240 is still under review and subject to change. I think we can wait until it has been finalized. @dongjoon-hyun

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Sep 25, 2024

Ya, I want to check ETA for this work. Do you think we can have this for Apache ORC 2.1?

@wgtmac
Copy link
Member

wgtmac commented Sep 25, 2024

If 2.1.0 will be released around January 17, 2025, then I think yes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants