Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Connector-v2] Support S3 filesystem of paimon connector #8036

Merged
merged 1 commit into from
Nov 14, 2024

Conversation

dailai
Copy link
Contributor

@dailai dailai commented Nov 13, 2024

Purpose of this pull request

Link pr #8002

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

@dailai
Copy link
Contributor Author

dailai commented Nov 13, 2024

Write to paimon with s3:

截屏2024-11-13 09 25 08 截屏2024-11-13 09 25 20

Read from paimon with s3:

image
image

@dailai dailai force-pushed the dev-support-s3-paimon branch from 1bb84ac to 3d0e231 Compare November 13, 2024 01:27
@github-actions github-actions bot removed the e2e label Nov 13, 2024
@dailai dailai force-pushed the dev-support-s3-paimon branch from 3d0e231 to 201971a Compare November 13, 2024 01:35
Copy link
Contributor

@hawk9821 hawk9821 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dailai . please add E2E test case run locally, similar to the hadoop test sample

@dailai dailai force-pushed the dev-support-s3-paimon branch from 201971a to 22114f9 Compare November 14, 2024 01:59
@github-actions github-actions bot added the e2e label Nov 14, 2024
@dailai dailai force-pushed the dev-support-s3-paimon branch from 22114f9 to f5beed9 Compare November 14, 2024 02:20
@dailai dailai force-pushed the dev-support-s3-paimon branch from f5beed9 to 8b24ae1 Compare November 14, 2024 02:24
@dailai
Copy link
Contributor Author

dailai commented Nov 14, 2024

Details

I have already added the e2e case which is write and read from paimon with s3 filesystem.

Copy link
Contributor

@hawk9821 hawk9821 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dailai LGTM

@hailin0 hailin0 merged commit e2a4772 into apache:dev Nov 14, 2024
7 checks passed
@dailai dailai deleted the dev-support-s3-paimon branch November 28, 2024 03:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants