Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Support AWS Glue Catalog for Apache Iceberg #16793

Closed
Rowlandev opened this issue Nov 7, 2024 · 3 comments
Closed

Feature: Support AWS Glue Catalog for Apache Iceberg #16793

Rowlandev opened this issue Nov 7, 2024 · 3 comments
Labels
C-feature Category: feature

Comments

@Rowlandev
Copy link
Contributor

Rowlandev commented Nov 7, 2024

Databend currently supports rest and hms when creating an Apache Iceberg catalog. However, it's not supported for AWS Glue.

My proposition is to enable a query like the following, or somethings similar for users using Glue:

CREATE CATALOG analytics_testing
TYPE = ICEBERG
CONNECTION = (
	DATABASE = '<glue database name as it is in s3>'
        ROLE_ARN = '<iam role to assume>'
	REGION = '<region; go us-east-1>'
);

SHOW CREATE CATALOG analytics_testing;

Until this is implemented, users are given the following error:

iceberg catalog with type glue is not supported
@Rowlandev Rowlandev added the C-feature Category: feature label Nov 7, 2024
@sundy-li
Copy link
Member

sundy-li commented Nov 8, 2024

Maybe we should implement it in iceberg-rs and cc @Xuanwo.

@Xuanwo
Copy link
Member

Xuanwo commented Nov 8, 2024

Already supported in https://github.com/apache/iceberg-rust/blob/main/crates/catalog/glue/README.md.

We need to integrate it inside databend.

@Rowlandev
Copy link
Contributor Author

This has been included in Databend with this pull request.

Thanks to @Xuanwo, @BohuTANG, @drmingdrmer & @sundy-li for the help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-feature Category: feature
Projects
None yet
Development

No branches or pull requests

3 participants