Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distinguish creation of new table and registering existing table operations in Delta Lake connector #13568

Closed
aksakalli opened this issue Aug 9, 2022 · 2 comments · Fixed by #14779
Assignees

Comments

@aksakalli
Copy link
Member

aksakalli commented Aug 9, 2022

I am using the Delta Lake connector for reading existing delta tables in s3 exclusively. When I run a create table statement, I expect to already have an existing transaction log for the given location before creating the table. I have to check everytime manually if the transaction log exists in order to avoid creating an erroneous transection logs in the path for dummy bigint. I think it's need to have an explicit property for creating delta table from existing logs that makes the CREATE TABLE statement fail in case there is no existing transaction log.

From the documentation:

If the specified location does not already contain a Delta table, the connector automatically writes the initial transaction log entries and registers the table in the metastore.

I don't want Trino to silently create a transaction log if I intent to create a table from existing logs.

@alexjo2144
Copy link
Member

We could add a register_table procedure that would do this

@findepi findepi changed the title Delta Lake connector creates transaction log when not intended Distinguish creation of new table and registering existing table operations in Delta Lake connector Sep 28, 2022
@krvikash
Copy link
Contributor

Started working on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging a pull request may close this issue.

3 participants