Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add convertToDelta command #1041

Closed
MrPowers opened this issue Dec 24, 2022 · 5 comments · Fixed by #1686
Closed

Add convertToDelta command #1041

MrPowers opened this issue Dec 24, 2022 · 5 comments · Fixed by #1686
Assignees
@iajoiner
Labels
binding/rust Issues for the Rust crate enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@MrPowers
Copy link
Collaborator

The convertToDelta command is a good way to attract users because it makes Delta an easy switch. See this blog post for details.

The command adds a _delta_log directory to an existing Parquet data lake. It doesn't change any of the underlying data files - it's an in-place operation.

Would be a nice addition to this library 💪
@MrPowers MrPowers added the enhancement New feature or request label Dec 24, 2022
@houqp houqp added help wanted Extra attention is needed good first issue Good for newcomers binding/rust Issues for the Rust crate labels Dec 28, 2022
@iajoiner
Copy link
Contributor

iajoiner commented Jan 2, 2023 •
edited
Loading

I will do this one. Please give me a week or two.

@MrPowers
Copy link
Collaborator Author

MrPowers commented Jan 2, 2023

Awesome @iajoiner. I'll make sure to write a blog post when this gets merged in. Lots of folks will find this functionality useful.

@iajoiner
Copy link
Contributor

Sorry for the delay for I just recovered from COVID. I will do the release first and then this one.

@roeap roeap mentioned this issue Jan 25, 2023
Closed
@MrPowers
Copy link
Collaborator Author

@iajoiner - are you still planning on grabbing this one?

@rtyler
Copy link
Member

rtyler commented May 31, 2023

Huh, I just saw this ticket. I actually built this the other week which can be run as a CLI or Lambda function 🤷

@ericsun2 ericsun2 mentioned this issue Sep 29, 2023
Closed
@junjunjd junjunjd mentioned this issue Oct 1, 2023
Merged
This was referenced Oct 13, 2023
Closed
Open
Open
Open
@junjunjd junjunjd mentioned this issue Nov 9, 2023
Open
roeap pushed a commit that referenced this issue Nov 12, 2023
@junjunjd
feat: add convert_to_delta (#1686)
1368a78 
# Description
Add a convert_to_delta operation for converting a Parquet table to a
Delta Table in place.

# Related Issue(s)
- closes #1041
- closes #1682
<!---
For example:

- closes #106
--->

# Documentation

<!---
Share links to useful documentation
--->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iajoiner iajoiner

Labels
binding/rust Issues for the Rust crate enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: add convert_to_delta junjunjd/delta-rs
4 participants
@rtyler @houqp @MrPowers @iajoiner