Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parquet writer #575

Closed
norberttech opened this issue Oct 13, 2023 · 0 comments · Fixed by #693
Closed

Parquet writer #575

norberttech opened this issue Oct 13, 2023 · 0 comments · Fixed by #693
Assignees
@norberttech
Labels
lib-parquet
Milestone
0.5.0

Comments

@norberttech
Copy link
Member

This is a continuation of #506
The goal is to build a parquet writer that:

  • supports all parquet types
  • allows appending data into an existing file
  • supports remote filesystems

This is an absolute minimum to replace the library flow is using right now. After that the next step is to work on more direct integration between Flow and Parquet in order to benefit from more advanced parquet features not available in other file formats.
@norberttech norberttech self-assigned this Oct 13, 2023
This was referenced Oct 25, 2023
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
@norberttech norberttech mentioned this issue Oct 31, 2023
Merged
@norberttech norberttech mentioned this issue Nov 2, 2023
Merged
@norberttech norberttech added this to the 0.5.0 milestone Nov 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@norberttech norberttech

Labels
lib-parquet
Projects
Roadmap
Archived in project
Milestone
0.5.0
Development

Successfully merging a pull request may close this issue.

Added library version to parquet created_by metadata norberttech/flow
1 participant
@norberttech