Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(format): implement format trait #5167

Merged
merged 18 commits into from
May 8, 2022

Conversation

zhang2014
Copy link
Member

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

Summary about this PR

Changelog

  • Improvement

Related Issues

Fixes #issue

@vercel
Copy link

vercel bot commented May 5, 2022

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Updated
databend ⬜️ Ignored (Inspect) May 8, 2022 at 0:01AM (UTC)

@mergify
Copy link
Contributor

mergify bot commented May 5, 2022

Thanks for the contribution!
I have applied any labels matching special text in your PR Changelog.

Please review the labels and make any necessary changes.

@zhang2014 zhang2014 changed the title feat(format): add sequential format feat(format): implement format trait May 5, 2022
zhang2014 added 8 commits May 6, 2022 00:02
# Conflicts:
#	common/datavalues/src/types/deserializations/boolean.rs
#	common/datavalues/src/types/deserializations/date.rs
#	common/datavalues/src/types/deserializations/mod.rs
#	common/datavalues/src/types/deserializations/number.rs
#	common/datavalues/src/types/deserializations/string.rs
#	common/datavalues/src/types/deserializations/timestamp.rs
#	common/datavalues/src/types/deserializations/variant.rs
@zhang2014
Copy link
Member Author

zhang2014 commented May 7, 2022

After this PR, the load CSV will be a streaming read. This will avoid OOM in parse input. cc:@wubx

Parquet and JSON input formats will be implemented in the next pr.

@zhang2014 zhang2014 marked this pull request as ready for review May 7, 2022 10:58
@zhang2014 zhang2014 requested a review from BohuTANG as a code owner May 7, 2022 10:58
@zhang2014 zhang2014 requested a review from sundy-li May 7, 2022 10:58
@zhang2014 zhang2014 marked this pull request as draft May 7, 2022 14:56
@zhang2014 zhang2014 marked this pull request as ready for review May 8, 2022 05:15
@zhang2014 zhang2014 requested a review from sundy-li May 8, 2022 05:15
@BohuTANG BohuTANG removed their request for review May 8, 2022 05:35
@BohuTANG BohuTANG requested a review from sundy-li May 8, 2022 10:18
@BohuTANG
Copy link
Member

BohuTANG commented May 8, 2022

Oops, this PR is broken after #5233 merged

@BohuTANG
Copy link
Member

BohuTANG commented May 8, 2022

@mergify update

@mergify
Copy link
Contributor

mergify bot commented May 8, 2022

update

☑️ Nothing to do

  • -closed [:pushpin: update requirement]
  • #commits-behind>0 [:pushpin: update requirement]

@BohuTANG BohuTANG merged commit 2bd575e into databendlabs:main May 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants