Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 Destination Connector - Support JSON format #4153

Closed
panhavad opened this issue Jun 16, 2021 · 6 comments
Closed

S3 Destination Connector - Support JSON format #4153

panhavad opened this issue Jun 16, 2021 · 6 comments

Comments

@panhavad
Copy link
Contributor

Tell us about the problem you're trying to solve

Currently, the S3 Destination supports only CSV and Parquet format. It would be great to output direct as a JSON format.

Describe the solution you’d like

Users will be able to destinate using S3 Destination Connector that supports JSON output as a JSON file.

Describe the alternative you’ve considered or used

Additional context

Are you willing to submit a PR?

Yes, I would like to contribute to this feature. If the team could put it in the roadmap.

@panhavad panhavad added the type/enhancement New feature or request label Jun 16, 2021
@panhavad
Copy link
Contributor Author

panhavad commented Jun 16, 2021

Will you accept the contribution for this, I will start working on this as soon as you guys okay with it 🎉 @marcosmarxm @davinchia

@davinchia
Copy link
Contributor

I will defer to @tuliren who has more context on this

@tuliren
Copy link
Contributor

tuliren commented Jun 16, 2021

Hi @panhavad, yes, we are going to support JSONL output on S3 destination very soon, probably this week.

@panhavad
Copy link
Contributor Author

panhavad commented Jun 16, 2021

That's nice so you working on this feature right?. Anything for me to keep track progress of the update on this JSON support (issue link)?

@tuliren
Copy link
Contributor

tuliren commented Jun 17, 2021

Anything for me to keep track progress of the update on this JSON support (issue link)?

Well, this is the issue for this topic. I will update this issue when the PR is out.

@tuliren
Copy link
Contributor

tuliren commented Jun 23, 2021

@panhavad JSONL support has been merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants