Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: In-built functions/API or utility to handle avro files #45614

Closed
KayvanShah1 opened this issue Jan 25, 2022 · 3 comments
Closed

ENH: In-built functions/API or utility to handle avro files #45614

KayvanShah1 opened this issue Jan 25, 2022 · 3 comments
Labels
Enhancement IO Data IO issues that don't fit into a more specific label

Comments

@KayvanShah1
Copy link

Is your feature request related to a problem?

It would be great if pandas has inbuilt capabilities to handle - read, write, update, manipulate Avro files

Describe the solution you'd like

read_avro() and to_avro() functions

Describe alternatives you've considered

There are two installable libraries for working with Avro files:
avro & fastavro

Additional context

@KayvanShah1 KayvanShah1 added Enhancement Needs Triage Issue that has not been reviewed by a pandas team member labels Jan 25, 2022
@jreback
Copy link
Contributor

jreback commented Jan 25, 2022

this was asked in #11752

if a fully baked and tested PR was proposed would not object

@lithomas1 lithomas1 added IO Data IO issues that don't fit into a more specific label and removed Needs Triage Issue that has not been reviewed by a pandas team member labels Jan 27, 2022
@jorisvandenbossche
Copy link
Member

Some relevant discussion about this on the fastavro side: fastavro/fastavro#112

To be honest, I think this should be rather implemented as a third-party package first, and if that exists, we can still consider whether we want to optionally depend on that and wrap it in a to_avro/read_avro

@mroeschke
Copy link
Member

Thanks for the request. We have this logged in our master IO tracker #30407, and agreed utilizing a 3rd party parser would be idea. Closing as in our master tracker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement IO Data IO issues that don't fit into a more specific label
Projects
None yet
Development

No branches or pull requests

5 participants