Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] use_arrow_dtype doesn't work when read a directory path for read_parquet #2697

Closed
hekaisheng opened this issue Feb 10, 2022 · 0 comments · Fixed by #2698
Closed

[BUG] use_arrow_dtype doesn't work when read a directory path for read_parquet #2697

hekaisheng opened this issue Feb 10, 2022 · 0 comments · Fixed by #2698
Labels
mod: dataframe type: bug Something isn't working
Milestone

Comments

@hekaisheng
Copy link
Contributor

Describe the bug
use_arrow_dtype doesn't work when read a directory path for read_parquet

To Reproduce

In [26]: df = md.read_parquet(tempdir, use_arrow_dtype=True)

In [27]: df.dtypes
Out[27]: 
a      int64
b     object
c    float64
dtype: object

Expected dtypes should be:

In [14]: df.dtypes
Out[14]: 
a            int64
b    Arrow[string]
c          float64
dtype: object

Expected behavior
A clear and concise description of what you expected to happen.

Additional context
Add any other context about the problem here.

@hekaisheng hekaisheng added type: bug Something isn't working mod: dataframe to be backported Indicate that the PR need to be backported to stable branch labels Feb 10, 2022
@hekaisheng hekaisheng added this to the v0.9.0b1 milestone Feb 10, 2022
@hekaisheng hekaisheng removed the to be backported Indicate that the PR need to be backported to stable branch label Feb 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mod: dataframe type: bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant