Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests(python): account for version-based issue with pyarrow datetime units in tests #11052

Merged
merged 3 commits into from
Sep 11, 2023

Conversation

alexander-beedie
Copy link
Collaborator

@alexander-beedie alexander-beedie commented Sep 11, 2023

Latest deltalake pinned pyarrow at < 13, causing some unit test failures on package update (as we had previously updated the test to handle the changes in 13 and got unexpectedly reverted back to 12 by their pin).

@github-actions github-actions bot added the internal An internal refactor or improvement label Sep 11, 2023
@alexander-beedie
Copy link
Collaborator Author

One down, a bunch of is_sparse warnings to go... ;p

@stinodego
Copy link
Member

stinodego commented Sep 11, 2023

Why not just pin deltalake to 0.10.1 for now? We want to run our tests with the latest pyarrow version. I'd say that's way more important than having the latest patch version of deltalake.

@alexander-beedie
Copy link
Collaborator Author

alexander-beedie commented Sep 11, 2023

Why not just pin deltalake to 0.10.1 for now? We want to run our tests with the latest pyarrow version. I'd say that's way more important than having the latest patch version of deltalake.

Yup, I'm thinking the same now - just found the relevant issue on their repo: delta-io/delta-rs#1602.
We can unpin once this is closed and the next/compatible version is released.
(I'll keep these other fixes in place though).

@ritchie46 ritchie46 merged commit 1ffa54d into pola-rs:main Sep 11, 2023
12 checks passed
@alexander-beedie alexander-beedie deleted the fix-unit-tests branch September 11, 2023 18:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
internal An internal refactor or improvement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants