Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade datafusion to 22 which brings arrow upgrades with it #1249

Merged
merged 12 commits into from
Apr 14, 2023

Conversation

rtyler
Copy link
Member

@rtyler rtyler commented Mar 27, 2023

Both @roeap and I have upgraded to datafusion 22 and arrow 36 in this pull request. We're not yet ready to adopt arrow 37 unfortunately

@rtyler
Copy link
Member Author

rtyler commented Mar 29, 2023

The deprecation of Decoder is going to present some problems. I think I have found a bug in the new RawReaderBuilder and how it might handle the schema of checkpoint files upstream. Trying to give them a reproduction case 🥺

@rtyler rtyler force-pushed the datafusion-upgrade branch 2 times, most recently from 3bd0adb to a6d52d1 Compare March 31, 2023 04:25
rtyler added a commit to rtyler/delta-rs that referenced this pull request Apr 5, 2023
The object_store 0.5.6 release introduces some deprecation warnings which are
addressed in delta-io#1249
@rtyler rtyler changed the title Upgrade datafusion to 21 which brings arrow upgrades with it Upgrade datafusion to 22 which brings arrow upgrades with it Apr 8, 2023
@rtyler rtyler force-pushed the datafusion-upgrade branch 2 times, most recently from c032acc to 4a93eca Compare April 9, 2023 19:53
@rtyler rtyler marked this pull request as ready for review April 14, 2023 07:11
@rtyler rtyler requested a review from mosyp as a code owner April 14, 2023 07:11
@github-actions github-actions bot added the binding/python Issues for the Python package label Apr 14, 2023
@roeap roeap linked an issue Apr 14, 2023 that may be closed by this pull request
@rtyler rtyler enabled auto-merge (rebase) April 14, 2023 15:12
Copy link
Collaborator

@wjones127 wjones127 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

auto-merge was automatically disabled April 14, 2023 16:11

Rebase failed

@wjones127 wjones127 merged commit 449fe5f into main Apr 14, 2023
@wjones127 wjones127 deleted the datafusion-upgrade branch April 14, 2023 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/python Issues for the Python package binding/rust Issues for the Rust crate rust
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Upgrade to datafusion 22
3 participants