Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(rust,python): checkpoint with column nullable false #2680

Merged
merged 4 commits into from
Jul 18, 2024

Conversation

sherlockbeard
Copy link
Contributor

@sherlockbeard sherlockbeard commented Jul 17, 2024

Description

when creating min , max schema make sure the nullable is true

Related Issue(s)

closes #2675

Documentation

@github-actions github-actions bot added binding/python Issues for the Python package binding/rust Issues for the Rust crate labels Jul 17, 2024
@rtyler rtyler self-assigned this Jul 17, 2024
@rtyler
Copy link
Member

rtyler commented Jul 17, 2024

Thanks for the pull request! I was trying out this patch and couldn't get the tests to fail, how were you running/validating the python tests for the Rust changes?

@sherlockbeard
Copy link
Contributor Author

sherlockbeard commented Jul 17, 2024

I was trying out this patch and couldn't get the tests to fail, how were you running/validating the python tests for the Rust changes?

you can trigger this new test on main tests/test_checkpoint.py::test_checkpoint_with_nullable_false
it's failing for me without the schema fix .

FAILED tests/test_checkpoint.py::test_checkpoint_with_nullable_false - Exception: Json error: whilst decoding field 'add': whilst decoding field 'stats_parsed': whilst decoding field 'minValues'...

ion-elgreco
ion-elgreco previously approved these changes Jul 17, 2024
@ion-elgreco ion-elgreco changed the title feat(rust,python): fix checkpoint with column nullable false fix(rust,python): checkpoint with column nullable false Jul 17, 2024
@rtyler rtyler merged commit 64bca17 into delta-io:main Jul 18, 2024
21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/python Issues for the Python package binding/rust Issues for the Rust crate
Projects
None yet
3 participants