-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ZSTD compression is not supported #90
Comments
Thanks for opening the issue. |
I am using the Parquets backend. |
Ran into this issue today as well 👍🏾.
Using arrow backend |
## [2.4.0](v2.3.5...v2.4.0) (2023-10-13) ### Features * add zstd support to arrow backend ([195a688](195a688)), closes [#90](#90) * make arrow the default backend ([547ac84](547ac84)) ### Build and continuous integration * fix conan recipe revisions ([bf15cd1](bf15cd1)) * upgrade use node 18 everywhere ([c50d64d](c50d64d))
🎉 This issue has been resolved in version 2.4.0 🎉 The release is available on: Your semantic-release bot 📦🚀 |
This is now fixed for the arrow backend. |
When trying to open the Parquet file with the arrow backend, I receive this error: |
Sorry about that. There's no free M1 VMs currently available for GitHub actions.
|
@eriviere-b the latest release has built-in support for Apple M1. |
@dvirtz for each engine:
|
Thanks for that detailed feedback @eriviere-b |
I still receive the same error: |
Just to make sure you're on version |
Thanks. Can you please tell me what is printed when you run
|
That's what expected. |
experienced the same problem today as @eriviere-b being on 2.4.2 |
I managed to reproduce this on a friend's M1 machine. The error is:
Not sure how it works on the CI machine. |
M1 should be fixed with v2.4.3. |
I have an M1, and on v2.4.3 currently (just updated and reloaded) and the issue persists:
|
Sorry for that, the fix was only integrated in v2.4.4. |
Now it works with the arrow engine. Thanks @dvirtz ! |
Currently parquet-viewer does not support ZSTD compression which is a standard compression method.
{"error":"while reading /tmp/SB17-er-ursf_gen-crawls-list.parquet: Error: invalid compression method: ZSTD"}
The text was updated successfully, but these errors were encountered: