-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
module 'numcodecs' has no attribute 'Shuffle' #195
Comments
This runs with no error on my intel laptop or on a Qhub/aws instance, so I suspect you are right that it's a |
It may be that the cython/build step failed for M1? What version of numcodecs do you have, and how was it installed? What does |
Thanks for the reply!
I think I installed things like this (in a Python 3.10 conda environment): pip install kerchunk
conda install h5py zarr s3fs |
OK, so numcodecs will have been installed by the first line, since kerchunk has it as an explicit dependency. Looking at https://pypi.org/project/numcodecs/#files , py310 only has an x86 build for mac, so I suppose your system attempted a compile and skipped anythign that failed. You should report this on the numcodecs repo; however checking https://anaconda.org/conda-forge/numcodecs/files , you can conda-install numcodecs using channel conda-forge and expect things to work. |
What was your numcodecs version? It may be that the lack of a wheel on pypi meant you got an old version without Shuffle. |
Ah, numcodecs seems to be v0.7.3. I found that the version of numcodes in conda-forge worked though. I created my environment like this:
This installs numcodecs version 0.10.0. Then my program above prints out the JSON as expected. |
OK, I'll close this then, but feel free to request the arm/mac wheel at numcodecs. |
Sorry I know this is closed, but just for posterity - I should have made it a bit clearer that before running the above commands to create my environment, I had to add conda-forge to my channels:
If this isn't done, then numcodes version 0.7.3 will be pulled in as a dependency of zarr. |
Or the following also works, if you don't want to permanently set conda-forge as the default channel in your ~/.condarc:
|
Sounds like we should make a kerchunk conda-forge release :) |
I'm a newbie here, so apologies if I'm missing something obvious! I'm trying to read a NetCDF4 file over http(s) and am getting the error message "
module 'numcodecs' has no attribute 'Shuffle'
". This has happened with a range of files.I've done quite a lot of googling about this error but haven't found a solution (or at least, not one that I understood!) Perhaps this is the closest discussion: zarr-developers/numcodecs#260.
I'm not sure if this is an issue in
kerchunk.hdf
or whether it's deeper innumcodecs
. In case it helps, I'm on an M1 Mac - sometimes this causes issues because there's a missing binary (ARM) dependency somewhere in the tree.Here's some code that reproduces the error on my system. I'm using one of the free NetCDF4 files provided by Unidata as the example:
Traceback:
The text was updated successfully, but these errors were encountered: