Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improve chunk handling #28

Open
chrishavlin opened this issue Feb 1, 2023 · 1 comment
Open

improve chunk handling #28

chrishavlin opened this issue Feb 1, 2023 · 1 comment
Labels
enhancement New feature or request
Milestone

Comments

@chrishavlin
Copy link
Collaborator

chrishavlin commented Feb 1, 2023

yt_xarray currently loads in data on a single yt grid. For uniform grids, it should be straightforward to chunk it as well as align the yt grids with any existing xarray chunks (e.g., when xarray is using a dask backend) (NOTE: This is done). Stretched grids however, might need some upstream changes in yt.

@chrishavlin chrishavlin added the enhancement New feature or request label Feb 1, 2023
@chrishavlin chrishavlin added this to the v0.2.0 milestone Feb 1, 2023
@chrishavlin
Copy link
Collaborator Author

#30 addresses part of this: chunking for uniform grids. It works with dask arrays!

To close this issue for the v0.2.0 release, just need to add the option to auto-align the dask and yt chunks.

Future releases could add the functionality for stretched grids, but some work upstream in yt may be necessary for that.

@chrishavlin chrishavlin changed the title handle chunking improve chunk handling Feb 7, 2023
@chrishavlin chrishavlin modified the milestones: v0.2.0, v0.3.0 Oct 10, 2023
@chrishavlin chrishavlin modified the milestones: v0.3.0, v0.4.0 May 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant