Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎨 Add figure showing xbatcher's features for slicing n-dim arrays #8

Merged
merged 1 commit into from
Oct 15, 2023

Conversation

weiji14
Copy link
Owner

@weiji14 weiji14 commented Oct 15, 2023

Illustration of xbatcher's features of slicing multi-dimensional arrays on-the-fly with named variables.

xbatcher n-dimensional slicing

This is useful for e.g. time-series or multi-variate oceanography / climate model outputs. Diagram on the left shows how a datacube is sliced, and code block on the right shows how regular slicing code compares to xbatcher.

At the bottom, more features are mentioned such as lazy loading, xarray acessors, and the experiment cache mechanism. Also mentioned upcoming roadmap like shuffling/sampling utilities and async loading of batches.

References:

Illustration of xbatcher's features of slicing multi-dimensional arrays on-the-fly with named variables, useful for e.g. time-series or multi-variate oceanography / climate model outputs. Diagram on the left shows how a datacube is sliced, and code block on the right shows how regular slicing code compares to xbatcher.

At the bottom, more features are mentioned such as lazy loading, xarray acessors, and the experiment cache mechanism. Also mentioned upcoming roadmap like shuffling/sampling utilities and async loading of batches.
@weiji14 weiji14 self-assigned this Oct 15, 2023
@weiji14 weiji14 merged commit de7fd79 into main Oct 15, 2023
1 check passed
@weiji14 weiji14 deleted the fig/xbatcher_ndim_slicing branch October 15, 2023 11:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant