Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added zarr.zip merged data format #185

Merged
merged 5 commits into from
Aug 16, 2024

Conversation

brendan-m-murphy
Copy link
Contributor

@brendan-m-murphy brendan-m-murphy commented Jul 30, 2024

  • Summary of changes

Added option to use a zarr ZipStore (essentially just a zarr store zipped into a single file).

This will reduce the number of files created when saving merged data.

  • Please check if the PR fulfills these requirements

Tests pass. Needed to rework a filter to
get the tests to pass, possibly because
previously, merged data wasn't loaded as
a dask array.
@brendan-m-murphy brendan-m-murphy marked this pull request as ready for review July 30, 2024 12:18
@brendan-m-murphy brendan-m-murphy merged commit 373b56a into devel Aug 16, 2024
1 of 3 checks passed
@brendan-m-murphy brendan-m-murphy deleted the Iss184-merged-data-creates-many-files branch August 16, 2024 14:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Saving merged data makes a lot of files
1 participant