Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wip/codecs shards #135

Draft
wants to merge 128 commits into
base: master
Choose a base branch
from
Draft

Wip/codecs shards #135

wants to merge 128 commits into from

Conversation

cmhulbert
Copy link
Contributor

No description provided.

bogovicj and others added 30 commits May 21, 2024 17:12
# Conflicts:
#	src/main/java/org/janelia/saalfeldlab/n5/GsonKeyValueN5Reader.java
* DeterministicSizeCodec and Crc32cChecksumCodec
* move some functionality to ChecksumCodec
test,build: include n5-universe for tests
* edit behavior of getIndex
* this may make more sense in a more basic interface
* no need for getCompressionAsCodec
* use getType for codecs
cmhulbert and others added 30 commits January 8, 2025 16:11
* where readBlocks batches when possible
* so that we can index by position
* primitive long arrays are not great as keys for maps
* shardsPerImage, blocksPerImage
* grouping DataBlocks by shard postion
* stream of block positions ordered by shard
* methods in GridIterator replaces this
* Using Position class
* using ShardParameters.groupBlocks helper method
* use it to return early for getBlocks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants