Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Partitions and chain layout #134

Open
tsloughter opened this issue Feb 9, 2018 · 2 comments
Open

Partitions and chain layout #134

tsloughter opened this issue Feb 9, 2018 · 2 comments

Comments

@tsloughter
Copy link
Collaborator

Currently partitions are basically not used. Everything is hard-coded to only have 1 partition, 0.

With the way topics are laid out across chains through sorting it occurred to me there is no good way to support partitions as simply suffixes on the topic, since they would all be bunched together on the same chain.

Is there a way to support partitions in such a way that they will be spread apart? If not, we likely should make partitions confined to the kafka protocol and remove all other current usage.

@evanmcc
Copy link
Contributor

evanmcc commented Feb 9, 2018

given that partitions are largely for read throughput, and we have other ways of spreading read load, I would prefer that we just relegate them to an ignored protocol detail like you say at the end there.

@tsloughter
Copy link
Collaborator Author

I thought they were mostly for write throughput, hehe.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants