Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

Document how to calculate the minimum kafka retention / replay offset #1597

Closed
replay opened this issue Jan 10, 2020 · 2 comments
Closed

Document how to calculate the minimum kafka retention / replay offset #1597

replay opened this issue Jan 10, 2020 · 2 comments
Labels

Comments

@replay
Copy link
Contributor

replay commented Jan 10, 2020

There are a lot of factors which need to be considered when calculating the minimum offset to replay on startup. We should document them somewhere, because it's really easy to forget about one.

  • Time window for restarts due to maintenance
  • Max chunk span
  • Chunk stale time
  • GC Interval
  • Reorder buffer duration

Did I forget one?

@Dieterbe
Copy link
Contributor

the two places that I know of where we describe this are:

I agree. a dedicated place in the docs to explain this, would be nice.

@stale
Copy link

stale bot commented Apr 9, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale label Apr 9, 2020
@stale stale bot closed this as completed Apr 17, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants