Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enable hourly log ship mode #1025

Merged
merged 44 commits into from
Sep 26, 2024
Merged

enable hourly log ship mode #1025

merged 44 commits into from
Sep 26, 2024

Conversation

FxKu
Copy link
Member

@FxKu FxKu commented Sep 11, 2024

The idea is to check in configure_spilo script if the provided schedule contains a / in the second position of the cron schedule. We then set an environment variable to be used in other places to decide on the log file names and Postgre's log_rotation_age.

Open questions:

  • does it actually work? Especially the post_init part. Still need to test. works. Test added
  • is there a better way than using an extra env variable? Env var is fine. It's actually easier to just set a flag.
  • more flexibility on different log rotations? For now we decided to only distinguish between daily and hourly.

Disclaimer: If somebody switches from daily to hourly format between 1am - 12pm one will have a gap of logs on S3.

@FxKu FxKu added the minor label Sep 11, 2024
Co-authored-by: Polina Bungina <27892524+hughcapet@users.noreply.github.com>
FxKu and others added 2 commits September 16, 2024 16:01
Co-authored-by: Polina Bungina <27892524+hughcapet@users.noreply.github.com>
Co-authored-by: Polina Bungina <27892524+hughcapet@users.noreply.github.com>
@hughcapet
Copy link
Member

👍

1 similar comment
@idanovinda
Copy link
Member

👍

@hughcapet hughcapet merged commit efd6eb4 into zalando:master Sep 26, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants