Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: remove layer_removal_cs #5108

Merged
merged 44 commits into from
Nov 28, 2023
Merged

fix: remove layer_removal_cs #5108

merged 44 commits into from
Nov 28, 2023

Conversation

koivunej
Copy link
Member

@koivunej koivunej commented Aug 25, 2023

Quest: #4745. Follow-up to #4938.

@koivunej koivunej requested review from a team as code owners August 25, 2023 11:26
@koivunej koivunej requested review from fprasx and skyzh and removed request for a team August 25, 2023 11:26
@github-actions
Copy link

github-actions bot commented Aug 25, 2023

2394 tests run: 2300 passed, 0 failed, 94 skipped (full report)


Flaky tests (3)

Postgres 16

  • test_emergency_relocate_with_branches_slow_replay[mock_s3]: debug

Postgres 15

  • test_crafted_wal_end[last_wal_record_crossing_segment]: release
  • test_gc_cutoff: debug

Code coverage (full report)

  • functions: 54.4% (9152 of 16838 functions)
  • lines: 82.0% (53319 of 65014 lines)

The comment gets automatically updated with the latest test results
9d02ac4 at 2023-11-28T15:56:47.253Z :recycle:

@koivunej koivunej force-pushed the remove_remote_layer_ongoing branch from ac3e08a to 53eacac Compare August 28, 2023 10:47
@koivunej koivunej force-pushed the remove_remote_layer_ongoing branch 2 times, most recently from 3215f39 to 38f556a Compare September 4, 2023 09:19
@koivunej koivunej force-pushed the remove_remote_layer_ongoing branch 2 times, most recently from 0820b61 to 5fd7d84 Compare October 25, 2023 21:28
Base automatically changed from remove_remote_layer_ongoing to main October 26, 2023 09:36
@koivunej koivunej force-pushed the post_remove_remote_layer_ongoing branch from a94b446 to e267607 Compare October 26, 2023 15:05
@koivunej koivunej requested review from jcsp and problame and removed request for fprasx and skyzh October 26, 2023 15:09
@koivunej koivunej force-pushed the post_remove_remote_layer_ongoing branch 2 times, most recently from 722411a to db75a29 Compare November 6, 2023 15:38
@koivunej
Copy link
Member Author

koivunej commented Nov 7, 2023

After fixing the RemoteTimelineClient at least hastily, the scrubber seems to cause errors for any unlinked file?

@koivunej koivunej force-pushed the post_remove_remote_layer_ongoing branch 3 times, most recently from 966d4fb to cb67e18 Compare November 10, 2023 14:48
@koivunej koivunej changed the title refactor: remove layer_removal_cs fix: remove layer_removal_cs Nov 10, 2023
@koivunej koivunej force-pushed the post_remove_remote_layer_ongoing branch from ef5aec4 to 512ba3e Compare November 28, 2023 12:57
@koivunej koivunej force-pushed the post_remove_remote_layer_ongoing branch from 512ba3e to 9d02ac4 Compare November 28, 2023 13:38
@koivunej
Copy link
Member Author

Failures on Postgres 16

  • test_emergency_relocate_with_branches_slow_replay[mock_s3]: debug

Looks flaky but unsure why. Re-ran.

@koivunej koivunej enabled auto-merge (squash) November 28, 2023 17:15
@koivunej koivunej merged commit 105edc2 into main Nov 28, 2023
42 checks passed
@koivunej koivunej deleted the post_remove_remote_layer_ongoing branch November 28, 2023 17:15
koivunej added a commit that referenced this pull request Dec 7, 2023
Per [feedback], split the Layer metrics, also finally account for lost
and [re-submitted feedback] on `layer_gc` by renaming it to
`layer_delete`, `Layer::garbage_collect_on_drop` renamed to
`Layer::delete_on_drop`. References to "gc" dropped from metric names
and elsewhere.

Also fixes how the cancellations were tracked: there was one rare
counter. Now there is a top level metric for cancelled inits, and the
rare "download failed but failed to communicate" counter is kept.

Fixes: #6027

[feedback]: #5809 (review)
[re-submitted feedback]: #5108 (comment)
koivunej added a commit that referenced this pull request Dec 13, 2023
We no longer have `layer_removal_cs` since #5108, we no longer need
batching.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants