This repository has been archived by the owner on Apr 26, 2024. It is now read-only.
-
-
Notifications
You must be signed in to change notification settings - Fork 2.1k
Some minor performance fixes for task schedular #16313
Merged
Merged
Changes from 1 commit
Commits
Show all changes
13 commits
Select commit
Hold shift + click to select a range
3a76eb4
Only pull out old tasks
erikjohnston adccd7a
Add index to 'timestamp'
erikjohnston 9080102
Limit number of tasks we fetch
erikjohnston a0c02ad
Fast path when we're at capacity
erikjohnston f7b28da
Split launch and cleanup tasks
erikjohnston f3a576a
Try launching a new task immediately when a task finishes
erikjohnston 1976def
Make replication handling more efficient
erikjohnston 7f485e2
Prefix background process desc
erikjohnston f677fca
Newsfile
erikjohnston 2283b3f
Make sure we only have one concurrent `_launch_scheduled_tasks` at a …
erikjohnston 1b93783
Use a LaterGauge
erikjohnston 3696c05
Lint
erikjohnston 7f801bc
LINT
erikjohnston File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I also separated in 2 like you did at some point, but I was not sure that no races exist between the 2 so I ended up removing it.
After more thinking I think we should be safe, we are iterating on 2 disjoint set of tasks (active+schedule vs failed+complete) and I don't see any trouble if an active task becomes complete or failed in the middle.