Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Honestly, I wonder if we should just get rid of this TOLERANCE and just switch any place that uses it to
EXPECT_GT
. Since we aren't dealing with real-time OSs or threads here, there is no guarantee that any of these tests come back in a reasonable amount of time; the OS could choose not to schedule this process for long periods of time.We'll lose checking if the timeout is similar to what the user asked for, but I think that is relatively low risk.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's fair, and I agree that time-sensitive tests are inherently flaky for the OSes we support, but I'll point out that validating that timeout is the sole purpose of several of these tests. We may as well drop them if we get rid of this TOLERANCE.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't feel super strongly about it. If updating the tolerance to 25ms here makes the tests less flaky, that's at least a step in the right direction.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like the sound of making a small improvement for the moment. I don't feel like I have the bandwidth to look into which tests should be dropped at the moment.