-
Notifications
You must be signed in to change notification settings - Fork 13.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test: Reduce flaky integration tests triggered by test_get_tag
#25958
test: Reduce flaky integration tests triggered by test_get_tag
#25958
Conversation
@cccs-RyanK it seems like you might have authored the original test. Do you have any insights into why said test may be somewhat flakey? |
I believe the flakiness is caused by test execution times being variable, causing it to sometimes take longer than usual, which in turn causes the gap between the operations to extend beyond 1 second. I think |
@villebro thanks for the hint to use |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
SUMMARY
Local tests and GitHub CI runs sometimes fail because of
Examples from the last two weeks (note: the links will expire)
The test now additionally checks for
a second ago
andtwo seconds ago
as seen in the CI examples above.BEFORE/AFTER SCREENSHOTS OR ANIMATED GIF
TESTING INSTRUCTIONS
scripts/tests/run.sh --module tests/integration_tests/tags/api_tests.py::TestTagApi::test_get_tag
ADDITIONAL INFORMATION