-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove ineffective tests #2209
Remove ineffective tests #2209
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm surprised at how much cruft accumulated in the test code!
What criteria was used to determine that the tests were "ineffective"? Anything with "perf" in the name was just deemed ineffective? |
@rgoers, removed tests either were disabled long ago (causing compilation time waste) or contained no assertions (causing compilation + testing time waste). I tried saving whatever I can and removed the rest of such ineffective tests. |
@vy There were a couple of "tests" you removed that did not have any assertions that I used for occaisional sanity checks. Namely FilterPerformanceComparison, SimplePerfTest, and ThreadedPerfTest. I never found a way to assert what I wanted to check - namely that someone hadn't inserted code that seriously impacted the performance of what those are doing- SimplePerfTest primarily validates that the cost of logging is close to zero when disabled. FilterPerformanceComparison ensures we haven't added something that causes filtering to slow down - comparing it to Logback is a decent way to do that. One of the main issues is the performance varies from machine to machine so it is very tough to make assertions. Instead, I just eyeball the results based on what I expect on my machine. |
@rgoers, thanks for sharing the context, now I understand. These use cases weren't apparent to me from the code. I |
This PR either fixes or removes ineffective tests.