-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support JUnit TestNG engine #296
Conversation
.filter(test -> testFrameworkStrategy.isExpectedUnretriedTest(entry.getKey(), test)) | ||
.collect(Collectors.toSet()) | ||
)); | ||
expectedUnretriedTests.forEach((className, tests) -> previousRoundFailedTests.remove(className, tests::contains)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💬 Ideally, we would also report failed descriptors as successful, but at this point, we have no clue where in the hierarchy they belong or how to construct a valid descriptor.
With all of the issues with the TestNG reporting, it seems like putting lipstick on a pig. So, I suggest not to bother and just make sure that retries work correctly.
8c6e2aa
to
0e804e3
Compare
0e804e3
to
5f18200
Compare
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
Signed-off-by: Pavlo Shevchenko <pshevchenko@gradle.com>
5f18200
to
f2ce44e
Compare
@@ -205,7 +244,7 @@ class TestNGFuncTest extends AbstractFrameworkFuncTest { | |||
|
|||
public class OrderedTests { | |||
@Test(dependsOnMethods = {"childTest"}) | |||
public void grandchildTest() {} | |||
public void grandChildTest() {} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Afaik grandchild is a single word, so the case could be made to leave the casing as-is
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Agree, it is hard to make assertions, though, because childTest
matches both the childTest
and the grandchildTest
.
Summary
SAP reports a number of issues when TestNG run with JUnit TestNG Engine are retried:
This PR addresses the first two and I manually verified that the fix also resolves Build Scan publication errors. The plan forward is to release a Develocity plugin RC with this fix and validate with the customer if all of the issues are resolved.