-
Notifications
You must be signed in to change notification settings - Fork 312
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Increase Spark.Worker.UnitTest test coverage for different Spark versions #638
Increase Spark.Worker.UnitTest test coverage for different Spark versions #638
Conversation
d6c4512
to
448c411
Compare
Looks like tests are failing? |
it seems to occur outofmemory exception when test case only 2.4.0, CI was passed. I think CI test machine memory is not enough to test all spark versions. |
Can you check which version is causing the failure? |
It was my fault. The problem was a test logic and it has been resolved in cf191ea. thank you :) |
@@ -2,6 +2,8 @@ | |||
// The .NET Foundation licenses this file to you under the MIT license. | |||
// See the LICENSE file in the project root for more information. | |||
|
|||
using System; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
clean up usings
public static IEnumerable<object[]> versionTests() | ||
{ | ||
yield return new object[] { Versions.V2_3_0 }; | ||
yield return new object[] { Versions.V2_3_1 }; | ||
yield return new object[] { Versions.V2_3_2 }; | ||
yield return new object[] { Versions.V2_3_3 }; | ||
yield return new object[] { Versions.V2_4_0 }; | ||
yield return new object[] { Versions.V3_0_0 }; | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit
public static IEnumerable<object[]> versionTests() | |
{ | |
yield return new object[] { Versions.V2_3_0 }; | |
yield return new object[] { Versions.V2_3_1 }; | |
yield return new object[] { Versions.V2_3_2 }; | |
yield return new object[] { Versions.V2_3_3 }; | |
yield return new object[] { Versions.V2_4_0 }; | |
yield return new object[] { Versions.V3_0_0 }; | |
} | |
public static IEnumerable<object[]> VersionData() => | |
new List<object[]> | |
{ | |
new object[] { Versions.V2_3_0 }, | |
new object[] { Versions.V2_3_1 }, | |
new object[] { Versions.V2_3_2 }, | |
new object[] { Versions.V2_3_3 }, | |
new object[] { Versions.V2_4_0 }, | |
new object[] { Versions.V3_0_0 } | |
}; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thanks @KimKiHyuk !
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM as well, thanks @KimKiHyuk!
There are a lot of spark versions but only 2.4.0 has been tested.
so I've added test cases, also move test cases to
TestData.cs
also moved test cases have been reused in
PayloadProcessTests