You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
If the user invokes repeatedly mvn package on dist without clean, the dist jar ends up with a missing spark-rapids-jni-version-info.properties and the Plugin refuses to initialize.
For the second running mvn package -pl dist -am -Dbuildver=321 -DskipTest,
the unpack-spark-rapids-jni-and-ucx execution in dist pom stops unpacking the JNI and the UCX jars to dist/target/parallel-world, and it prints: already unpacked
ls -lh rapids-4-spark_2.12-22.08.0-SNAPSHOT-cuda11.jar
// first time
377M 6 8 10:41 rapids-4-spark_2.12-22.08.0-SNAPSHOT-cuda11.jar
// second time
7.2M 6 8 10:44 rapids-4-spark_2.12-22.08.0-SNAPSHOT-cuda11.jar
gerashegalov
changed the title
[BUG] repeated runs mvn package without clean lead to missing spark-rapids spark-rapids-jni-version-info.properties in dist jar
[BUG] repeated runs of mvn package without clean lead to missing spark-rapids-jni-version-info.properties in dist jar
Jun 8, 2022
Describe the bug
If the user invokes repeatedly
mvn package
on dist without clean, the dist jar ends up with a missing spark-rapids-jni-version-info.properties and the Plugin refuses to initialize.Steps/Code to reproduce bug
Clean just once:
Run package for dist module using
Check the resulting jar has the build info for spark-rapids-jni
Re-run package for dist module using the same command:
Recheck the build info for spark-rapids-jni, and observe it's missing
Expected behavior
mvn package
with the same parameters should be reproducible and result in equivalent artifacts without a cleanAs a workaround use
mvn clean package/install ...
Environment details (please complete the following information)
Any
Additional context
Maybe related to #5603
h/t @NVnavkumar @anthony-chang
The text was updated successfully, but these errors were encountered: