-
Notifications
You must be signed in to change notification settings - Fork 244
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
More compilation fixes for Spark 4.0.0 [databricks] #10978
More compilation fixes for Spark 4.0.0 [databricks] #10978
Conversation
Signed-off-by: Raza Jafri <rjafri@nvidia.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, so far.
Here's the latest build break:
[INFO] Compiling 421 Scala sources and 59 Java sources to /home/runner/work/spark-rapids/spark-rapids/sql-plugin/target/spark312/classes ...
Error: ] /home/runner/work/spark-rapids/spark-rapids/sql-plugin/src/main/java/com/nvidia/spark/rapids/CudfUnsafeRow.java:31: cannot find symbol
symbol: class VariantVal
location: package org.apache.spark.unsafe.types
Error: ] /home/runner/work/spark-rapids/spark-rapids/sql-plugin/src/main/java/com/nvidia/spark/rapids/CudfUnsafeRow.java:404: cannot find symbol
symbol: class VariantVal
location: class com.nvidia.spark.rapids.CudfUnsafeRow
Error: ] /home/runner/work/spark-rapids/spark-rapids/sql-plugin/src/main/java/com/nvidia/spark/rapids/CudfUnsafeRow.java:403: method does not override or implement a method from a supertype
Sorry, this should be shimmed! |
Signed-off-by: Raza Jafri <rjafri@nvidia.com>
This reverts commit dc4823b.
build |
Reviewing the latest version now. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok, that looks better. We use the trait for the CudfUnsafeRow
object, and Base
for the class. That works for me.
* More compilation fixes * Signing off Signed-off-by: Raza Jafri <rjafri@nvidia.com> * Added shim for UnsafeCudfRow * POM changes Signed-off-by: Raza Jafri <rjafri@nvidia.com> * Added shim for UnsafeCudfRow * Revert "POM changes" This reverts commit dc4823b. --------- Signed-off-by: Raza Jafri <rjafri@nvidia.com>
This PR solves the last bit of the compilation errors, when building for Spark 4.0.
fixes #10972