You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When running the NDS 2.0 Power Run locally using partitioned Iceberg tables with Parquet data, the following exception is encountered when query 7 is run:
Caused by: java.lang.AssertionError: assertion failed
at scala.Predef$.assert(Predef.scala:208)
at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanExec.$anonfun$doExecuteBroadcast$1(AdaptiveSparkPlanExec.scala:359)
at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanExec.withFinalPlanUpdate(AdaptiveSparkPlanExec.scala:366)
at org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanExec.doExecuteBroadcast(AdaptiveSparkPlanExec.scala:358)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeBroadcast$1(SparkPlan.scala:197)
at org.apache.spark.sql.execution.SparkPlan.$anonfun$executeQuery$1(SparkPlan.scala:222)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:219)
at org.apache.spark.sql.execution.SparkPlan.executeBroadcast(SparkPlan.scala:193)
at org.apache.spark.sql.execution.SubqueryBroadcastExec.$anonfun$relationFuture$2(SubqueryBroadcastExec.scala:81)
at org.apache.spark.sql.execution.SQLExecution$.$anonfun$withExecutionId$1(SQLExecution.scala:139)
at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:163)
at org.apache.spark.sql.execution.SQLExecution$.withExecutionId(SQLExecution.scala:137)
at org.apache.spark.sql.execution.SubqueryBroadcastExec.$anonfun$relationFuture$1(SubqueryBroadcastExec.scala:78)
at scala.concurrent.Future$.$anonfun$apply$1(Future.scala:659)
at scala.util.Success.$anonfun$map$1(Try.scala:255)
at scala.util.Success.map(Try.scala:213)
at scala.concurrent.Future.$anonfun$map$1(Future.scala:292)
at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:33)
Steps/Code to reproduce bug
Create a partitioned table using Iceberg parquet data and run NDS query 7 against it using the Spark RAPIDS plugin (latest 22.06 version).
Expected behavior
Expectation is that query will succeed and not fail with an exception.
Environment details (please complete the following information)
Environment is local Linux desktop with RTX A5000 GPU. Spark version is 3.2.1 with standard benchmark configuration.
Additional context
N/A
The text was updated successfully, but these errors were encountered:
mattahrens
changed the title
[BUG] Query failure with java.lang.AssertionError inside org.apache.spark.sql.execution.adaptive.AdaptiveSparkPlanExec.doExecuteBroadcast when using partitioned Iceberg tables
[BUG] Query failure with java.lang.AssertionError when using partitioned Iceberg tables
May 11, 2022
Describe the bug
When running the NDS 2.0 Power Run locally using partitioned Iceberg tables with Parquet data, the following exception is encountered when query 7 is run:
Steps/Code to reproduce bug
Create a partitioned table using Iceberg parquet data and run NDS query 7 against it using the Spark RAPIDS plugin (latest 22.06 version).
Expected behavior
Expectation is that query will succeed and not fail with an exception.
Environment details (please complete the following information)
Environment is local Linux desktop with RTX A5000 GPU. Spark version is 3.2.1 with standard benchmark configuration.
Additional context
N/A
The text was updated successfully, but these errors were encountered: