Skip to content

Merge branch 'master' of https://github.com/apache/spark into LEGACY_… #1265

Merge branch 'master' of https://github.com/apache/spark into LEGACY_…

Merge branch 'master' of https://github.com/apache/spark into LEGACY_… #1265

Triggered via push July 12, 2023 00:39
Status Failure
Total duration 3h 45m 50s
Artifacts 20

build_main.yml

on: push
Run  /  Check changes
38s
Run / Check changes
Run  /  Base image build
49s
Run / Base image build
Run  /  Breaking change detection with Buf (branch-3.4)
1m 7s
Run / Breaking change detection with Buf (branch-3.4)
Run  /  Scala 2.13 build with SBT
20m 18s
Run / Scala 2.13 build with SBT
Run  /  Run TPC-DS queries with SF=1
1h 28m
Run / Run TPC-DS queries with SF=1
Run  /  Run Docker integration tests
37m 26s
Run / Run Docker integration tests
Run  /  Run Spark on Kubernetes Integration test
1h 30m
Run / Run Spark on Kubernetes Integration test
Matrix: Run / build
Matrix: Run / java-11-17
Run  /  Build modules: sparkr
38m 21s
Run / Build modules: sparkr
Run  /  Linters, licenses, dependencies and documentation generation
27m 6s
Run / Linters, licenses, dependencies and documentation generation
Matrix: Run / pyspark
Fit to window
Zoom out
Zoom in

Annotations

26 errors
Run / Linters, licenses, dependencies and documentation generation
Process completed with exit code 1.
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-95bb308947d9daf4-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-9c00268947db2e74-exec-1".
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
sleep interrupted
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$575/693591376@383a4600 rejected from java.util.concurrent.ThreadPoolExecutor@7bea7bb1[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 321]
Run / Run Spark on Kubernetes Integration test
Task io.fabric8.kubernetes.client.utils.internal.SerialExecutor$$Lambda$575/693591376@2a1aabca rejected from java.util.concurrent.ThreadPoolExecutor@7bea7bb1[Shutting down, pool size = 3, active threads = 2, queued tasks = 0, completed tasks = 320]
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-4eb4b18947f60021-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-555b438947f76679-exec-1".
Run / Run Spark on Kubernetes Integration test
Set() did not contain "decomtest-1e75f38947fbd9fc-exec-1".
Run / Run Spark on Kubernetes Integration test
Status(apiVersion=v1, code=404, details=StatusDetails(causes=[], group=null, kind=pods, name=spark-test-app-a2b4e0395e9a47098e7b141a739c1786-driver, retryAfterSeconds=null, uid=null, additionalProperties={}), kind=Status, message=pods "spark-test-app-a2b4e0395e9a47098e7b141a739c1786-driver" not found, metadata=ListMeta(_continue=null, remainingItemCount=null, resourceVersion=null, selfLink=null, additionalProperties={}), reason=NotFound, status=Failure, additionalProperties={})..
Run / Build modules: sql - other tests
Process completed with exit code 18.
SparkThrowableSuite.Error classes match with document: SparkThrowableSuite#L259
org.scalatest.exceptions.TestFailedException: "[--- layout: global title: INCOMPATIBLE_DATA_FOR_TABLE error class displayTitle: INCOMPATIBLE_DATA_FOR_TABLE error class license: | Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --- SQLSTATE: KD000 Cannot write incompatible data for the table `<tableName>`: This error class has the following derived error classes: ## AMBIGUOUS_COLUMN_NAME Ambiguous column name in the input data `<colName>`. ## CANNOT_FIND_DATA Cannot find data for the output column `<colName>`. ## CANNOT_SAFELY_CAST Cannot safely cast `<colName>` `<srcType>` to `<targetType>`. ## EXTRA_STRUCT_FIELDS Cannot write extra fields `<extraFields>` to the struct `<colName>`. ## NULLABLE_ARRAY_ELEMENTS Cannot write nullable elements to array of non-nulls: `<colName>`. ## NULLABLE_COLUMN Cannot write nullable values to non-null column `<colName>`. ## NULLABLE_MAP_VALUES Cannot write nullable values to map of non-nulls: `<colName>`. ## STRUCT_MISSING_FIELDS Struct `<colName>` missing fields: `<missingFields>`. ## UNEXPECTED_COLUMN_NAME Struct `<colName>` `<order>`-th field name does not match (may be out of order): expected `<expected>`, found `<found>`.]" did not equal "[]" The error class document is not up to date. Please regenerate it.
DSV2SQLInsertTestSuite.insert by name: mismatch column name: DSV2SQLInsertTestSuite#L543
org.scalatest.exceptions.TestFailedException: Map("tableName" -> "`testcat`.`t1`", "colName" -> "`c1`") did not equal Map("tableName" -> "`testcat`.`t1`", "colPath" -> "`c1`")
DataFrameWriterV2Suite.Append: by name not position: DataFrameWriterV2Suite#L44
org.scalatest.exceptions.TestFailedException: Map("tableName" -> "`testcat`.`table_name`", "colName" -> "`data`") did not equal Map("tableName" -> "`testcat`.`table_name`", "colPath" -> "`data`")
DataFrameWriterV2Suite.Overwrite: by name not position: DataFrameWriterV2Suite#L44
org.scalatest.exceptions.TestFailedException: Map("tableName" -> "`testcat`.`table_name`", "colName" -> "`data`") did not equal Map("tableName" -> "`testcat`.`table_name`", "colPath" -> "`data`")
DataFrameWriterV2Suite.OverwritePartitions: by name not position: DataFrameWriterV2Suite#L44
org.scalatest.exceptions.TestFailedException: Map("tableName" -> "`testcat`.`table_name`", "colName" -> "`data`") did not equal Map("tableName" -> "`testcat`.`table_name`", "colPath" -> "`data`")

Artifacts

Produced during runtime
Name Size
test-results-catalyst, hive-thriftserver--8-hadoop3-hive2.3 Expired
3 MB
test-results-core, unsafe, kvstore, avro, network-common, network-shuffle, repl, launcher, examples, sketch, graphx--8-hadoop3-hive2.3 Expired
2.52 MB
test-results-docker-integration--8-hadoop3-hive2.3 Expired
133 KB
test-results-hive-- other tests-8-hadoop3-hive2.3 Expired
1.1 MB
test-results-hive-- slow tests-8-hadoop3-hive2.3 Expired
942 KB
test-results-pyspark-connect, pyspark-errors--8-hadoop3-hive2.3 Expired
432 KB
test-results-pyspark-core, pyspark-streaming, pyspark-ml--8-hadoop3-hive2.3 Expired
297 KB
test-results-pyspark-pandas--8-hadoop3-hive2.3 Expired
1.01 MB
test-results-pyspark-pandas-connect--8-hadoop3-hive2.3 Expired
670 KB
test-results-pyspark-pandas-slow--8-hadoop3-hive2.3 Expired
1.16 MB
test-results-pyspark-pandas-slow-connect--8-hadoop3-hive2.3 Expired
899 KB
test-results-pyspark-sql, pyspark-mllib, pyspark-resource, pyspark-testing--8-hadoop3-hive2.3 Expired
339 KB
test-results-sparkr--8-hadoop3-hive2.3 Expired
280 KB
test-results-sql-- extended tests-8-hadoop3-hive2.3 Expired
3.32 MB
test-results-sql-- other tests-8-hadoop3-hive2.3 Expired
4.6 MB
test-results-sql-- slow tests-8-hadoop3-hive2.3 Expired
3.13 MB
test-results-streaming, sql-kafka-0-10, streaming-kafka-0-10, mllib-local, mllib, yarn, mesos, kubernetes, hadoop-cloud, spark-ganglia-lgpl, connect, protobuf--8-hadoop3-hive2.3 Expired
3.16 MB
test-results-tpcds--8-hadoop3-hive2.3 Expired
22.6 KB
unit-tests-log-core, unsafe, kvstore, avro, network-common, network-shuffle, repl, launcher, examples, sketch, graphx--8-hadoop3-hive2.3 Expired
156 MB
unit-tests-log-sql-- other tests-8-hadoop3-hive2.3 Expired
284 MB