[SPARK-43567][PS] Match behavior for with pandas 2 #1283
GitHub Actions / Report test results
failed
Aug 1, 2023 in 0s
5151 tests run, 372 skipped, 1 failed.
Annotations
Check failure on line 1 in python/pyspark/pandas/tests/connect/series/test_parity_compute.py
github-actions / Report test results
python/pyspark/pandas/tests/connect/series/test_parity_compute.py.test_factorize
[UNSUPPORTED_DATA_TYPE] Unsupported DataType `Column`.
Raw output
Traceback (most recent call last):
File "/__w/spark/spark/python/pyspark/pandas/tests/series/test_compute.py", line 422, in test_factorize
kcodes, kuniques = psser.factorize()
File "/__w/spark/spark/python/pyspark/pandas/base.py", line 1754, in factorize
new_scol = null_scol.otherwise(map_scol[self.spark.column])
File "/__w/spark/spark/python/pyspark/sql/connect/column.py", line 465, in __getitem__
return Column(UnresolvedExtractValue(self._expr, LiteralExpression._from_value(k)))
File "/__w/spark/spark/python/pyspark/sql/connect/expressions.py", line 333, in _from_value
return LiteralExpression(value=value, dataType=LiteralExpression._infer_type(value))
File "/__w/spark/spark/python/pyspark/sql/connect/expressions.py", line 326, in _infer_type
raise PySparkTypeError(
pyspark.errors.exceptions.base.PySparkTypeError: [UNSUPPORTED_DATA_TYPE] Unsupported DataType `Column`.
Loading