[VL] Large timestamp outside of range

[ccat3z]

Backend

VL (Velox)

Bug description

Timestamps that great then 32767 years without but do not overflow will be outside of range.

Seq(
  (1723240800675l)
).toDF("time")

spark.sql("""
  select from_unixtime(event_timestamp, 'HH') from test
""")

// vanilla: 56577-04-30 00:11:15
// gluten: Timestamp is outside of supported range of [-32767-01-01, 32767-12-31]

It may be because std::chrono::time_point is used in time conversion, which has range limitations.

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

No response

[zml1206]

Seems to be a known issue facebookincubator/velox#10641

[ccat3z]

Seems to be a known issue facebookincubator/velox#10641

It maybe not same issue, facebookincubator/velox#10641 still use std::chrono. But the expected result is 56577, which std::chrono not supported.

[ccat3z]

Seems to be a known issue facebookincubator/velox#10641

It maybe not same issue, facebookincubator/velox#10641 still use std::chrono. But the expected result is 56577, which std::chrono not supported.

I am trying to remove the dependency on std::chrono to get rid of the limitations.