You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As we know, FileScanTask has two fields project_field_ids and schema. I think the RecordBatch from the reader of this FileScanTask should always follow the schema specified in FileScanTask. However, in some case the schema could be inconsistent.
Considering we have an iceberg table with schema (c1 int, c2 int, c3 int). If we select the table with this order c3, c2, c1. The RecordBatch schema still is c1, c2, c3 which confuses me a lot.
As we know,
FileScanTask
has two fieldsproject_field_ids
andschema
. I think theRecordBatch
from the reader of thisFileScanTask
should always follow the schema specified inFileScanTask
. However, in some case the schema could be inconsistent.Considering we have an iceberg table with schema (c1 int, c2 int, c3 int). If we select the table with this order
c3, c2, c1
. TheRecordBatch
schema still isc1, c2, c3
which confuses me a lot.The text was updated successfully, but these errors were encountered: