Skip to content

Commit

Permalink
Fix type of column and encodings in PARQUET.md
Browse files Browse the repository at this point in the history
  • Loading branch information
EnricoMi committed Apr 19, 2023
1 parent 9cbe146 commit 7de5b44
Showing 1 changed file with 15 additions and 15 deletions.
30 changes: 15 additions & 15 deletions PARQUET.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,21 +108,21 @@ spark.read.parquet_block_columns("/path/to/parquet").show()
+-------------+-----+------+------+-------------------+-------------------+--------------------+------------------+-----------+---------------+-----------------+------+-----+
```

|column |type |description |
|:-----------------|:----:|:-----------------------------------------------------|
|filename |string|The Parquet file name |
|block |int |Block / RowGroup number starting at 1 |
|column |string|Block / RowGroup column name |
|codec |string|The coded used to compress the block column values |
|type |string|The data type of the block column |
|encodings |string|Encodings of the block column |
|minValue |string|Minimum value of this column in this block |
|maxValue |string|Maximum value of this column in this block |
|columnStart |long |Start position of the block column in the Parquet file|
|compressedBytes |long |Number of compressed bytes of this block column |
|uncompressedBytes |long |Number of uncompressed bytes of this block column |
|values |long |Number of values in this block column |
|nulls |long |Number of null values in this block column |
|column |type |description |
|:-----------------|:-----------:|:-----------------------------------------------------|
|filename |string |The Parquet file name |
|block |int |Block / RowGroup number starting at 1 |
|column |array<string>|Block / RowGroup column name |
|codec |string |The coded used to compress the block column values |
|type |string |The data type of the block column |
|encodings |array<string>|Encodings of the block column |
|minValue |string |Minimum value of this column in this block |
|maxValue |string |Maximum value of this column in this block |
|columnStart |long |Start position of the block column in the Parquet file|
|compressedBytes |long |Number of compressed bytes of this block column |
|uncompressedBytes |long |Number of uncompressed bytes of this block column |
|values |long |Number of values in this block column |
|nulls |long |Number of null values in this block column |

## Parquet partition metadata

Expand Down

0 comments on commit 7de5b44

Please sign in to comment.