Skip to content

Latest commit

 

History

History
166 lines (149 loc) · 25.2 KB

CHANGELOG.md

File metadata and controls

166 lines (149 loc) · 25.2 KB
Raw

Changelog

50.0.0 (2024-01-08)

Full Changelog

Breaking changes:

Implemented enhancements:

  • Support get offsets or blocks info from arrow file. #5252 [arrow]
  • Make regexp_match take scalar pattern and flag #5246 [arrow]
  • Cannot access pen state website on arrow-row #5238 [arrow]
  • RecordBatch with_schema's error message is hard to read #5227 [arrow]
  • Support cast between StructArray. #5219 [arrow]
  • Remove nightly-only simd feature and related code in ArrowNumericType #5185 [arrow]
  • Use Vec instead of Slice in ColumnReader #5177 [parquet]
  • Request to Memmap Arrow IPC files on disk #5153 [arrow]
  • GenericColumnReader::read_records Yields Truncated Records #5150 [parquet]
  • Nested Schema Projection #5148 [parquet] [arrow]
  • Support specifying quote and escape in Csv WriterBuilder #5146 [arrow]
  • Support casting of Float16 with other numeric types #5138 [arrow]
  • Parquet: read parquet metadata with page index in async and with size hints #5129 [parquet]
  • Cast from floating/timestamp to timestamp/floating #5122 [arrow]
  • Support Casting List To/From LargeList in Cast Kernel #5113 [arrow]
  • Expose a path for converting bytes::Bytes into arrow_buffer::Buffer without copy #5104 [arrow]
  • API inconsistency of ListBuilder make it hard to use as nested builder #5098 [arrow]
  • Parquet: don't truncate min/max statistics for float16 and decimal when writing file #5075 [parquet]
  • Parquet: derive boundary order when writing columns #5074 [parquet]
  • Support new Arrow PyCapsule Interface for Python FFI #5067 [arrow]
  • 48.0.1 arrow patch release #5050 [parquet] [arrow]
  • Binary columns do not receive truncated statistics #5037 [parquet]
  • Re-evaluate Explicit SIMD Aggregations #5032 [arrow]
  • Min/Max Kernels Should Use Total Ordering #5031 [arrow]
  • Allow zip compute kernel to take Scalar / Datum #5011 [arrow]
  • Add Float16/Half-float logical type to Parquet #4986 [parquet]
  • feat: cast (Large)List to FixedSizeList #5081 [arrow] (wjones127)
  • Update Parquet Encoding Documentation #5051 [parquet]

Fixed bugs:

  • json schema inference can't handle null field turned into object field in subsequent rows #5215 [arrow]
  • Invalid trailing content after Z in timezone is ignored #5182 [arrow]
  • Take panics on a fixed size list array when given null indices #5169 [arrow]
  • EnabledStatistics::Page does not take effect on ByteArrayEncoder #5162 [parquet]
  • Parquet: ColumnOrder not being written when writing parquet files #5152 [parquet]
  • Parquet: Interval columns shouldn't write min/max stats #5145 [parquet]
  • cast Utf8 to decimal failure #5127 [arrow]
  • coerce_primitive not honored when decoding from serde object #5095 [arrow]
  • Unsound MutableArrayData Constructor #5091 [arrow]
  • RowGroupReader.get_row_iter() fails with Path ColumnPath not found #5064 [parquet]
  • cast format 'yyyymmdd' to Date32 give a error #5044 [arrow]

Performance improvements:

  • ArrowArrayStreamReader imports FFI_ArrowSchema on each iteration #5103 [arrow]

Closed issues:

  • Working example of list_flights with ObjectStore #5116
  • (object_store) Error broken pipe on S3 multipart upload #5106

Merged pull requests: