fix(ingest-data): update dependency deltalake to v0.13.0

[renovate]

This PR contains the following updates:

Package	Change	Age	Adoption	Passing	Confidence
deltalake	0.12.0 -> 0.13.0

---

Warning

Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

---

Release Notes

delta-io/delta-rs (deltalake)

v0.13.0

Full Changelog

Implemented enhancements:

• Add nested struct supports #​1518
• Support FixedLenByteArray UUID statistics as a logical scalar #​1483
• Exposing create_add in the API #​1458
• Update features table on README #​1404
• docs(python): show data catalog options in Python API reference #​1347
• Add optimization to only list log files starting at a certain name #​1252
• Support configuring parquet compression #​1235
• parallel processing in Optimize command #​1171

Fixed bugs:

• get_add_actions() MAX is not showing complete value #​1534
• Can't get stats's minValues in add actions #​1515
• Pyarrow is_null filter not working as expected after loading using deltalake #​1496
• Can't write to table that uses generated columns #​1495
• Json error: Binary is not supported by JSON when writing checkpoint files #​1493
• _last_checkpoint size field is incorrect #​1468
• Error when Z Ordering a larger dataset #​1459
• Timestamp parsing issue #​1455
• File options are ignored when writing delta #​1444
• Slack Invite Link No Longer Valid #​1425
• cleanup_metadata doesn't remove .checkpoint.parquet files #​1420
• The test of reading the data from the blob storage located in Azurite container failed #​1415
• The test of reading the data from the bucket located in Minio container failed #​1408
• Datafusion: unreachable code reached when parsing statistics with missing columns #​1374
• vacuum is very slow on Cloudflare R2 #​1366

Closed issues:

• Expose Compression Options or WriterProperties for writing to Delta #​1469
• Support out-of-core Z-order using DataFusion #​1460
• Expose Z-order in Python #​1442

Merged pull requests:

• chore: fix the latest clippy warnings with the newer rustc's #​1536 (rtyler)
• docs: show data catalog options in Python API reference #​1532 (omkar-foss)
• fix: handle nulls in file-level stats #​1520 (wjones127)
• feat: add nested struct supports #​1519 (haruband)
• fix: tiny typo in AggregatedStats #​1516 (haruband)
• refactor: unify with_predicate for delete ops #​1512 (Blajda)
• chore: remove deprecated table functions #​1511 (roeap)
• chore: update datafusion and related crates #​1504 (roeap)
• feat: implement restore operation #​1502 (loleek)
• chore: fix mypy failure #​1500 (wjones127)
• fix: avoid writing statistics for binary columns to fix JSON error #​1498 (ChewingGlass)
• feat(rust): expose WriterProperties method on RecordBatchWriter and DeltaWriter #​1497 (theelderbeever)
• feat: add UUID statistics handling #​1484 (atefsaw)
• feat: expose create_add to the public #​1482 (atefsaw)
• fix: add sizeInBytes to _last_checkpoint and change size to # of actions #​1477 (cmackenzie1)
• fix(python): match Field signatures #​1463 (guilhem-dvr)
• feat: handle larger z-order jobs with streaming output and spilling #​1461 (wjones127)
• chore: increment python version #​1449 (wjones127)
• chore: upgrade to arrow 40 and datafusion 26 #​1448 (rtyler)
• feat(python): expose z-order in Python #​1443 (wjones127)
• ci: prune CI/CD pipelines #​1433 (roeap)
• refactor: remove LoadCheckpointError and ApplyLogError #​1432 (roeap)
• feat: update writers to include compression method in file name #​1431 (Blajda)
• refactor: move checkpoint and errors into separate module #​1430 (roeap)
• feat: add z-order optimize #​1429 (wjones127)
• fix: casting when data to be written does not match table schema #​1427 (Blajda)
• docs: update README.adoc to fix expired Slack link #​1426 (dennyglee)
• chore: remove no-longer-necessary build.rs for Rust bindings #​1424 (rtyler)
• chore: remove the delta-checkpoint lambda which I have moved to a new repo #​1423 (rtyler)
• refactor: rewrite redundant_async_block #​1422 (cmackenzie1)
• fix: update cleanup regex to include checkpoint.parquet files #​1421 (cmackenzie1)
• docs: update features table in README #​1414 (ognis1205)
• fix: get_prune_stats returns homogenous ArrayRef #​1413 (cmackenzie1)
• feat: explicit python exceptions #​1409 (roeap)
• feat: implement update operation #​1390 (Blajda)
• feat: allow concurrent file compaction #​1383 (wjones127)

---

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR has been generated by Mend Renovate. View repository job log here.

[hongbo-miao]

Waiting delta-io/delta-rs#1602

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
No Duplication information

[github-actions]

🎉 This PR is included in version 1.95.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀