From 397cd94adb0fe10f2d3c1dc9a21e9c78e918186a Mon Sep 17 00:00:00 2001 From: David Blajda Date: Sat, 6 Jan 2024 16:22:52 -0500 Subject: [PATCH] docs: update docs for merge (#2042) # Description Update documentation to reflect the current state of merge. Since merge now supports upserts without performing a full rewrite I'd let to mark it as "done". There is of course further optimizations that can be performed but it is now in a usable state. # Related Issue(s) - closes #850 --- README.md | 4 +--- crates/deltalake-core/src/operations/merge/mod.rs | 4 ---- 2 files changed, 1 insertion(+), 7 deletions(-) diff --git a/README.md b/README.md index 1913b6305e..343c73f601 100644 --- a/README.md +++ b/README.md @@ -152,7 +152,7 @@ of features outlined in the Delta [protocol][protocol] is also [tracked](#protoc | Delete - predicates | ![done] | ![done] | Delete data based on a predicate | | Optimize - compaction | ![done] | ![done] | Harmonize the size of data file | | Optimize - Z-order | ![done] | ![done] | Place similar data into the same file | -| Merge | [![semi-done]][merge-rs] | [![semi-done]][merge-py] | Merge two tables (limited to full re-write) | +| Merge | ![done] | ![done] | Merge a target Delta table with source data | | FS check | ![done] | ![done] | Remove corrupted files from table | ### Protocol Support Level @@ -182,8 +182,6 @@ of features outlined in the Delta [protocol][protocol] is also [tracked](#protoc [semi-done]: https://cdn.jsdelivr.net/gh/Readme-Workflows/Readme-Icons@main/icons/octicons/ApprovedChangesGrey.svg [done]: https://cdn.jsdelivr.net/gh/Readme-Workflows/Readme-Icons@main/icons/octicons/ApprovedChanges.svg [roadmap]: https://github.com/delta-io/delta-rs/issues/1128 -[merge-py]: https://github.com/delta-io/delta-rs/issues/1357 -[merge-rs]: https://github.com/delta-io/delta-rs/issues/850 [writer-rs]: https://github.com/delta-io/delta-rs/issues/851 [check-constraints]: https://github.com/delta-io/delta-rs/issues/1881 [onelake-rs]: https://github.com/delta-io/delta-rs/issues/1418 diff --git a/crates/deltalake-core/src/operations/merge/mod.rs b/crates/deltalake-core/src/operations/merge/mod.rs index 2bc2ddb2b2..6a40498851 100644 --- a/crates/deltalake-core/src/operations/merge/mod.rs +++ b/crates/deltalake-core/src/operations/merge/mod.rs @@ -7,10 +7,6 @@ //! and specify additional predicates for finer control. The order of operations //! specified matter. See [`MergeBuilder`] for more information //! -//! *WARNING* The current implementation rewrites the entire delta table so only -//! use on small to medium sized tables. -//! Enhancements tracked at #850 -//! //! # Example //! ```rust ignore //! let table = open_table("../path/to/table")?;