Skip to content
This repository has been archived by the owner on Dec 13, 2023. It is now read-only.

feature: Not storing duplicate data in external storage #153

Merged

Conversation

SimonMisencik
Copy link
Contributor

@SimonMisencik SimonMisencik commented Dec 8, 2022

Signed-off-by: Simon Misencik simon.misencik@gmail.com

Pull Request type

  • Bugfix
  • Feature
  • Refactoring (no functional changes, no api changes)
  • Build related changes (Please run ./gradlew generateLock saveLock to refresh dependencies)
  • WHOSUSING.md
  • Other (please describe):

Changes in this PR

Discussion: Netflix/conductor#3384

This PR implements calculating digest(sha-256) from payloadBytes. This digest is used as an id for record in the database. However, if the same digest/id is already in the database, it only updates the create_at data to prevent deletion during the cleaning of old data.

Alternatives considered

Describe alternative implementation you have considered

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>
@SimonMisencik SimonMisencik marked this pull request as draft December 8, 2022 12:46
@SimonMisencik SimonMisencik marked this pull request as ready for review December 8, 2022 13:42
@SimonMisencik
Copy link
Contributor Author

Build failed because of dependency on this PR: Netflix/conductor#3383

@github-actions
Copy link

This PR is stale, because it has been open for 45 days with no activity. Remove the stale label or comment, or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label Jan 28, 2023
@SimonMisencik
Copy link
Contributor Author

Netflix/conductor#3383 was merged. Please rerun the build.

@github-actions github-actions bot removed the Stale label Jan 29, 2023
@marosmars
Copy link
Contributor

Hey @apanicker-nflx , could we get a retrigger here ? and then a review.

Thank you,
Maros

@SimonMisencik SimonMisencik marked this pull request as draft February 17, 2023 10:02
@SimonMisencik SimonMisencik force-pushed the remove_duplication_from_external_storage branch from d5f96d6 to b3301ae Compare February 17, 2023 10:07
@SimonMisencik SimonMisencik marked this pull request as ready for review February 17, 2023 10:32
@v1r3n v1r3n merged commit 27fe955 into Netflix:main Mar 19, 2023
v1r3n added a commit that referenced this pull request Mar 19, 2023
JumasJM pushed a commit to FRINXio/conductor-community that referenced this pull request Oct 23, 2023
* Not storing duplicate data in external storage

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>

* Add dependencies

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>

---------

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>
JumasJM pushed a commit to FRINXio/conductor-community that referenced this pull request Nov 6, 2023
* Not storing duplicate data in external storage

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>

* Add dependencies

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>

---------

Signed-off-by: Simon Misencik <simon.misencik@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants