-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Re-evaluate skip normalization if no new data feature #17578
Labels
Comments
One option might be to not skip normalization following a reset as well. |
colesnodgrass
added
platform-workflow/requires-grooming
and removed
platform-workflow/requires-grooming
labels
Oct 19, 2022
This issue make airbyte nearly unusable and very unstable. I think that's ok with having sync falling, but having it wiping the data is a big issue which make the tool unreliable |
Is this anywhere on the roadmap? |
Hi all, this is automatically handled by our Destinations today - any sort of typing and deduping is only run if needed. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
What
We introduced a feature to skip normalization in certain cases #9672.
However, following a reset, normalization should run as well because some clean up on the destination side are only done by normalization (https://github.com/airbytehq/oncall/issues/741)
This behavior has been disabled by #17574 as a mitigation.
Also for context, there might be some discussions about how to better handle resets which may impact this feature
(slack thread + https://github.com/airbytehq/airbyte-internal-issues/issues/999)
The text was updated successfully, but these errors were encountered: