-
Notifications
You must be signed in to change notification settings - Fork 34
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Duplication of data #47
Comments
And another bug with deduplication -> If I restart the first instance, it will get data from second one, so also in first instance I'll have a duplicated data. |
I can not understant what is the problem . Could you please tell me what exactly means "duplicate data" for you with an example please? |
This ha system only works with data sent to the srelay with timestamp, if not sent each node will set the local timestamp and data could be different in both nodes. If data is equal in (tags, fiels, and timestamp) data can not be "duplicated" it will be overwritten. Could you show me the original sent data in ILP format ? |
I have a problem with duplication of data.
I have a 2 instances of InfluxDB (in1, in2), on the front of it there is a influxdb-srelay with HA config. Every write command is executed in in1/in2 instance.
Also on in1/in2 I have a 2 instances of syncflux in configuration -> at
in1
there is master:in1,slave:in2, atin2
there is master:in2, slave:in1.I'm executing some write queries, and everything is ok, queries are executed on both instances.
And now, I'm shutting down
in2
instance still sending write command. Next I'm restartingin2
-> syncflux are starting to process chunks fromin1
and it writes it toin2
instance. The problem is that some of data which was before shutting down in instance in2 are also retrieved from in1, and added as a duplicates in process chunks command.My configs are simple as examples from github, srelay are using HA example, syncflux are using default HA configuration with initial-replication = "both" (changing to none doesn't help)
Why syncflux duplicates the data? Why it not checks that data is present in the database?
At the screenshot there is example:
19.28 - Servers was started
19.29 - I've executed a one write command
19.30 - I've stopped a second instance, and execute two write commands.
19.32 - I've started secondary database, and syncflux rebuild database, but it add a duplication of write command at 19.29, so at secondary graph there is a 2 instead of 1
The text was updated successfully, but these errors were encountered: