NETOBSERV-973 skip duplicates

[jpinsonneau]

When FLPs are restarted after agents, the connection store is cleared of any previous connections.

Previously, when a record containing Duplicate: true was triggering a new connection, the record sent to loki was not containing the TimeFlowEndMs field since it comes from an aggregation.

This PR skip duplicated flows in connection tracking instead of only skipping aggregates to avoid this case.

Backport: #420

[codecov]

Codecov Report

Merging #421 (4e97779) into main (41fe8ff) will increase coverage by 0.01%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #421      +/-   ##
==========================================
+ Coverage   64.42%   64.44%   +0.01%     
==========================================
  Files          94       94              
  Lines        6567     6570       +3     
==========================================
+ Hits         4231     4234       +3     
  Misses       2096     2096              
  Partials      240      240              

Flag	Coverage Δ
unittests	64.44% <100.00%> (+0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
pkg/pipeline/extract/conntrack/conntrack.go	93.47% <100.00%> (+0.10%)	⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

[Amoghrd]

/label qe-approved

[jotak]

/lgtm
but can you add more info to the PR description please? (why moving it to a different level is better)

[jpinsonneau]

/approve

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jpinsonneau

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jpinsonneau]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment