Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NETOBSERV-182 Drop unused fields #141

Merged
merged 1 commit into from
Aug 2, 2022

Conversation

jotak
Copy link
Member

@jotak jotak commented Jul 26, 2022

When using IPFIX, it's now possible to avoid storing lots of garbage by
turning dropUnusedFields to true (it actually defaults to true)

I saw about 30% less space used with this method, uncompressed (it's probably less with compression)

When using IPFIX, it's now possible to avoid storing lots of garbage by
turning dropUnusedFields to true (it actually defaults to true)

//+kubebuilder:default:=true
// Set true to drop fields that are known to be unused by OVS, in order to save storage space.
DropUnusedFields bool `json:"dropUnusedFields,omitempty"`
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mariomac I'm adding this field in FLP section as this is where it has an impact, however following the discussion on API review, maybe it makes more sense to have it under "ipfix"? (because it only has effect with ipfix, it would be ignored when agent is ebpf

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, when this PR is merged, I'll rebase my branch and incorporate these changes

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thinking it twice, I think this field could still be in the FLP section, as:

  1. It's a configuration for FLP
  2. Despite it's useless in EBPF, it could still have generic functionality if in the future we use other technologies/agents.

Copy link
Contributor

@mariomac mariomac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks good to me. Have you found any noticeable impact in the FLP CPU consumption?

@@ -127,6 +128,13 @@ func (b *builder) daemonSet(configDigest string) *appsv1.DaemonSet {
}
}

func (b *builder) portProtocol() corev1.Protocol {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👏

@memodi
Copy link
Contributor

memodi commented Jul 28, 2022

/ok-to-test

@openshift-ci openshift-ci bot added the ok-to-test To set manually when a PR is safe to test. Triggers image build on PR. label Jul 28, 2022
@github-actions
Copy link

New image: ["quay.io/netobserv/network-observability-operator:64090ca"]. It will expire after two weeks.

@jotak
Copy link
Member Author

jotak commented Jul 29, 2022

Some quick measurements (on the left before 19:09, it's using current main images; on the right after 19:11, it's with this PR)

  • FLP CPU stays stable:
    Capture d’écran du 2022-07-29 19-17-41

  • FLP memory minor increase (~about 4MB increase per FLP pod) :
    Capture d’écran du 2022-07-29 19-17-57

  • Flows rate stable (not reaching capacity anyway)
    Capture d’écran du 2022-07-29 19-20-12

@jotak
Copy link
Member Author

jotak commented Aug 2, 2022

/approve

@openshift-ci
Copy link

openshift-ci bot commented Aug 2, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jotak

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved label Aug 2, 2022
@openshift-merge-robot openshift-merge-robot merged commit b000d31 into netobserv:main Aug 2, 2022
@jotak jotak deleted the cleanup-unused branch December 7, 2022 04:01
KalmanMeth pushed a commit to KalmanMeth/network-observability-operator that referenced this pull request Feb 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved lgtm ok-to-test To set manually when a PR is safe to test. Triggers image build on PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants