Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NETOBSERV-497 Use direct-prom pipeline #153

Merged
merged 2 commits into from
Sep 7, 2022
Merged

Conversation

jotak
Copy link
Member

@jotak jotak commented Aug 11, 2022

  • Remove aggregation stage
  • Update FLP / vendor

Requires netobserv/flowlogs-pipeline#266

@openshift-ci
Copy link

openshift-ci bot commented Aug 11, 2022

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from jotak by writing /assign @jotak in a comment. For more information see:The Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@jotak jotak changed the title Use direct-prom pipeline NETOBSERV-497 Use direct-prom pipeline Aug 11, 2022
@jotak
Copy link
Member Author

jotak commented Aug 11, 2022

/hold
requires netobserv/flowlogs-pipeline#266

@Amoghrd
Copy link
Contributor

Amoghrd commented Sep 1, 2022

/ok-to-test

@openshift-ci openshift-ci bot added the ok-to-test To set manually when a PR is safe to test. Triggers image build on PR. label Sep 1, 2022
@github-actions
Copy link

github-actions bot commented Sep 1, 2022

New image: ["quay.io/netobserv/network-observability-operator:677a609"]. It will expire after two weeks.

encode:
type: prom
prom:
metrics:
- name: bandwidth_per_network_service_per_namespace
type: counter
filter: {key: name, value: bandwidth_network_service_namespace}
valuekey: recent_op_value
valuekey: Bytes
labels:
- Service
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we no longer do the summation in the extract_aggregate, where is the sum performed? In prometheus counter? So we have to call Prometheus.Add() on each record instead of on the aggregates. OK.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

exactly, it's built-in prom client

Comment on lines 374 to 399

// obtain extract_aggregate and encode_prometheus stages from metrics_definitions
aggregates, promMetrics, err := b.obtainMetricsConfiguration()
promMetrics, err := b.obtainMetricsConfiguration()
if err != nil {
return err
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fix comment that we add only encode_prometheus stage but not extract_aggregate.

@KalmanMeth
Copy link
Contributor

@jotak @jpinsonneau @OlivierCazade We have these metrics now in prometheus. How do we expose them to a user? Do we send them to our own prometheus instance or to the existing Openshift prometheus? Then, how do we show the graphs?

@jotak
Copy link
Member Author

jotak commented Sep 6, 2022

@jotak @jpinsonneau @OlivierCazade We have these metrics now in prometheus. How do we expose them to a user? Do we send them to our own prometheus instance or to the existing Openshift prometheus? Then, how do we show the graphs?

It depends on the operator flavour, if it's upstream or downstream. Upstream, the user needs to install prometheus (or configure cluster monitoring to scrape user workload targets). It's not documented in the operator yet because it's still kinda WIP (cf epic https://issues.redhat.com/browse/NETOBSERV-391 ), but there's some documentation there: https://github.com/netobserv/documents/blob/main/openshift.md#metrics
Also, if I remember correctly you created some make targets to deploy prometheus, so that's an option for users.

In the productized/downstream version, metrics will be available in cluster monitoring, hence visible from the openshift console.

In both case that's not something we're actively working on right now as it's not in 4.12 roadmap, it will certainly be in 4.13. But that doesn't mean we can't make progress on it if we have time for it.

And at last, we will create new dashboards in our console plugin (epic https://issues.redhat.com/browse/NETOBSERV-139 )

- Remove aggregation stage
- Update FLP / vendor
@openshift-ci
Copy link

openshift-ci bot commented Sep 7, 2022

New changes are detected. LGTM label has been removed.

@github-actions github-actions bot removed the ok-to-test To set manually when a PR is safe to test. Triggers image build on PR. label Sep 7, 2022
@jotak jotak merged commit 950743a into netobserv:main Sep 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants