Releases: netobserv/flowlogs-pipeline
Releases · netobserv/flowlogs-pipeline
v1.6.1-community
What's Changed
Breaking changes 🛠
Non-breaking changes
- NETOBSERV-1522 Add otel to pipeline builder by @jpinsonneau in #672
- NETOBSERV-1707: move to go 1.22 by @jotak in #675
- Add .ci-operator.yaml by @jotak in #680
Dependencies
- Bump github.com/prometheus/client_golang from 1.19.0 to 1.19.1 by @dependabot in #665
- Bump google.golang.org/protobuf from 1.33.0 to 1.34.1 by @dependabot in #670
- Bump github.com/spf13/viper from 1.18.2 to 1.19.0 by @dependabot in #673
Full Changelog: v1.6.0-community...v1.6.1-community
v1.6.0-community
What's Changed
Breaking changes 🛠
- NETOBSERV-1425: enhance metrics filters by @jotak in #602
- API cleanup: remove deprecated metric.filter by @jotak in #613
- NETOBSERV-1500 : Refactoring of transform network API by @OlivierCazade in #580
- NETOBSERV-1466 Update eBPF dependency for FLP by @jpinsonneau in #601
- Enum replacement in API by @jotak in #614
- NETOBSERV-1426: subnet labelling enhancements by @jotak in #586
Non-breaking changes
- Fix yaml unmarshaling of inlined config by @jotak in #596
- Add test on IPFIX writer by @jotak in #606
- Refactor metrics by @KalmanMeth in #590
- Add new field to ipfix exporter for flowRtt by @bhale in #603
- (trivial) Report error when Kafka connection is broken by @jotak in #615
- Add test covering use of viper with unmarshaller by @jotak in #623
- NETOBSERV-1471 add gRPC write stage by @jpinsonneau in #621
- NETOBSERV-1514: drop go1.20 support by @jotak in #629
- Provide k8s templates to just deploy an ipfix collector by @jotak in #633
- NETOBSERV-1566: ipfix: make RTT optional by @jotak in #630
- Fix inconsistent maps by @jotak in #634
- update examples, minor changes by @jotak in #635
- NETOBSERV-1471 update eBPF dep by @jpinsonneau in #642
- Add go mod vendor check in CI by @jotak in #644
- codecov v4 by @jpinsonneau in #650
- Codecov add env token from secret by @jpinsonneau in #652
- Otel fix deprecated function by @OlivierCazade in #653
- NETOBSERV-1427: Added config watcher and supporting metrics reloading by @OlivierCazade in #607
- NETOBSERV-1597: skip RecordKeyMissing error by @jpinsonneau in #660
- Codecov: remove token, turn off CI failure by @jotak in #667
Dependencies
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 0.45.0 to 1.23.1 by @dependabot in #594
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 0.44.0 to 1.23.1 by @dependabot in #592
- Bump github.com/vmware/go-ipfix from 0.8.2 to 0.9.0 by @dependabot in #597
- Bump k8s.io/apimachinery from 0.29.1 to 0.29.2 by @dependabot in #600
- Bump k8s.io/client-go from 0.29.1 to 0.29.2 by @dependabot in #598
- Bump google.golang.org/grpc from 1.61.0 to 1.62.0 by @dependabot in #609
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.23.1 to 1.24.0 by @dependabot in #611
- Bump go.opentelemetry.io/otel/sdk/metric from 1.23.1 to 1.24.0 by @dependabot in #610
- Bump github.com/netobserv/netobserv-ebpf-agent from 0.3.3-0.20240117144239-03bb6a38b3f0 to 0.3.3 by @dependabot in #599
- Bump github.com/prometheus/client_golang from 1.18.0 to 1.19.0 by @dependabot in #616
- Bump github.com/minio/minio-go/v7 from 7.0.67 to 7.0.68 by @dependabot in #617
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.23.1 to 1.24.0 by @dependabot in #618
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.23.1 to 1.24.0 by @dependabot in #619
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.23.1 to 1.24.0 by @dependabot in #620
- Bump golang.org/x/net from 0.21.0 to 0.22.0 by @dependabot in #624
- Bump github.com/stretchr/testify from 1.8.4 to 1.9.0 by @dependabot in #625
- Bump github.com/minio/minio-go/v7 from 7.0.68 to 7.0.69 by @dependabot in #627
- Bump google.golang.org/grpc from 1.62.0 to 1.62.1 by @dependabot in #628
- Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 by @dependabot in #631
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.24.0 to 1.25.0 by @dependabot in #646
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 1.24.0 to 1.25.0 by @dependabot in #647
- Bump golang.org/x/net from 0.23.0 to 0.24.0 by @dependabot in #655
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetrichttp from 1.24.0 to 1.26.0 by @dependabot in #659
- Bump github.com/agoda-com/opentelemetry-logs-go from 0.4.3 to 0.5.0 by @dependabot in #658
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.25.0 to 1.26.0 by @dependabot in #662
- Bump ubi9.4 by @jotak in #668
New Contributors
Full Changelog: v0.1.11...v1.6.0-community
v0.1.11
What's Changed
Breaking changes 🛠
- NETOBSERV-1231: Improve promencode API: scaling & filters by @jotak in #513
- Opentelemetry exporter by @KalmanMeth in #531
Non-breaking changes
- initial support for labels by @KalmanMeth in #447
- NETOBSERV-1222: create PR template by @jotak in #490
- Bump minio-go by @jotak in #489
- Fixes a couple of minor weaknesses by @jotak in #491
- Bump github.com/spf13/cobra from 1.3.0 to 1.7.0 by @dependabot in #492
- Bump google.golang.org/grpc from 1.53.0 to 1.58.1 by @dependabot in #493
- Bump dependencies (kube client, prom model...) by @jotak in #497
- Bump dependencies (kube client, prom model...) by @jotak in #500
- NETOBSERV-1151: move flp decode grpc pipe to netobserv agent by @msherif1234 in #466
- Bump github.com/netsampler/goflow2 from 1.1.1-0.20220509155230-5300494e4785 to 1.3.6 by @dependabot in #498
- Bump github.com/minio/minio-go/v7 from 7.0.44 to 7.0.63 by @dependabot in #506
- Bump github.com/google/go-jsonnet from 0.19.1 to 0.20.0 by @dependabot in #507
- Add ingest_stdin by @ronensc in #488
- Bump github.com/spf13/viper from 1.10.1 to 1.16.0 by @dependabot in #505
- NETOBSERV-1352 enhance prom filters for RTT metrics by @jpinsonneau in #478
- Bump github.com/ip2location/ip2location-go/v9 from 9.2.0 to 9.6.0 by @dependabot in #510
- Bump google.golang.org/grpc from 1.58.1 to 1.58.2 by @dependabot in #509
- Bump github.com/benbjohnson/clock from 1.3.0 to 1.3.5 by @dependabot in #504
- Bump github.com/vmware/go-ipfix from 0.5.13 to 0.8.0 by @dependabot in #512
- Bump github.com/go-kit/kit from 0.12.0 to 0.13.0 by @dependabot in #511
- Bump github.com/prometheus/client_golang from 1.16.0 to 1.17.0 by @dependabot in #514
- Bump golang.org/x/net from 0.14.0 to 0.16.0 by @dependabot in #516
- Bump github.com/spf13/viper from 1.16.0 to 1.17.0 by @dependabot in #517
- Bump github.com/segmentio/kafka-go from 0.4.38 to 0.4.43 by @dependabot in #515
- NETOBSERV-1336: update netobserv agent to get DSCP support by @msherif1234 in #518
- Bump golang.org/x/net from 0.16.0 to 0.17.0 by @dependabot in #520
- Workflow: build images from release branches by @jotak in #524
- Bump google.golang.org/grpc from 1.58.2 to 1.58.3 by @dependabot in #522
- Bump github.com/segmentio/kafka-go from 0.4.43 to 0.4.44 by @dependabot in #523
- Bump k8s.io/apimachinery from 0.28.2 to 0.28.3 by @dependabot in #528
- Move Mountain View 2 kilometers south by @jotak in #534
- NETOBSERV-1379: enhance DNS debugging to dbg DNS over TCP by @msherif1234 in #533
- NETOBSERV-1247: using Meta informer for replicaSets by @msherif1234 in #474
- Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 by @dependabot in #535
- Allow multiple prometheus stages with different URLs by @KalmanMeth in #532
- Fix crash when metrics settings are unset by @jotak in #537
- Allow to start FLP directly from the flow logs producer by @jotak in #538
- NETOBSERV-1102: fine-tuning http server settings by @jotak in #545
- Bump github.com/ip2location/ip2location-go/v9 from 9.6.0 to 9.6.1 by @dependabot in #543
- Bump k8s.io/apimachinery from 0.28.3 to 0.28.4 by @dependabot in #540
- Bump k8s.io/api from 0.28.3 to 0.28.4 by @dependabot in #542
- Bump github.com/segmentio/kafka-go from 0.4.44 to 0.4.46 by @dependabot in #547
- Bump golang.org/x/net from 0.17.0 to 0.19.0 by @dependabot in #548
- Bump github.com/spf13/viper from 1.17.0 to 1.18.1 by @dependabot in #549
- Bump k8s.io/client-go from 0.28.3 to 0.29.0 by @dependabot in #555
- Bump github.com/minio/minio-go/v7 from 7.0.63 to 7.0.66 by @dependabot in #556
- Bump github.com/vmware/go-ipfix from 0.8.0 to 0.8.1 by @dependabot in #550
- Bump golang.org/x/crypto from 0.16.0 to 0.17.0 by @dependabot in #557
- Bump google.golang.org/protobuf from 1.31.0 to 1.32.0 by @dependabot in #559
- Bump github.com/spf13/viper from 1.18.1 to 1.18.2 by @dependabot in #560
- Bump github.com/vmware/go-ipfix from 0.8.1 to 0.8.2 by @dependabot in #558
- Bump google.golang.org/grpc from 1.59.0 to 1.60.1 by @dependabot in #561
- Bump github.com/prometheus/client_golang from 1.17.0 to 1.18.0 by @dependabot in #562
- Bump github.com/segmentio/kafka-go from 0.4.46 to 0.4.47 by @dependabot in #563
- Bump github.com/netsampler/goflow2 from 1.3.6 to 1.3.7 by @dependabot in #552
- NETOBSERV-1451: Bump ubi 9.3 / go 1.21 by @jotak in #564
- Bump github.com/ip2location/ip2location-go/v9 from 9.6.1 to 9.7.0 by @dependabot in #565
- NETOBSERV-1298: update netobserv agent package to pick duplist changes by @msherif1234 in #546
- Bump github.com/prometheus/common from 0.45.0 to 0.46.0 by @dependabot in #566
- NETOBSERV-1244: Add Kubernetes Infra transform rule by @OlivierCazade in #554
- Update prometheus common to v0.46.0-netobserv by @OlivierCazade in #574
- NETOBSERV-1203: Added option to add zones in k8s transform rule by @OlivierCazade in #575
- Adding k8s unit tests and some refactoring by @jotak in #578
- NETOBSERV-1308: fix minor vulnerabilities with location db by @jotak in #576
- Update docs and demo for opentelemetry by @KalmanMeth in #577
- Bump k8s.io/apimachinery from 0.29.0 to 0.29.1 by @dependabot in #571
- Bump go.opentelemetry.io/otel/metric from 1.21.0 to 1.22.0 by @dependabot in #570
- Bump k8s.io/client-go from 0.29.0 to 0.29.1 by @dependabot in #569
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace from 1.21.0 to 1.22.0 by @dependabot in #572
- Bump google.golang.org/grpc from 1.60.1 to 1.61.0 by @dependabot in #584
- Bump go.opentelemetry.io/otel/sdk/metric from 1.21.0 to 1.22.0 by @dependabot in #585
- Bump go.opentelemetry.io/otel/exporters/otlp/otlpmetric/otlpmetricgrpc from 0.44.0 to 0.45.0 by @dependabot in #582
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracehttp from 1.21.0 to 1.23.1 by @dependabot in #588
- Bump go.opentelemetry.io/otel/exporters/otlp/otlptrace/otlptracegrpc from 1.21.0 to 1.23.1 by @dependabot in #589
- Bump golang.org/x/net from 0.20.0 to 0.21.0 by @dependabot in htt...
v0.1.10
What's Changed
Breaking changes 🛠
- NETOBSERV-1063: Add TCP drop & DNS tracking to flowlogs-pipeline by @msherif1234 in #429
- NETOBSERV-1111: Add support for RoundTripTime in FLP. by @dushyantbehl in #446
- NETOBSERV-1017 extract timebased indexKeys by @jpinsonneau in #450
- move add_if and add_regex_if to transform_filter from transform_network by @KalmanMeth in #453
Non-breaking changes
- NETOBSERV-915 skip reinterpret direction for conversations by @jpinsonneau in #430
- Add encode s3 to pipeline builder by @jpinsonneau in #442
- Fix makefile imgae-build with podman by @jotak in #444
- fixed generation of flow logs for more connections by @KalmanMeth in #432
- Add IBM Z (s390x) by @jotak in #445
- NETOBSERV-1131: need to allow setting multiple filters by @jotak in #448
- Bump google.golang.org/grpc from 1.45.0 to 1.53.0 by @dependabot in #449
- changed error to warning by @KalmanMeth in #443
- NETOBSERV-1186: extract DNS flags rcode field and stringify it by @msherif1234 in #451
- Add msherif1234 by @jotak in #454
- NETOBSERV-1190: update DNS tracking to report latency instead of TS by @msherif1234 in #455
- Upgrade linter - fix found issues - use go1.20 by @jotak in #452
- fix ppc64le and s390x targets build by @msherif1234 in #458
- NETOBSERV-1197: Generalize TCPDrop to support more protocols by @msherif1234 in #457
- github ok-to-test: add more info in comment by @jotak in #456
- NETOBSERV-1111 Change RTT output to ns by @dushyantbehl in #468
- Add test for missing labels by @jotak in #463
- NETOBSERV-1208 & NETOBSERV-1233 Aggregators skip missing fields by @jpinsonneau in #470
- NETOBSERV-1135: add ovs subsystem drop causes by @msherif1234 in #472
- NETOBSERV-1233: Remove L3 fields for ARP ethtype packets and update unit-test by @msherif1234 in #471
- Update README and config by @ronensc in #475
- Fix loki writer config in README.md by @ronensc in #479
- NETOBSERV-1275: Introduce new "INNER" direction for inner-node traffic by @jotak in #483
New Contributors
- @dushyantbehl made their first contribution in #446
Full Changelog: v0.1.9...v0.1.10
v0.1.10-rc1
What's Changed
Non-breaking changes
- NETOBSERV-1111 Change RTT output to ns by @dushyantbehl in #468
- Add test for missing labels by @jotak in #463
- NETOBSERV-1208 & NETOBSERV-1233 Aggregators skip missing fields by @jpinsonneau in #470
Full Changelog: v0.1.10-rc0...v0.1.10-rc1
v0.1.10-rc0
What's Changed
Breaking changes 🛠
- NETOBSERV-1063: Add TCP drop & DNS tracking to flowlogs-pipeline by @msherif1234 in #429
- NETOBSERV-1111: Add support for RoundTripTime in FLP. by @dushyantbehl in #446
Non-breaking changes
- NETOBSERV-915 skip reinterpret direction for conversations by @jpinsonneau in #430
- Add encode s3 to pipeline builder by @jpinsonneau in #442
- Fix makefile imgae-build with podman by @jotak in #444
- fixed generation of flow logs for more connections by @KalmanMeth in #432
- Add IBM Z (s390x) by @jotak in #445
- NETOBSERV-1131: need to allow setting multiple filters by @jotak in #448
- Bump google.golang.org/grpc from 1.45.0 to 1.53.0 by @dependabot in #449
- changed error to warning by @KalmanMeth in #443
- NETOBSERV-1186: extract DNS flags rcode field and stringify it by @msherif1234 in #451
- Add msherif1234 by @jotak in #454
- NETOBSERV-1190: update DNS tracking to report latency instead of TS by @msherif1234 in #455
- Upgrade linter - fix found issues - use go1.20 by @jotak in #452
- fix ppc64le and s390x targets build by @msherif1234 in #458
- NETOBSERV-1197: Generalize TCPDrop to support more protocols by @msherif1234 in #457
- github ok-to-test: add more info in comment by @jotak in #456
- NETOBSERV-1017 extract timebased indexKeys by @jpinsonneau in #450
New Contributors
- @dushyantbehl made their first contribution in #446
Full Changelog: v0.1.9...v0.1.10-rc0
v0.1.9
What's Changed
Breaking changes 🛠
- Move prometheus server to main by @KalmanMeth in #399
- make expiryTime in encode_prom into a Duration by @KalmanMeth in #411
- shorten default timeout for aggregate; allow configuration of timeout for aggregates by @KalmanMeth in #418
Non-breaking changes
- NETOBSERV-838 Group ingress+egress flows in same connection by @jpinsonneau in #387
- bump golang.org/x/net from 0.5.0 to 0.7.0 by @dependabot in #393
- Avoid searching new connections in the multi-ordered-map by @ronensc in #397
- conntrack: handle TCP flags by @ronensc in #391
- fix e2e test by @KalmanMeth in #402
- add config parameter to suppress go metrics by @KalmanMeth in #394
- Increasing test coverage by @jotak in #401
- Remove unused (?) codecov secret by @jotak in #400
- Test ConvertToBool by @ronensc in #403
- tcp flags: Update readme and default configuration by @ronensc in #410
- NETOBSERV-924 adapt to new ovn annotation format by @jotak in #404
- Expose cache size as an operational metric by @KalmanMeth in #398
- Add ingest stage to provide synthetic workload for benchmarks by @KalmanMeth in #395
- conntrack: Fix a bug in swapAB by @ronensc in #415
- NETOBSERV-962 - ADD write ipfix stage to pipeline builder by @acmenezes in #414
- NETOBSERV-973 skip duplicates by @jpinsonneau in #421
- Conntrack output field copy operations + fix duplicates by @jpinsonneau in #413
- conntrack: Add operational metrics on errors for hash computation and aggregators by @ronensc in #416
- NETOBSERV-934: Add icmpv4/v6 bits to FLP by @msherif1234 in #408
- NETOBSERV-984 - KafkaInterBrokerProtocalVersion throws warning and has ingestion errors by @jpinsonneau in #428
- NETOBSERV-994 FLP multiarch consistency by @jpinsonneau in #426
- Remove error logs in processing loop by @jotak in #431
- fix makefile by @msherif1234 in #433
- fix github ci image argument by @jpinsonneau in #436
- fix manifset build by @msherif1234 in #435
- Update workflow, setup workflow-test by @jotak in #438
- NETOBSERV-974 Implement SASL for Kafka (producer+consumer) by @jotak in #424
- Fix naming of k8s entries to ipfix export by @praveingk in #427
- Bump ubi-9.2 by @jotak in #440
New Contributors
- @acmenezes made their first contribution in #414
- @msherif1234 made their first contribution in #408
Full Changelog: v0.1.8...v0.1.9
v0.1.9-rc2
What's Changed
Breaking changes 🛠
- shorten default timeout for aggregate; allow configuration of timeout for aggregates
Non-breaking changes
- Add icmpv4/v6 bits to FLP
- KafkaInterBrokerProtocalVersion throws warning and has ingestion errors
- FLP multiarch consistency
- Remove error logs in processing loop
Full Changelog: v0.1.9-rc1...v0.1.9-rc2
v0.1.9-rc1
Connection tracking
- Updated
endConnection
logic and addedTerminatingTimeout
- Added operations
first
&last
to keep informations for first / last flow
API
- Added missing
WriteIpfix
helpers
v0.1.9-rc0
add config parameter to suppress go metrics (#394) * suppress Go metrics and document metrics settings * changed metrics-settings back to metricsSettings