Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporter/syslog] Add syslog exporter #19647

Merged
merged 12 commits into from
May 15, 2023

Conversation

kasia-kujawa
Copy link
Contributor

Description: Adding syslog exporter implementation

Link to tracking Issue: #17982

Testing: unit tests, manual tests with syslog server

Documentation: please see README.md file

@linux-foundation-easycla
Copy link

linux-foundation-easycla bot commented Mar 14, 2023

CLA Signed

The committers listed above are authorized under a signed CLA.

  • ✅ login: kkujawa-sumo / name: Katarzyna Kujawa (24eae193dceb6210e3b33efc38e58d206fa9b497)

@kasia-kujawa kasia-kujawa reopened this Mar 14, 2023
@kasia-kujawa kasia-kujawa reopened this Mar 14, 2023
@kasia-kujawa kasia-kujawa reopened this Mar 14, 2023
@kasia-kujawa kasia-kujawa marked this pull request as ready for review March 14, 2023 13:05
@kasia-kujawa kasia-kujawa requested review from a team and TylerHelmuth March 14, 2023 13:06
@kasia-kujawa kasia-kujawa reopened this Mar 14, 2023
@kasia-kujawa kasia-kujawa marked this pull request as draft March 14, 2023 13:06
@kasia-kujawa kasia-kujawa reopened this Mar 14, 2023
@kasia-kujawa kasia-kujawa marked this pull request as ready for review March 14, 2023 14:10
@kasia-kujawa
Copy link
Contributor Author

This pull request is ready for review :)
cc: @astencel-sumo @djaglowski

@runforesight
Copy link

runforesight bot commented Mar 15, 2023

Foresight Summary

    
Major Impacts
Foresight hasn't detected any major impact on your workflows and tests.

View More Details

⭕  build-and-test-windows workflow has finished in 7 seconds (30 minutes 45 seconds less than main branch avg.) and finished at 10th Apr, 2023.


Job Failed Steps Tests
windows-unittest-matrix -     🔗  N/A See Details
windows-unittest -     🔗  N/A See Details

✅  telemetrygen workflow has finished in 59 seconds and finished at 10th Apr, 2023.


Job Failed Steps Tests
publish-latest -     🔗  N/A See Details
build-dev -     🔗  N/A See Details
publish-stable -     🔗  N/A See Details

✅  check-links workflow has finished in 2 minutes 8 seconds (⚠️ 1 minute 9 seconds more than main branch avg.) and finished at 10th Apr, 2023.


Job Failed Steps Tests
changed files -     🔗  N/A See Details
check-links -     🔗  N/A See Details

✅  changelog workflow has finished in 2 minutes 21 seconds and finished at 10th Apr, 2023.


Job Failed Steps Tests
changelog -     🔗  N/A See Details

✅  build-and-test workflow has finished in 43 minutes 12 seconds and finished at 10th Apr, 2023.


Job Failed Steps Tests
unittest-matrix (1.19, connector) -     🔗  ✅ 126  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, connector) -     🔗  ✅ 126  ❌ 0  ⏭ 0    🔗 See Details
correctness-traces -     🔗  ✅ 17  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, internal) -     🔗  ✅ 583  ❌ 0  ⏭ 0    🔗 See Details
correctness-metrics -     🔗  ✅ 2  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, processor) -     🔗  ✅ 1557  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, internal) -     🔗  ✅ 583  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, extension) -     🔗  ✅ 544  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, extension) -     🔗  ✅ 544  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, processor) -     🔗  ✅ 1557  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, receiver-0) -     🔗  ✅ 2616  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, receiver-0) -     🔗  ✅ 2616  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, exporter) -     🔗  ✅ 2524  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, receiver-1) -     🔗  ✅ 1965  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, receiver-1) -     🔗  ✅ 1965  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, exporter) -     🔗  ✅ 2524  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.20, other) -     🔗  ✅ 4761  ❌ 0  ⏭ 0    🔗 See Details
unittest-matrix (1.19, other) -     🔗  ✅ 4761  ❌ 0  ⏭ 0    🔗 See Details
integration-tests -     🔗  ✅ 56  ❌ 0  ⏭ 0    🔗 See Details
setup-environment -     🔗  N/A See Details
check-collector-module-version -     🔗  N/A See Details
check-codeowners -     🔗  N/A See Details
checks -     🔗  N/A See Details
lint-matrix (receiver-0) -     🔗  N/A See Details
lint-matrix (receiver-1) -     🔗  N/A See Details
lint-matrix (processor) -     🔗  N/A See Details
lint-matrix (exporter) -     🔗  N/A See Details
lint-matrix (extension) -     🔗  N/A See Details
lint-matrix (connector) -     🔗  N/A See Details
lint-matrix (internal) -     🔗  N/A See Details
lint-matrix (other) -     🔗  N/A See Details
build-examples -     🔗  N/A See Details
unittest (1.20) -     🔗  N/A See Details
unittest (1.19) -     🔗  N/A See Details
lint -     🔗  N/A See Details
cross-compile (darwin, amd64) -     🔗  N/A See Details
cross-compile (darwin, arm64) -     🔗  N/A See Details
cross-compile (linux, 386) -     🔗  N/A See Details
cross-compile (linux, amd64) -     🔗  N/A See Details
cross-compile (linux, arm) -     🔗  N/A See Details
cross-compile (linux, arm64) -     🔗  N/A See Details
cross-compile (linux, ppc64le) -     🔗  N/A See Details
cross-compile (windows, 386) -     🔗  N/A See Details
cross-compile (windows, amd64) -     🔗  N/A See Details
build-package (deb) -     🔗  N/A See Details
build-package (rpm) -     🔗  N/A See Details
windows-msi -     🔗  N/A See Details
publish-check -     🔗  N/A See Details
publish-stable -     🔗  N/A See Details
publish-dev -     🔗  N/A See Details

✅  prometheus-compliance-tests workflow has finished in 10 minutes 23 seconds (⚠️ 4 minutes 4 seconds more than main branch avg.) and finished at 10th Apr, 2023.


Job Failed Steps Tests
prometheus-compliance-tests -     🔗  ✅ 21  ❌ 0  ⏭ 0    🔗 See Details

✅  load-tests workflow has finished in 15 minutes 3 seconds (⚠️ 4 minutes 42 seconds more than main branch avg.) and finished at 10th Apr, 2023.


Job Failed Steps Tests
loadtest (TestTraceAttributesProcessor) -     🔗  ✅ 3  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestIdleMode) -     🔗  ✅ 1  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestMetric10kDPS|TestMetricsFromFile) -     🔗  ✅ 6  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestTraceBallast1kSPSWithAttrs|TestTraceBallast1kSPSAddAttrs) -     🔗  ✅ 10  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestMetricResourceProcessor|TestTrace10kSPS) -     🔗  ✅ 12  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestTraceNoBackend10kSPS|TestTrace1kSPSWithAttrs) -     🔗  ✅ 8  ❌ 0  ⏭ 0    🔗 See Details
loadtest (TestBallastMemory|TestLog10kDPS) -     🔗  ✅ 18  ❌ 0  ⏭ 0    🔗 See Details
setup-environment -     🔗  N/A See Details

✅  e2e-tests workflow has finished in 16 minutes 41 seconds (⚠️ 2 minutes 35 seconds more than main branch avg.) and finished at 10th Apr, 2023.


Job Failed Steps Tests
kubernetes-test (v1.26.0) -     🔗  N/A See Details
kubernetes-test (v1.24.7) -     🔗  N/A See Details
kubernetes-test (v1.25.3) -     🔗  N/A See Details
kubernetes-test (v1.23.13) -     🔗  N/A See Details

🔎 See details on Foresight

*You can configure Foresight comments in your organization settings page.

@kasia-kujawa kasia-kujawa force-pushed the kkujawa-syslogexporter branch 2 times, most recently from a40f1a1 to 9cf9443 Compare May 5, 2023 08:31
@kasia-kujawa
Copy link
Contributor Author

@astencel-sumo @djaglowski please take a look once again ;)
I created following issues which must be done before giving this exporter alpha status:

[syslog_receiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/syslogreceiver
[filelog_receiver]: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/filelogreceiver
[cryptoTLS]: https://github.com/golang/go/blob/518889b35cb07f3e71963f2ccfc0f96ee26a51ce/src/crypto/tls/common.go#L706-L709
[development]: https://github.com/open-telemetry/opentelemetry-collector#development
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This line is probably not needed anymore, as the link is being autogenerated together with the status table.

Suggested change
[development]: https://github.com/open-telemetry/opentelemetry-collector#development

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kkujawa-sumo, please take note of this. It can be done in a follow up PR.

@andrzej-stencel
Copy link
Member

Not sure where the check errors come from:

  • check-collector-module-version:
    Incorrect version "v0.76.1" of "go.opentelemetry.io/collector " is included in "./exporter/syslogexporter/go.mod". It should be version "v0.76.2-0.20230502195822-4df44379e094".
  • checks:
    'status' has invalid keys: pipelines
    'status.stability' expected a map, got 'string'

Perhaps you need to merge the latest changes from main? 🤔

@dmitryax
Copy link
Member

dmitryax commented May 9, 2023

@kkujawa-sumo please rebase, run make gotidy and update metadata.yaml to the latest schema

kasia-kujawa and others added 11 commits May 15, 2023 08:51
Signed-off-by: Katarzyna Kujawa <kkujawa@sumologic.com>

Co-authored-by: Raj Nishtala <rnishtala@sumologic.com>
problem reported by golangci-lint
sender.go:57:71: unexported-return: exported func Connect returns unexported type *syslogexporter.sender, which can be annoying to use
(revive)
func Connect(logger *zap.Logger, cfg *Config, tlsConfig *tls.Config) (*sender, error) {
- replace protocol with network
- replace format with protocol
@kasia-kujawa kasia-kujawa force-pushed the kkujawa-syslogexporter branch from 9cf9443 to 6d46774 Compare May 15, 2023 07:27
@kasia-kujawa kasia-kujawa force-pushed the kkujawa-syslogexporter branch from 6d46774 to c626d4c Compare May 15, 2023 08:34
@kasia-kujawa
Copy link
Contributor Author

@dmitryax All checks passed :) could you merge this pull request?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants