Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[exporter/clickhouse] Add persistent queue configuration to clickhouseexporter #27653

Closed
fredthomsen opened this issue Oct 12, 2023 · 4 comments
Assignees
Labels

Comments

@fredthomsen
Copy link
Contributor

Component(s)

exporter/clickhouse

Is your feature request related to a problem? Please describe.

Currently the clickhouseexporter only supports setting QueueSize from exporterhelper.QueueSettings: https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/exporter/clickhouseexporter/config.go#L81, thus in the event of the collector going down, data queued for export is not persisted.

Describe the solution you'd like

Update clickhouseexporter configuration to add the ability to specify *component.ID to enable persistence.

Describe alternatives you've considered

No response

Additional context

No response

@fredthomsen fredthomsen added enhancement New feature or request needs triage New item requiring triage labels Oct 12, 2023
@github-actions
Copy link
Contributor

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@fredthomsen fredthomsen changed the title Add persistent queue configuration to clickhouseexporter [exporter/clickhouse] Add persistent queue configuration to clickhouseexporter Oct 12, 2023
@dmitryax
Copy link
Member

It's unclear to me why the queue in this exporter was implemented in such a hardcoded way. It seems pretty reasonable to make it support the whole set of queue configurations. @fredthomsen do you want to submit a PR?

@fredthomsen
Copy link
Contributor Author

@dmitryax I had the same question, and yes, I will submit a PR.

fredthomsen added a commit to fredthomsen/opentelemetry-collector-contrib that referenced this issue Oct 26, 2023
fredthomsen added a commit to fredthomsen/opentelemetry-collector-contrib that referenced this issue Oct 27, 2023
@crobert-1
Copy link
Member

Removing needs triage based on Dmitrii's comment.

@crobert-1 crobert-1 removed the needs triage New item requiring triage label Oct 27, 2023
dmitryax pushed a commit that referenced this issue Oct 29, 2023
Addresses #27653.

**Description:**
Added persistent storage queue support by leveraging default
`exporthelper.QueueSettings` config structure.

**NOTE** This does end up being a **breaking** change to the API.
jmsnll pushed a commit to jmsnll/opentelemetry-collector-contrib that referenced this issue Nov 12, 2023
…8579)

Addresses open-telemetry#27653.

**Description:**
Added persistent storage queue support by leveraging default
`exporthelper.QueueSettings` config structure.

**NOTE** This does end up being a **breaking** change to the API.
RoryCrispin pushed a commit to ClickHouse/opentelemetry-collector-contrib that referenced this issue Nov 24, 2023
…8579)

Addresses open-telemetry#27653.

**Description:**
Added persistent storage queue support by leveraging default
`exporthelper.QueueSettings` config structure.

**NOTE** This does end up being a **breaking** change to the API.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants