Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Azure] azure-eventhub input fails to start on Windows due to "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'" error #40608

Closed
zmoog opened this issue Aug 24, 2024 · 5 comments · Fixed by #40609
Assignees
Labels
bug Team:obs-ds-hosted-services Label for the Observability Hosted Services team

Comments

@zmoog
Copy link
Contributor

zmoog commented Aug 24, 2024

- module: azure
  # All logs
  activitylogs:
    enabled: true
    var:
      # eventhub name containing the activity logs, overwrite he default value if the logs are exported in a different eventhub
      eventhub: "activitylogs"
      # consumer group name that has access to the event hub, we advise creating a dedicated consumer group for the azure module
      consumer_group: "$Default"
      # the connection string required to communicate with Event Hubs, steps to generate one here https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-get-connection-string
      connection_string: "<redacted>"
      # the name of the storage account the state/offsets will be stored and updated
      storage_account: "mbrancageneral"
      # the name of the storage account container you would like to store the offset information in.
      storage_account_container: "<redacted>"
      # the storage account key, this key will be used to authorize access to data in your storage account
      storage_account_key: "<redacted>"

Filebeat 8.15.0 on Windows fails to run the azure-eventhub input with the following error:

{
  "log.level": "error",
  "@timestamp": "2024-08-24T13:16:00.930Z",
  "message": "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'",
  "component": {
    "binary": "filebeat",
    "dataset": "elastic_agent.filebeat",
    "id": "azure-eventhub-default",
    "type": "azure-eventhub"
  },
  "log": {
    "source": "azure-eventhub-default"
  },
  "log.origin": {
    "file.line": 139,
    "file.name": "cfgfile/list.go",
    "function": "github.com/elastic/beats/v7/libbeat/cfgfile.(*RunnerList).Reload"
  },
  "service.name": "filebeat",
  "ecs.version": "1.6.0",
  "log.logger": "centralmgmt"
}
@zmoog zmoog self-assigned this Aug 24, 2024
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Aug 24, 2024
@zmoog zmoog added bug and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 24, 2024
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Aug 24, 2024
@zmoog zmoog added Team:obs-ds-hosted-services Label for the Observability Hosted Services team and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 24, 2024
@elasticmachine
Copy link
Collaborator

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

@zmoog
Copy link
Contributor Author

zmoog commented Aug 24, 2024

During the input upgrade from Filebeat input v1 to v2 #39511, I missed registering the plugin for the Windows platform.

This bug seems to affect v8.15.0 only on the Windows platform. Linux and macOS seem to work correctly. If you are on Windows, please stay on v8.14.3 until v8.15.1 is available.

@zmoog zmoog changed the title azure-eventhub input fails to start on Windows due to "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'" [Azure] azure-eventhub input fails to start on Windows due to "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'" Aug 24, 2024
@zmoog zmoog changed the title [Azure] azure-eventhub input fails to start on Windows due to "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'" [Azure] azure-eventhub input fails to start on Windows due to "Error creating runner from config: Error creating input. No such input type exist: 'azure-eventhub'" error Aug 24, 2024
@zmoog zmoog added backport-8.15 Automated backport to the 8.15 branch with mergify and removed backport-8.15 Automated backport to the 8.15 branch with mergify labels Aug 24, 2024
@nicpenning
Copy link
Contributor

@zmoog, by the way, this was reported many days before it was found on reddit in the official Elastic community.

Do you monitor that?

https://elasticstack.slack.com/archives/CNEDGGJQ3/p1723645981755829?thread_ts=1723645981.755829&cid=CNEDGGJQ3

@zmoog
Copy link
Contributor Author

zmoog commented Aug 28, 2024

@zmoog, by the way, this was reported many days before it was found on reddit in the official Elastic community.

Do you monitor that?

https://elasticstack.slack.com/archives/CNEDGGJQ3/p1723645981755829?thread_ts=1723645981.755829&cid=CNEDGGJQ3

@nicpenning, thanks for sharing the link to the community Slack conversation! I personally discovered the issue when a developer shared the link to the Reddit conversation on Aug 24.

I'm sorry for not being able to answer earlier and address the problem more promptly! I'm checking with the team to see how we can work more effectively with the community.

In the meantime, you can mention me on GitHub for Azure-related topics, and I'll try to help you as much as possible.

@nicpenning
Copy link
Contributor

Sounds great thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Team:obs-ds-hosted-services Label for the Observability Hosted Services team
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants