Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove a plugins can lead to stop of executor #608

Closed
tchiotludo opened this issue May 18, 2022 · 0 comments
Closed

Remove a plugins can lead to stop of executor #608

tchiotludo opened this issue May 18, 2022 · 0 comments
Labels
area/backend Needs backend code changes bug Something isn't working

Comments

@tchiotludo
Copy link
Member

🆚 [context: default] [date: 2022-05-18T15:37:37.838Z] [logger: org.apache.kafka.clients.consumer.internals.ConsumerCoordinator] [severity: WARN] [thread: kafka-coordinator-heartbeat-thread | kestra_executor_main] [Consumer instanceId=dev-kestra-executor-d555865d6-88cp5-1, clientId=io.kestra.runner.kafka.executors.ExecutorMain-StreamThread-1-consumer, groupId=kestra_executor_main] consumer poll timeout has expired. This means the time between subsequent calls to poll() was longer than the configured max.poll.interval.ms, which typically implies that the poll loop is spending too much time processing messages. You can address this either by increasing max.poll.interval.ms or by reducing the maximum size of batches returned in poll() with max.poll.records.

This is caused I think because we wait for the flow and will never found it (invalid flow maybe because of invalid type?). Seems the executor :

  • is waiting
  • raise the error consumer poll timeout has expired
  • the consumer group is removed from kafka
  • no more activity and freeze
@tchiotludo tchiotludo added bug Something isn't working area/backend Needs backend code changes component: runner labels May 18, 2022
@tchiotludo tchiotludo moved this to Backlog in All issues May 18, 2022
Repository owner moved this from Backlog to Done in All issues Sep 20, 2022
@tchiotludo tchiotludo reopened this Sep 20, 2022
Repository owner moved this from Done to In Progress in All issues Sep 20, 2022
Repository owner moved this from In Progress to Done in All issues Sep 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backend Needs backend code changes bug Something isn't working
Projects
No open projects
Archived in project
Development

No branches or pull requests

1 participant