Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI Failure (TimeoutError waiting consumer) in ShadowIndexingTxTest.test_shadow_indexing_aborted_txs #11280

Closed
andijcr opened this issue Jun 7, 2023 · 1 comment
Labels
Milestone

Comments

@andijcr
Copy link
Contributor

andijcr commented Jun 7, 2023

https://buildkite.com/redpanda/redpanda/builds/30762#01889476-123d-4db9-b137-66a2fdbfc208

Module: rptest.tests.shadow_indexing_tx_test
Class:  ShadowIndexingTxTest
Method: test_shadow_indexing_aborted_txs
Arguments:
{
  "cloud_storage_type": 2
}
====================================================================================================
test_id:    rptest.tests.shadow_indexing_tx_test.ShadowIndexingTxTest.test_shadow_indexing_aborted_txs.cloud_storage_type=CloudStorageType.ABS
status:     FAIL
run time:   10 minutes 45.006 seconds


    TimeoutError(None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 79, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/utils/mode_checks.py", line 63, in f
    return func(*args, **kwargs)
  File "/root/tests/rptest/tests/shadow_indexing_tx_test.py", line 99, in test_shadow_indexing_aborted_txs
    consumer.wait()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/services/service.py", line 261, in wait
    if not self.wait_node(node, end - now):
  File "/root/tests/rptest/services/kgo_verifier_services.py", line 181, in wait_node
    self._redpanda.wait_until(lambda: self._status.active is False or self.
  File "/root/tests/rptest/services/redpanda.py", line 1981, in wait_until
    wait_until(wrapped,
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: None
@rystsov
Copy link
Contributor

rystsov commented Jun 14, 2023

It looks like KgoVerifierSeqConsumer is stuck: I don't see it requesting any data (processing name:fetch is missing in the logs) from RP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants