CI Failure (Failed to commit offsets to transaction on broker) in TransactionsStreamsTest.consumer_offsets_retention_test

[vbotbuildovich]

https://buildkite.com/redpanda/redpanda/builds/48583
https://buildkite.com/redpanda/redpanda/builds/48623

Module: rptest.tests.transactions_test
Class: TransactionsStreamsTest
Method: consumer_offsets_retention_test

test_id:    TransactionsStreamsTest.consumer_offsets_retention_test
status:     FAIL
run time:   40.179 seconds

KafkaException(KafkaError{code=UNKNOWN,val=-1,str="Failed to commit offsets to transaction on broker docker-rp-24:9092/2: topic-nnodzilqek[0](Unknown broker error) (after 3ms)"})
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 103, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/transactions_test.py", line 922, in consumer_offsets_retention_test
    producer.send_offsets_to_transaction(
cimpl.KafkaException: KafkaError{code=UNKNOWN,val=-1,str="Failed to commit offsets to transaction on broker docker-rp-24:9092/2: topic-nnodzilqek[0](Unknown broker error) (after 3ms)"}

JIRA Link: CORE-2758

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/48727

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/48735

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/48777

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/48982

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/49076

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/49199
*https://buildkite.com/redpanda/redpanda/builds/49251
*https://buildkite.com/redpanda/redpanda/builds/49288
*https://buildkite.com/redpanda/redpanda/builds/49306
*https://buildkite.com/redpanda/redpanda/builds/49357
*https://buildkite.com/redpanda/redpanda/builds/49365
*https://buildkite.com/redpanda/redpanda/builds/49359

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/49389

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/49553

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/49777
*https://buildkite.com/redpanda/redpanda/builds/49791
*https://buildkite.com/redpanda/redpanda/builds/49806

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/50042

[bharathv]

likely stale, a lot of changes went in we can reopen if needed.

[ztlpn]

Fresh instance in v23.3.x branch: https://buildkite.com/redpanda/redpanda/builds/54084#0191c6d8-52e5-4708-abc6-6961c38dce06