CI Failure (Failed to get OCSF server version) in AuditLogTestsKafkaApi.test_management

[vbotbuildovich]

https://buildkite.com/redpanda/vtools/builds/10423

Module: rptest.tests.audit_log_test
Class: AuditLogTestsKafkaApi
Method: test_management

test_id:    AuditLogTestsKafkaApi.test_management
status:     FAIL
run time:   140.122 seconds

TimeoutError('Could not get API version from http://ip-172-31-9-50:8000/api/version')
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 159, in _new_conn
    conn = connection.create_connection(
  File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 84, in create_connection
    raise err
  File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 74, in create_connection
    sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 670, in urlopen
    httplib_response = self._make_request(
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 392, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python3.10/http/client.py", line 1283, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.10/http/client.py", line 1329, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
    self.send(msg)
  File "/usr/lib/python3.10/http/client.py", line 976, in send
    self.connect()
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 187, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 164, in _new_conn
    raise ConnectTimeoutError(
urllib3.exceptions.ConnectTimeoutError: (<urllib3.connection.HTTPConnection object at 0x7fbcb9095c90>, 'Connection to ip-172-31-9-50 timed out. (connect timeout=None)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 726, in urlopen
    retries = retries.increment(
  File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 446, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='ip-172-31-9-50', port=8000): Max retries exceeded with url: /api/version (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7fbcb9095c90>, 'Connection to ip-172-31-9-50 timed out. (connect timeout=None)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 44, in wait_until
    if condition():
  File "/home/ubuntu/redpanda/tests/rptest/util.py", line 77, in wrapped_condition
    cond = condition()
  File "/home/ubuntu/redpanda/tests/rptest/services/ocsf_server.py", line 81, in _wait_for_api_version
    r = requests.get(uri)
  File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/requests/api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 530, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 643, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 504, in send
    raise ConnectTimeout(e, request=request)
requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='ip-172-31-9-50', port=8000): Max retries exceeded with url: /api/version (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7fbcb9095c90>, 'Connection to ip-172-31-9-50 timed out. (connect timeout=None)'))

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 182, in _do_run
    self.setup_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 260, in setup_test
    self.test.setup()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/test.py", line 91, in setup
    self.setUp()
  File "/home/ubuntu/redpanda/tests/rptest/tests/audit_log_test.py", line 309, in setUp
    f'Running OCSF Server Version {self.ocsf_server.get_api_version(None)}'
  File "/home/ubuntu/redpanda/tests/rptest/services/ocsf_server.py", line 86, in get_api_version
    r = wait_until_result(_wait_for_api_version,
  File "/home/ubuntu/redpanda/tests/rptest/util.py", line 90, in wait_until_result
    wait_until(wrapped_condition, *args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: Could not get API version from http://ip-172-31-9-50:8000/api/version

[vbotbuildovich]

*https://buildkite.com/redpanda/vtools/builds/10446
*https://buildkite.com/redpanda/vtools/builds/10450

[vbotbuildovich]

*https://buildkite.com/redpanda/vtools/builds/10456
*https://buildkite.com/redpanda/vtools/builds/10461