Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test to demonstrate that OpenSearch does not start up with plain v6 configuration #4745

Closed
wants to merge 1 commit into from

Conversation

nibix
Copy link
Collaborator

@nibix nibix commented Sep 22, 2024

Description

Do not merge!

This is just a test implementation that demonstrates that currently OpenSearch is not able to start up based on a plain legacy v6 configuration.

The test leads to a cluster startup failure with these errors:

2024-09-22 09:48:48 opensearch[cluster_manager_1][clusterManagerService#updateTask][T#1] INFO  PluginsService:310 - PluginService:onIndexModule index:[.opendistro_security/V2k5ExEPQeCxgfqCqFPEfA]
2024-09-22 09:48:48 opensearch[cluster_manager_1][clusterManagerService#updateTask][T#1] INFO  MetadataMappingService:326 - [.opendistro_security/V2k5ExEPQeCxgfqCqFPEfA] update_mapping [_doc]
2024-09-22 09:48:48 opensearch[cluster_manager_1][transport_worker][T#10] WARN  ConfigurationLoaderSecurity7:183 - No data for tenants while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES]  (index=.opendistro_security)
2024-09-22 09:48:48 opensearch[data_0][system_read][T#1] WARN  ConfigurationLoaderSecurity7:183 - No data for tenants while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES]  (index=.opendistro_security)
2024-09-22 09:48:48 opensearch[cluster_manager_0][transport_worker][T#9] WARN  ConfigurationLoaderSecurity7:183 - No data for tenants while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES]  (index=.opendistro_security)
2024-09-22 09:48:48 opensearch[cluster_manager_2][transport_worker][T#9] WARN  ConfigurationLoaderSecurity7:183 - No data for tenants while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES]  (index=.opendistro_security)
2024-09-22 09:48:48 opensearch[data_1][system_read][T#1] WARN  ConfigurationLoaderSecurity7:183 - No data for tenants while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES]  (index=.opendistro_security)
WARNING: A restricted method in java.lang.foreign.Linker has been called
WARNING: java.lang.foreign.Linker::downcallHandle has been called by the unnamed module
WARNING: Use --enable-native-access=ALL-UNNAMED to avoid a warning for this module

2024-09-22 09:48:58 SUITE-LegacyConfigV6AutoConversionTest-seed#[EA8291E27E18659E] ERROR LocalCluster:258 - Local ES cluster start failed
java.lang.RuntimeException: ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
	at org.opensearch.test.framework.cluster.LocalCluster.triggerConfigurationReload(LocalCluster.java:294) ~[integrationTest/:?]
	at org.opensearch.test.framework.cluster.LocalCluster.initSecurityIndex(LocalCluster.java:272) ~[integrationTest/:?]
	at org.opensearch.test.framework.cluster.LocalCluster.start(LocalCluster.java:248) [integrationTest/:?]
	at org.opensearch.test.framework.cluster.LocalCluster.before(LocalCluster.java:150) [integrationTest/:?]
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50) [junit-4.13.2.jar:4.13.2]
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:426) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:716) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138) [randomizedtesting-runner-2.8.1.jar:?]
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:637) [randomizedtesting-runner-2.8.1.jar:?]

java.lang.RuntimeException: ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
java.lang.RuntimeException: java.lang.RuntimeException: ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
	at __randomizedtesting.SeedInfo.seed([EA8291E27E18659E]:0)
	at org.opensearch.test.framework.cluster.LocalCluster.start(LocalCluster.java:259)
	at org.opensearch.test.framework.cluster.LocalCluster.before(LocalCluster.java:150)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:426)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:716)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:637)
Caused by: java.lang.RuntimeException: ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
	at org.opensearch.test.framework.cluster.LocalCluster.triggerConfigurationReload(LocalCluster.java:294)
	at org.opensearch.test.framework.cluster.LocalCluster.initSecurityIndex(LocalCluster.java:272)
	at org.opensearch.test.framework.cluster.LocalCluster.start(LocalCluster.java:248)
	... 9 more


ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
java.lang.RuntimeException: ConfigUpdateResponse produced failures: [FailedNodeException[Failed node [wtldg___T_-ewOir_____w]]; nested: RemoteTransportException[[data_0][127.0.0.1:47310][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: TimeoutException[Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [yaLASgAAQAC746CY_____w]]; nested: RemoteTransportException[[data_1][127.0.0.1:47311][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [Kgswtv__T_-Xj0eI_____w]]; nested: RemoteTransportException[[cluster_manager_2][127.0.0.1:47302][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [w6j1YwAAQACR-jP8_____w]]; nested: RemoteTransportException[[cluster_manager_0][127.0.0.1:47300][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];, FailedNodeException[Failed node [NaXKCgAAQACAVbO______w]]; nested: RemoteTransportException[[cluster_manager_1][127.0.0.1:47301][cluster:admin/opendistro_security/config/update[n]]]; nested: OpenSearchException[java.util.concurrent.TimeoutException: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)]; nested: NotSerializableExceptionWrapper[timeout_exception: Timeout after 10SECONDS while retrieving configuration for [ROLESMAPPING, NODESDN, WHITELIST, CONFIG, TENANTS, AUDIT, ACTIONGROUPS, INTERNALUSERS, ALLOWLIST, ROLES](index=.opendistro_security)];]
	at org.opensearch.test.framework.cluster.LocalCluster.triggerConfigurationReload(LocalCluster.java:294)
	at org.opensearch.test.framework.cluster.LocalCluster.initSecurityIndex(LocalCluster.java:272)
	at org.opensearch.test.framework.cluster.LocalCluster.start(LocalCluster.java:248)
	at org.opensearch.test.framework.cluster.LocalCluster.before(LocalCluster.java:150)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:426)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:716)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:637)
  • Category (Enhancement, New feature, Bug fix, Test fix, Refactoring, Maintenance, Documentation)
  • Why these changes are required?
  • What is the old behavior before changes and new behavior after changes?

Issues Resolved

[List any issues this PR will resolve]

Is this a backport? If so, please add backport PR # and/or commits #, and remove backport-failed label from the original PR.

Do these changes introduce new permission(s) to be displayed in the static dropdown on the front-end? If so, please open a draft PR in the security dashboards plugin and link the draft PR here

Testing

[Please provide details of testing done: unit testing, integration testing and manual testing]

Check List

  • New functionality includes testing
  • New functionality has been documented
  • New Roles/Permissions have a corresponding security dashboards plugin PR
  • API changes companion pull request created
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

…onfiguration

Signed-off-by: Nils Bandener <nils.bandener@eliatra.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant