Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] LeaderPartition cannot be cast to StreamPartition #5167

Open
vincentpham13 opened this issue Nov 2, 2024 · 2 comments
Open

[BUG] LeaderPartition cannot be cast to StreamPartition #5167

vincentpham13 opened this issue Nov 2, 2024 · 2 comments
Assignees
@graytaylor0
Labels
question Further information is requested

Comments

@vincentpham13
Copy link

Describe the bug
I'm using docker compose which starts an opensearch node and a data-prepper server.
My pipeline is using DynamoDB (AWS not Local) as source, the created opensearch node as sink.
The error is about casting a value from the LeaderPartition type to the StreamPartition type.

To Reproduce
Steps to reproduce the behavior:

  1. Execute docker compose up -d --build to starts all needed services
  2. Execute docker logs -f docker-dynamodb-opensearch-data-prepper-opensearch-data-prepper-1

Expected behavior
data-prepper server is ready to consume records from DynamoDB stream, then write to Opensearch index

Screenshots
image

Environment (please complete the following information):

  • OS: MacOS Sequoia
  • Version 15.1 Beta (24B5055e)

Additional context

docker-compose.yml

version: '3'
services:
  opensearch-node:
    image: opensearchproject/opensearch
    ports:
      - "9200:9200"
      - "9600:9600"
    environment:
      - "discovery.type=single-node"
      - "plugins.security.disabled=true"
      - "OPENSEARCH_INITIAL_ADMIN_PASSWORD=<OPENSEARCH_INITIAL_ADMIN_PASSWORD>"
    networks:
      - dynamodb_opensearch
  opensearch-dashboard:
    image: opensearchproject/opensearch-dashboards:2.11.0
    ports:
      - "5601:5601"
    environment:
      - "OPENSEARCH_HOSTS=http://opensearch-node:9200"
      - "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true"
    networks:
      - dynamodb_opensearch
  opensearch-data-prepper:
    image: opensearchproject/data-prepper:latest
    environment:
      - AWS_PROFILE=my-profile
      - AWS_ACCESS_KEY_ID = <AWS_ACCESS_KEY_ID>
      - AWS_SECRET_ACCESS_KEY = <AWS_SECRET_ACCESS_KEY>
      - AWS_DEFAULT_REGION = eu-west-1
      - AWS_REGION = eu-west-1
    volumes:
      - ~/.aws:/root/.aws
      - ./pipelines.yaml:/usr/share/data-prepper/pipelines/pipelines.yaml
      - ./data-prepper-config.yaml:/usr/share/data-prepper/config/data-prepper-config.yaml
    ports:
      - "21890:21890"
    networks:
      - dynamodb_opensearch
networks:
  dynamodb_opensearch:
    driver: bridge

data-prepper-config.yaml

ssl: false

pipelines.yaml

version: "2"
cdc-pipeline:
  source:
    dynamodb:
      acknowledgments: true
      tables:
        - table_arn: "arn:aws:dynamodb:eu-west-1:123456789:table/my-table"
          stream:
            start_position: LATEST
            view_on_remove: OLD_IMAGE
      aws:
        region: "eu-west-1"

  sink:
    - opensearch:
        hosts: ["http://opensearch-node:9200"]
        index: my-index
        index_type: custom
        document_id: '${/id}'
        action: '${getMetadata("opensearch_action")}'
        document_version: '${getMetadata("document_version")}'
        document_version_type: external
@vincentpham13 vincentpham13 added bug Something isn't working untriaged labels Nov 2, 2024
@dlvenable dlvenable added documentation Improvements or additions to documentation question Further information is requested and removed untriaged bug Something isn't working documentation Improvements or additions to documentation labels Nov 5, 2024
@graytaylor0
Copy link
Member

Hi @vincentpham13,

The dynamodb source currently requires enabling source coordination with DynamoDB as a store. The in_memory source coordination store, which is the default, unfortunately does not work with DynamoDB as a source at this time.

If you plan on scaling Data Prepper horizontally, then using DynamoDB as a store with source coordination is a requirement regardless of the in_memory store not being supported. Please see the documentation that I shared above for how to configure DynamoDB as a source coordination store in the data-prepper-config.yaml, and let me know if you have any questions. Data Prepper will create the store automatically on startup the first time it is used.

@vincentpham13
Copy link
Author

Hi @graytaylor0,

Thank you for your reply. After configuring the source coordination with DynamoDB as the store, this issue has been resolved.

I have another issue I hope you can help with. As I mentioned, I'm testing with DynamoDB local.
I specified the local endpoint using the environment variable:
AWS_ENDPOINT_URL=http://local-dynamodb:8000.

The problem is that the Data Prepper server attempts to use the endpoint dynamodb.ddblocal.amazonaws.com, where ddblocal is the region automatically created when using DynamoDB local.

Here is full logs

2024-12-03T08:35:57,992 [main] INFO  org.opensearch.dataprepper.DataPrepperArgumentConfiguration - Command line args: /usr/share/data-prepper/pipelines,/usr/share/data-prepper/config/data-prepper-config.yaml
2024-12-03T08:35:59,534 [main] INFO  org.opensearch.dataprepper.pipeline.parser.transformer.DynamicConfigTransformer - No transformation needed
2024-12-03T08:36:01,175 [main] INFO  org.opensearch.dataprepper.plugins.kafka.extension.KafkaClusterConfigExtension - Applying Kafka Cluster Config Extension.
2024-12-03T08:36:02,299 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building pipeline [cdc-pipeline] from provided configuration
2024-12-03T08:36:02,299 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building [dynamodb] as source component for the pipeline [cdc-pipeline]
2024-12-03T08:36:02,625 [main] INFO  org.opensearch.dataprepper.plugins.source.dynamodb.DynamoDBSource - Create DynamoDB Source
2024-12-03T08:36:02,639 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building buffer for the pipeline [cdc-pipeline]
2024-12-03T08:36:02,676 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building processors for the pipeline [cdc-pipeline]
2024-12-03T08:36:02,677 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building sinks for the pipeline [cdc-pipeline]
2024-12-03T08:36:02,678 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Building [opensearch] as sink component
2024-12-03T08:36:02,917 [main] INFO  org.opensearch.dataprepper.parser.PipelineTransformer - Constructing MultiBufferDecorator with [0] secondary buffers for pipeline [cdc-pipeline]
2024-12-03T08:36:03,136 [main] WARN  org.opensearch.dataprepper.pipeline.server.config.DataPrepperServerConfiguration - Creating data prepper server without authentication. This is not secure.
2024-12-03T08:36:03,137 [main] WARN  org.opensearch.dataprepper.pipeline.server.config.DataPrepperServerConfiguration - In order to set up Http Basic authentication for the data prepper server, go here: https://github.com/opensearch-project/data-prepper/blob/main/docs/core_apis.md#authentication
2024-12-03T08:36:03,278 [main] INFO  org.opensearch.dataprepper.pipeline.Pipeline - Pipeline [cdc-pipeline] - Initiating pipeline execution
2024-12-03T08:36:07,810 [main] ERROR org.opensearch.dataprepper.pipeline.Pipeline - Pipeline [cdc-pipeline] encountered exception while starting the source, skipping execution
software.amazon.awssdk.core.exception.SdkClientException: An exception was thrown and did not match any waiter acceptors
	at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.exception.SdkClientException.create(SdkClientException.java:47) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutorHelper.lambda$noneMatchException$3(WaiterExecutorHelper.java:94) ~[sdk-core-2.25.11.jar:?]
	at java.base/java.util.Optional.map(Optional.java:260) ~[?:?]
	at software.amazon.awssdk.utils.Either.lambda$map$0(Either.java:51) ~[utils-2.25.11.jar:?]
	at java.base/java.util.Optional.orElseGet(Optional.java:364) ~[?:?]
	at software.amazon.awssdk.utils.Either.map(Either.java:51) ~[utils-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutorHelper.noneMatchException(WaiterExecutorHelper.java:92) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.lambda$firstWaiterAcceptor$0(WaiterExecutor.java:78) ~[sdk-core-2.25.11.jar:?]
	at java.base/java.util.Optional.orElseThrow(Optional.java:403) ~[?:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.firstWaiterAcceptor(WaiterExecutor.java:78) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.execute(WaiterExecutor.java:53) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.DefaultWaiter.run(DefaultWaiter.java:49) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.waiters.DefaultDynamoDbWaiter.waitUntilTableExists(DefaultDynamoDbWaiter.java:81) ~[dynamodb-2.25.11.jar:?]
	at org.opensearch.dataprepper.plugins.sourcecoordinator.dynamodb.DynamoDbClientWrapper.initializeTable(DynamoDbClientWrapper.java:100) ~[dynamodb-source-coordination-store-2.10.1.jar:?]
	at org.opensearch.dataprepper.plugins.sourcecoordinator.dynamodb.DynamoDbSourceCoordinationStore.initializeStore(DynamoDbSourceCoordinationStore.java:54) ~[dynamodb-source-coordination-store-2.10.1.jar:?]
	at org.opensearch.dataprepper.sourcecoordination.enhanced.EnhancedLeaseBasedSourceCoordinator.initialize(EnhancedLeaseBasedSourceCoordinator.java:97) ~[data-prepper-core-2.10.1.jar:?]
	at org.opensearch.dataprepper.plugins.source.dynamodb.DynamoDBSource.setEnhancedSourceCoordinator(DynamoDBSource.java:98) ~[dynamodb-source-2.10.1.jar:?]
	at org.opensearch.dataprepper.pipeline.Pipeline.execute(Pipeline.java:252) ~[data-prepper-core-2.10.1.jar:?]
	at org.opensearch.dataprepper.DataPrepper.lambda$execute$1(DataPrepper.java:92) ~[data-prepper-core-2.10.1.jar:2.10.1]
	at java.base/java.util.LinkedHashMap.forEach(LinkedHashMap.java:721) [?:?]
	at org.opensearch.dataprepper.DataPrepper.execute(DataPrepper.java:91) [data-prepper-core-2.10.1.jar:2.10.1]
	at org.opensearch.dataprepper.DataPrepperExecute.main(DataPrepperExecute.java:42) [data-prepper-main-2.10.1.jar:2.10.1]
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Received an UnknownHostException when attempting to interact with a service. See cause for the exact endpoint that is failing to resolve. If this is happening on an endpoint that previously worked, there may be a network connectivity issue or your DNS cache could be storing endpoints for too long.
	at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.awscore.interceptor.HelpfulUnknownHostExceptionInterceptor.modifyException(HelpfulUnknownHostExceptionInterceptor.java:59) ~[aws-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.interceptor.ExecutionInterceptorChain.modifyException(ExecutionInterceptorChain.java:181) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.runModifyException(ExceptionReportingUtils.java:54) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.utils.ExceptionReportingUtils.reportFailureToInterceptors(ExceptionReportingUtils.java:38) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:39) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:224) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53) ~[aws-core-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.DefaultDynamoDbClient.describeTable(DefaultDynamoDbClient.java:2282) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.waiters.DefaultDynamoDbWaiter.lambda$waitUntilTableExists$0(DefaultDynamoDbWaiter.java:81) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.pollResponse(WaiterExecutor.java:70) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.execute(WaiterExecutor.java:52) ~[sdk-core-2.25.11.jar:?]
	... 11 more
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	at software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.exception.SdkClientException.create(SdkClientException.java:47) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.utils.RetryableStageHelper.setLastException(RetryableStageHelper.java:223) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:83) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:36) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:56) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:36) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:80) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:60) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:42) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:50) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:32) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:224) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53) ~[aws-core-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.DefaultDynamoDbClient.describeTable(DefaultDynamoDbClient.java:2282) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.waiters.DefaultDynamoDbWaiter.lambda$waitUntilTableExists$0(DefaultDynamoDbWaiter.java:81) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.pollResponse(WaiterExecutor.java:70) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.execute(WaiterExecutor.java:52) ~[sdk-core-2.25.11.jar:?]
	... 11 more
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 1 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com: System error
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 2 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 3 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 4 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 5 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 6 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 7 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
	Suppressed: software.amazon.awssdk.core.exception.SdkClientException: Request attempt 8 failure: Unable to execute HTTP request: dynamodb.ddblocal.amazonaws.com
Caused by: java.net.UnknownHostException: dynamodb.ddblocal.amazonaws.com
	at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) ~[?:?]
	at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) ~[?:?]
	at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) ~[?:?]
	at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) ~[?:?]
	at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.14.jar:4.5.14]
	at software.amazon.awssdk.http.apache.internal.conn.ClientConnectionManagerFactory$DelegatingHttpClientConnectionManager.connect(ClientConnectionManagerFactory.java:86) ~[apache-client-2.25.11.jar:?]
	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.14.jar:4.5.14]
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) ~[httpclient-4.5.14.jar:4.5.14]
	at software.amazon.awssdk.http.apache.internal.impl.ApacheSdkHttpClient.execute(ApacheSdkHttpClient.java:72) ~[apache-client-2.25.11.jar:?]
	at software.amazon.awssdk.http.apache.ApacheHttpClient.execute(ApacheHttpClient.java:254) ~[apache-client-2.25.11.jar:?]
	at software.amazon.awssdk.http.apache.ApacheHttpClient.access$500(ApacheHttpClient.java:104) ~[apache-client-2.25.11.jar:?]
	at software.amazon.awssdk.http.apache.ApacheHttpClient$1.call(ApacheHttpClient.java:231) ~[apache-client-2.25.11.jar:?]
	at software.amazon.awssdk.http.apache.ApacheHttpClient$1.call(ApacheHttpClient.java:228) ~[apache-client-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.util.MetricUtils.measureDurationUnsafe(MetricUtils.java:99) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.executeHttpRequest(MakeHttpRequestStage.java:79) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.execute(MakeHttpRequestStage.java:57) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.execute(MakeHttpRequestStage.java:40) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:72) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:42) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:78) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:40) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:55) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:39) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:81) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:36) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:56) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:36) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:80) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:60) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:42) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:50) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:32) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:224) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:173) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:80) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:182) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:74) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:53) ~[aws-core-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.DefaultDynamoDbClient.describeTable(DefaultDynamoDbClient.java:2282) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.services.dynamodb.waiters.DefaultDynamoDbWaiter.lambda$waitUntilTableExists$0(DefaultDynamoDbWaiter.java:81) ~[dynamodb-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.pollResponse(WaiterExecutor.java:70) ~[sdk-core-2.25.11.jar:?]
	at software.amazon.awssdk.core.internal.waiters.WaiterExecutor.execute(WaiterExecutor.java:52) ~[sdk-core-2.25.11.jar:?]
	... 11 more
2024-12-03T08:36:07,895 [main] WARN  org.opensearch.dataprepper.pipeline.server.HttpServerProvider - Creating Data Prepper server without TLS. This is not secure.
2024-12-03T08:36:07,896 [main] WARN  org.opensearch.dataprepper.pipeline.server.HttpServerProvider - In order to set up TLS for the Data Prepper server, go here: https://github.com/opensearch-project/data-prepper/blob/main/docs/configuration.md#server-configuration
2024-12-03T08:36:07,950 [main] INFO  org.opensearch.dataprepper.pipeline.server.DataPrepperServer - Data Prepper server running at :4900

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@graytaylor0 graytaylor0

Labels
question Further information is requested
Projects
Data Prepper Tracking Board
Status: Unplanned
Milestone
No milestone
Development

No branches or pull requests
3 participants
@dlvenable @graytaylor0 @vincentpham13