[BUG] Path prefix is not supported for remote reindex

[Semenchuk1997]

I'm trying to reindex from the remote host using /_reindex API.

The host URL is of the form [scheme]://[host]:[port](/pathPrefix). However, the reindex request fails with Path prefix is not supported for remote reindex reason.

Seems like the issue was resolved in Elasticsearch 7.0.0 elastic/elasticsearch#22913

[andrross]

I'll take a look at this

[kartg]

By 11/12, we're aiming to reproduce the issue and outline scope of change.

This shouldn't repro in Opensearch since we forked from Elasticsearch 7.10.2

[Semenchuk1997]

Here is my cluster props

[andrross]

OpenSearch forked from Elasticsearch 7.10.3, and the change to support pathPrefix is included in OpenSearch 1.0 for remote reindexing operations. If I attempt to reproduce the error as shown I get:

{
  "error": {
    "root_cause": [
      {
        "type": "x_content_parse_exception",
        "reason": "[1:144] [reindex] failed to parse field [source]"
      }
    ],
    "type": "x_content_parse_exception",
    "reason": "[1:144] [reindex] failed to parse field [source]",
    "caused_by": {
      "type": "illegal_argument_exception",
      "reason": "Unsupported fields in [remote]: [external]"
    }
  },
  "status": 400
}

The external field does not seem to be a valid parameter for the remote reindexing request. The valid fields for the remote parameter are host, username, password, socket_timeout, and connect_timeout Can you retry the request without the external field? (Though I can't explain why you're getting a different error message than me)

[Semenchuk1997]

Without external field the response the same.

I saw the message as yours in the code. However, in the Dev Tools the message the same as in my screenshots above

[andrross]

Can you clarify how you're running your OpenSearch cluster? Is it hosted in Amazon OpenSearch Service or are you running the instance yourself?

[Semenchuk1997]

Amazon OpenSearch Service

[andrross]

I've confirmed that path prefix support for remote reindex is implemented in OpenSearch 1.0. I'm not sure what is the causing the error that you're seeing, but at this point I think AWS support is the right place to get assistance with Amazon OpenSearch Service.

[anasalkouz]

Closing the issue, please feel free to re-open the issue incase you still have any questions or concerns.