Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] RepositoryS3StsCredentialsRestIT class failing #117897

Closed
elasticsearchmachine opened this issue Dec 3, 2024 · 5 comments
Closed

[CI] RepositoryS3StsCredentialsRestIT class failing #117897

elasticsearchmachine opened this issue Dec 3, 2024 · 5 comments
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs medium-risk An open issue or test failure that is a medium risk to future releases Team:Distributed Coordination Meta label for Distributed Coordination team >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Dec 3, 2024

Build Scans:

Reproduction Line:

./gradlew ":modules:repository-s3:javaRestTest" --tests "org.elasticsearch.repositories.s3.RepositoryS3StsCredentialsRestIT.testGetRepositoryReadonlyTrue" -Dtests.seed=DDC87F135EA5F1E7 -Dtests.locale=khq -Dtests.timezone=VST -Druntime.java=17 -Dtests.fips.enabled=true

Applicable branches:
8.x

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

org.elasticsearch.client.ResponseException: method [PUT], host [http://127.0.0.1:45789], URI [/_snapshot/pupfqjgfu], status line [HTTP/1.1 500 Internal Server Error]
---
error:
  root_cause:
  - type: "repository_verification_exception"
    reason: "[pupfqjgfu] path [RepositoryS3StsCredentialsRestIT-a434ec7-base_path]\
      \ is not accessible on master node"
  type: "repository_verification_exception"
  reason: "[pupfqjgfu] path [RepositoryS3StsCredentialsRestIT-a434ec7-base_path] is\
    \ not accessible on master node"
  caused_by:
    type: "i_o_exception"
    reason: "Exception when listing blobs by prefix [index-]"
    caused_by:
      type: "sdk_client_exception"
      reason: "Unable to calculate a request signature: Unable to calculate a request\
        \ signature: No installed provider supports this key: javax.crypto.spec.SecretKeySpec"
      caused_by:
        type: "sdk_client_exception"
        reason: "Unable to calculate a request signature: No installed provider supports\
          \ this key: javax.crypto.spec.SecretKeySpec"
        caused_by:
          type: "invalid_key_exception"
          reason: "No installed provider supports this key: javax.crypto.spec.SecretKeySpec"
status: 500

Issue Reasons:

  • [8.x] 6 failures in class org.elasticsearch.repositories.s3.RepositoryS3StsCredentialsRestIT (1.0% fail rate in 625 executions)
  • [8.x] 5 failures in step openjdk17_checkpart1_java-fips-matrix (27.8% fail rate in 18 executions)
  • [8.x] 5 failures in pipeline elasticsearch-periodic (26.3% fail rate in 19 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >test-failure Triaged test failures from CI labels Dec 3, 2024
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination)

@elasticsearchmachine elasticsearchmachine added needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Distributed Coordination Meta label for Distributed Coordination team labels Dec 3, 2024
@DiannaHohensee
Copy link
Contributor

I suspect c3f9e01 may have destabilized something. Pinging @DaveCTurner.

@DiannaHohensee DiannaHohensee added medium-risk An open issue or test failure that is a medium risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Dec 3, 2024
@ywangd
Copy link
Member

ywangd commented Dec 3, 2024

This is an artefact of out-of-order backports. The backport #117738 did not contain the fix for AwsStsHttpHandler from the orignal PR #117675. That is because #117458 was not backported at that time. Now it has been backport as #117749. We need to backport the fix for AwsStsHttpHandler as well. I raised #117944

@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch 8.x

Mute Reasons:

  • [8.x] 6 failures in class org.elasticsearch.repositories.s3.RepositoryS3StsCredentialsRestIT (1.0% fail rate in 625 executions)
  • [8.x] 5 failures in step openjdk17_checkpart1_java-fips-matrix (27.8% fail rate in 18 executions)
  • [8.x] 5 failures in pipeline elasticsearch-periodic (26.3% fail rate in 19 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Dec 5, 2024
…IT org.elasticsearch.repositories.s3.RepositoryS3StsCredentialsRestIT #117897
@ywangd
Copy link
Member

ywangd commented Dec 5, 2024

Should be fixed by #117944

@ywangd ywangd closed this as completed Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs medium-risk An open issue or test failure that is a medium risk to future releases Team:Distributed Coordination Meta label for Distributed Coordination team >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

3 participants