git tag lookup fails for bitbucket-server and terragrunt #29400

Roshick · 2024-06-03T09:38:21Z

Roshick
Jun 3, 2024

What would you like help with?

I think I found a bug

How are you running Renovate?

Self-hosted

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

bitbucket-server, latest version 37.385

Please tell us more about your question or problem

#27903 broke the lookup for git tags in bitbucket-server.

the request ends in a 404, because the lookup is tried at https://api.bitbucket.org/2.0/... although RENOVATE_ENDPOINT is set.

Logs (if relevant)

Logs


DEBUG: GET https://api.bitbucket.org/2.0/repositories/iac/az-vault/refs/tags?pagelen=100 = (code=ERR_NON_2XX_3XX_RESPONSE, statusCode=404 retryCount=0, duration=222) (repository=iac/tg-cicd-platform)
DEBUG: Datasource 404 (repository=iac/tg-cicd-platform)
       "datasource": "bitbucket-tags",
       "packageName": "iac/az-vault",
       "url": "https://api.bitbucket.org/2.0/repositories/iac/az-vault/refs/tags?pagelen=100"
...
 "deps": [
   {
     "depType": "gitTags",
     "depName": "bitbucket.<redacted>.de/iac/az-vault",
     "currentValue": "v2.49.4",
     "datasource": "bitbucket-tags",
     "packageName": "iac/az-vault",
     "registryUrls": ["https://bitbucket.<redacted>.de"],
     "updates": [],
     "versioning": "semver-coerced",
     "warnings": [
       {
         "topic": "iac/az-vault",
         "message": "Failed to look up bitbucket-tags package iac/az-vault"
       }
     ]
   }
 ],

Answered by Churro

Jun 3, 2024

PR #29416

View full answer

Churro · 2024-06-03T10:22:22Z

Churro
Jun 3, 2024
Collaborator

The logs show that your bitbucket-server is hosted on a domain named bitbucket.<redacted>.de. The confusion of bitbucket SaaS and on-prem probably is probably caused by this fuzzy check in detectPlatform:

renovate/lib/util/common.ts

Lines 25 to 27 in 494ab10

    
           if (hostname === 'bitbucket.org' || hostname?.includes('bitbucket')) { 
        
             return 'bitbucket'; 
        
           }

6 replies

Roshick Jun 3, 2024
Author

before:


packageFiles with updates (repository=iac/tg-cicd-platform, baseBranch=master)
       "config": {
         "terraform": [
           {
             "deps": [
               {
                 "currentValue": "3.6.2",
                 "depType": "required_provider",
                 "depName": "random",
                 "datasource": "terraform-provider",
                 "packageName": "hashicorp/random",
                 "updates": [],
                 "versioning": "hashicorp",
                 "warnings": [],
                 "sourceUrl": "https://github.com/hashicorp/terraform-provider-random",
                 "registryUrl": "https://registry.terraform.io",
                 "homepage": "https://registry.terraform.io/providers/hashicorp/random",
                 "currentVersion": "3.6.2",
                 "fixedVersion": "3.6.2"
               }
             ]
           },
           {
             "deps": [
               {
                 "currentValue": "3.6.2",
                 "depType": "required_provider",
                 "depName": "random",
                 "datasource": "terraform-provider",
                 "packageName": "hashicorp/random",
                 "updates": [],
                 "versioning": "hashicorp",
                 "warnings": [],
                 "sourceUrl": "https://github.com/hashicorp/terraform-provider-random",
                 "registryUrl": "https://registry.terraform.io",
                 "homepage": "https://registry.terraform.io/providers/hashicorp/random",
                 "currentVersion": "3.6.2",
                 "fixedVersion": "3.6.2"
               }
             ]
           }
         ],
         "terragrunt": [
           {
             "deps": [{"skipReason": "invalid-name", "updates": []}]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "packageName": "ssh://**redacted**@bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "currentValue": "v2.49.4",
                 "datasource": "git-tags",
                 "updates": [
                   {
                     "bucket": "non-major",
                     "newVersion": "v2.49.5",
                     "newValue": "v2.49.5",
                     "newMajor": 2,
                     "newMinor": 49,
                     "updateType": "patch"
                   }
                 ],
                 "versioning": "semver-coerced",
                 "warnings": [],
                 "currentVersion": "v2.49.4",
                 "isSingleVersion": true,
                 "fixedVersion": "v2.49.4"
               }
             ]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "packageName": "ssh://**redacted**@bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "currentValue": "v2.49.4",
                 "datasource": "git-tags",
                 "updates": [
                   {
                     "bucket": "non-major",
                     "newVersion": "v2.49.5",
                     "newValue": "v2.49.5",
                     "newMajor": 2,
                     "newMinor": 49,
                     "updateType": "patch"
                   }
                 ],
                 "versioning": "semver-coerced",
                 "warnings": [],
                 "currentVersion": "v2.49.4",
                 "isSingleVersion": true,
                 "fixedVersion": "v2.49.4"
               }
             ]
           },
           {
             "deps": [{"skipReason": "invalid-name", "updates": []}]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "packageName": "ssh://**redacted**@bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "currentValue": "v2.49.4",
                 "datasource": "git-tags",
                 "updates": [
                   {
                     "bucket": "non-major",
                     "newVersion": "v2.49.5",
                     "newValue": "v2.49.5",
                     "newMajor": 2,
                     "newMinor": 49,
                     "updateType": "patch"
                   }
                 ],
                 "versioning": "semver-coerced",
                 "warnings": [],
                 "currentVersion": "v2.49.4",
                 "isSingleVersion": true,
                 "fixedVersion": "v2.49.4"
               }
             ]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "packageName": "ssh://**redacted**@bitbucket.<redacted>.de:7999/iac/az-vault.git",
                 "currentValue": "v2.49.4",
                 "datasource": "git-tags",
                 "updates": [
                   {
                     "bucket": "non-major",
                     "newVersion": "v2.49.5",
                     "newValue": "v2.49.5",
                     "newMajor": 2,
                     "newMinor": 49,
                     "updateType": "patch"
                   }
                 ],
                 "versioning": "semver-coerced",
                 "warnings": [],
                 "currentVersion": "v2.49.4",
                 "isSingleVersion": true,
                 "fixedVersion": "v2.49.4"
               }
             ]
           }
         ]
       }

after:


packageFiles with updates (repository=iac/tg-cicd-platform, baseBranch=master)
       "config": {
         "terraform": [
           {
             "deps": [
               {
                 "currentValue": "3.6.2",
                 "depType": "required_provider",
                 "depName": "random",
                 "datasource": "terraform-provider",
                 "packageName": "hashicorp/random",
                 "updates": [],
                 "versioning": "hashicorp",
                 "warnings": [],
                 "sourceUrl": "https://github.com/hashicorp/terraform-provider-random",
                 "registryUrl": "https://registry.terraform.io",
                 "homepage": "https://registry.terraform.io/providers/hashicorp/random",
                 "currentVersion": "3.6.2",
                 "currentVersionTimestamp": "2024-05-21T19:38:54.000Z",
                 "fixedVersion": "3.6.2"
               }
             ]
           },
           {
             "deps": [
               {
                 "currentValue": "3.6.2",
                 "depType": "required_provider",
                 "depName": "random",
                 "datasource": "terraform-provider",
                 "packageName": "hashicorp/random",
                 "updates": [],
                 "versioning": "hashicorp",
                 "warnings": [],
                 "sourceUrl": "https://github.com/hashicorp/terraform-provider-random",
                 "registryUrl": "https://registry.terraform.io",
                 "homepage": "https://registry.terraform.io/providers/hashicorp/random",
                 "currentVersion": "3.6.2",
                 "currentVersionTimestamp": "2024-05-21T19:38:54.000Z",
                 "fixedVersion": "3.6.2"
               }
             ]
           }
         ],
         "terragrunt": [
           {
             "deps": [{"skipReason": "invalid-name", "updates": []}]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de/iac/az-vault",
                 "currentValue": "v2.49.4",
                 "datasource": "bitbucket-tags",
                 "packageName": "iac/az-vault",
                 "registryUrls": ["https://bitbucket.<redacted>.de"],
                 "updates": [],
                 "versioning": "semver-coerced",
                 "warnings": [
                   {
                     "topic": "iac/az-vault",
                     "message": "Failed to look up bitbucket-tags package iac/az-vault"
                   }
                 ]
               }
             ]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de/iac/az-vault",
                 "currentValue": "v2.49.4",
                 "datasource": "bitbucket-tags",
                 "packageName": "iac/az-vault",
                 "registryUrls": ["https://bitbucket.<redacted>.de"],
                 "updates": [],
                 "versioning": "semver-coerced",
                 "warnings": [
                   {
                     "topic": "iac/az-vault",
                     "message": "Failed to look up bitbucket-tags package iac/az-vault"
                   }
                 ]
               }
             ]
           },
           {
             "deps": [{"skipReason": "invalid-name", "updates": []}]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de/iac/az-vault",
                 "currentValue": "v2.49.4",
                 "datasource": "bitbucket-tags",
                 "packageName": "iac/az-vault",
                 "registryUrls": ["https://bitbucket.<redacted>.de"],
                 "updates": [],
                 "versioning": "semver-coerced",
                 "warnings": [
                   {
                     "topic": "iac/az-vault",
                     "message": "Failed to look up bitbucket-tags package iac/az-vault"
                   }
                 ]
               }
             ]
           },
           {
             "deps": [
               {
                 "depType": "gitTags",
                 "depName": "bitbucket.<redacted>.de/iac/az-vault",
                 "currentValue": "v2.49.4",
                 "datasource": "bitbucket-tags",
                 "packageName": "iac/az-vault",
                 "registryUrls": ["https://bitbucket.<redacted>.de"],
                 "updates": [],
                 "versioning": "semver-coerced",
                 "warnings": [
                   {
                     "topic": "iac/az-vault",
                     "message": "Failed to look up bitbucket-tags package iac/az-vault"
                   }
                 ]
               }
             ]
           }
         ]
       }

rarkins Jun 3, 2024
Maintainer

It's a bit confusing due to the duplicates. Can you copy/paste out of there a single dependency before/after?

Roshick Jun 3, 2024
Author

sure thing! before the change they were handled as simple "git-tags" and retrieved via ssh which worked fine, now it's recognized as "bitbucket-tags" and uses the wrong host for the lookup via https.

before:


{
 "deps": [
   {
     "depType": "gitTags",
     "depName": "bitbucket.<redacted>.de:7999/iac/az-vault.git",
     "packageName": "ssh://**redacted**@bitbucket.<redacted>.de:7999/iac/az-vault.git",
     "currentValue": "v2.49.4",
     "datasource": "git-tags",
     "updates": [
       {
         "bucket": "non-major",
         "newVersion": "v2.49.5",
         "newValue": "v2.49.5",
         "newMajor": 2,
         "newMinor": 49,
         "updateType": "patch"
       }
     ],
     "versioning": "semver-coerced",
     "warnings": [],
     "currentVersion": "v2.49.4",
     "isSingleVersion": true,
     "fixedVersion": "v2.49.4"
   }
 ]
}

after:


{
 "deps": [
   {
     "depType": "gitTags",
     "depName": "bitbucket.<redacted>.de/iac/az-vault",
     "currentValue": "v2.49.4",
     "datasource": "bitbucket-tags",
     "packageName": "iac/az-vault",
     "registryUrls": ["https://bitbucket.<redacted>.de"],
     "updates": [],
     "versioning": "semver-coerced",
     "warnings": [
       {
         "topic": "iac/az-vault",
         "message": "Failed to look up bitbucket-tags package iac/az-vault"
       }
     ]
   }
 ]
}

Churro Jun 3, 2024
Collaborator

PR #29416

Answer selected by Churro

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

git tag lookup fails for bitbucket-server and terragrunt #29400

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

git tag lookup fails for bitbucket-server and terragrunt #29400

Roshick Jun 3, 2024

What would you like help with?

How are you running Renovate?

If you're self-hosting Renovate, tell us which platform (GitHub, GitLab, etc) and which version of Renovate.

Please tell us more about your question or problem

Logs (if relevant)

Replies: 1 comment · 6 replies

Churro Jun 3, 2024 Collaborator

Roshick Jun 3, 2024 Author

rarkins Jun 3, 2024 Maintainer

Roshick Jun 3, 2024 Author

Churro Jun 3, 2024 Collaborator

Roshick
Jun 3, 2024

Replies: 1 comment 6 replies

Churro
Jun 3, 2024
Collaborator

Roshick Jun 3, 2024
Author

rarkins Jun 3, 2024
Maintainer

Roshick Jun 3, 2024
Author

Churro Jun 3, 2024
Collaborator