feat: added mirroring support

[Ak-sky]

Description

Added ES mirroring support for disaster recovery usecase.
Git Issue

Release required?

• No release
• Patch release (x.x.X)
• Minor release (x.X.x)
• Major release (X.x.x)

Release notes content

• Added support for mirroring for disaster recovery usecase.

Run the pipeline

If the CI pipeline doesn't run when you create the PR, the PR requires a user with GitHub collaborators access to run the pipeline.

Run the CI pipeline when the PR is ready for review and you expect tests to pass. Add a comment to the PR with the following text:

/run pipeline

Checklist for reviewers

• If relevant, a test for the change is included or updated with this PR.
• If relevant, documentation for the change is included or updated with this PR.

For mergers

• Use a conventional commit message to set the release level. Follow the guidelines.
• Include information that users need to know about the PR in the commit message. The commit message becomes part of the GitHub release notes.
• Use the Squash and merge option.

[JunliWang]

mirroring needs a parameters_json with a structure like this, so that cluster provisioning will come with additional workerpool and mirrormaker application running on it.
source_crn, source_alias, and target_alias are user input and required.

parameters_json = jsonencode(
    {
      mirroring = {
        source_crn   = data.ibm_resource_instance.es_instance_source.id
        source_alias = "source-alias"
        target_alias = "target-alias"
        }
     }
 )

user also has the options to configure it to be more complex like below:

parameters_json = jsonencode(
   {
     mirroring = {
       source_crn   = data.ibm_resource_instance.es_instance_source.id
       source_alias = "source-alias"
       target_alias = "target-alias"
       options = {
         topic_name_transform = {
            type = "rename" 
            rename = {
              add_prefix = "add_prefix"
              add_suffix = "add_suffix"
              remove_prefix = "remove_prefix"
              remove_suffix = "remove_suffix"
            }
         }
         group_id_transform = {
           type = "rename" 
           rename = {
             add_prefix = "add_prefix"
             add_suffix = "add_suffix"
             remove_prefix = "remove_prefix"
             remove_suffix = "remove_suffix"
           }
         }
       }
     }
   }
 )

[kccox]

Note, you need plan = "enterprise-3nodes-2tb" to use mirroring, but provisioning of an enterprise instance can take two to three hours. You probably do not want to test that in pr_test.go.

[Ak-sky]

Addressing changes with the latest stable provider release https://registry.terraform.io/providers/IBM-Cloud/ibm/1.71.0

[JunliWang]

@Ak-sky
the resource ibm_event_streams_mirroring_config depends on the provider release v1.71.0, the parameters_json for mirroring does not, it is already supported by resource controller and Event Streams' service broker.

[JunliWang]

example doc for mirroring
IBM-Cloud/terraform-provider-ibm#5767

[Ak-sky]

@srikant-sahu, can you please have a look at this PR.

[Ak-sky]

/run pipeline

[ocofaigh]

The mirror example will take too long to run in pr_test.go. I think we maybe add a permanent enterprise instance to our account, and update the fscloud example with mirror support. Then we can run the fscloud example in pr_test.go to test all enterprise features

[Ak-sky]

/run pipeline

[Ak-sky]

/run pipeline

[Ak-sky]

/run pipeline

[Ak-sky]

/run pipeline

[Ak-sky]

@ocofaigh, PR pipeline is still failing due to permission error

╷
Error: [0m Error: [ERROR] Error creating resource key: You do not have the required permission to assign role 'Manager'. Contact the account owner to update your access. with resp code: {
│     "StatusCode": 403,

[Ak-sky]

/run pipeline

[Ak-sky]

@ocofaigh, PR pipeline is still failing due to permission error

╷
Error: [0m Error: [ERROR] Error creating resource key: You do not have the required permission to assign role 'Manager'. Contact the account owner to update your access. with resp code: {
│     "StatusCode": 403,

Error was coming due to the CBR rules.

[Ak-sky]

/run pipeline

[ocofaigh]

see comments

[Ak-sky]

/run pipeline

[Ak-sky]

/run pipeline

[Ak-sky]

/run pipeline

[terraform-ibm-modules-ops]

🎉 This PR is included in version 2.11.0 🎉

The release is available on:

• GitHub release
• v2.11.0

Your semantic-release bot 📦🚀