create instances via nodegroup

[gthao313]

Issue number:
#162

Description of changes:
Currently we create bottlerocket nodes via launching instances directly, and in this PR we're going to create bottlerocket node via nodegroups. From this we can specify any arbitrary setting we want. and we can have the node-labels set as a Bottlerocket settings directly.

Tasks

• Nodegroup creation and termination
• Launch template creation and termination
• One-time iam role and profile creation and deletion
• Mapping iam role and profile to cluster

Testing done:
Test on ipv4 and ipv6 clusters

cargo run --bin integ integration-test --cluster-name bottlerocket-test --region us-west-2 --bottlerocket-version 1.5.0  --arch x86_64 --nodegroup-name=tianhg-test-x64

cargo run --bin integ clean --cluster-name bottlerocket-test --region us-west-2 --nodegroup-name=tianhg-test-x64

cargo run --bin integ integration-test --cluster-name bottlerocket-test --region us-west-2 --bottlerocket-version 1.5.0  --arch arm64 --nodegroup-name=tianhg-test-arm64

cargo run --bin integ clean --cluster-name bottlerocket-test --region us-west-2  --nodegroup-name=tianhg-test-arm64

Terms of contribution:

By submitting this pull request, I agree that this contribution is dual-licensed under the terms of both the Apache License, version 2.0, and the MIT license.

[cbgbt]

We should probably use a TOML serializer with serde for this, since it would be pretty easy to break the TOML formatting with the right input.

[gthao313]

Do you mean something like below? I tried this but create_launch_template().user_data( input), the input need a valid base64 string. Can I still use TOML serializer to output base64 string?

n userdata(endpoint: &str, cluster_name: &str, certificate: &str) -> ProviderResult<String> {
    let user_data = toml::ser::to_string_pretty(&format!(
        r#"[settings.updates]
            ignore-waves = true
                
            [settings.kubernetes]
            api-server = "{}"
            cluster-name = "{}"
            cluster-certificate = "{}"
        "#,
        endpoint, cluster_name, certificate
    ))
    .context("Unable convert userdata to pretty string")?;

    Ok(user_data)

[cbgbt]

I meant more like create a series of structs like:

#[derive(Serialize)]
struct Settings {
    updates: UpdateSettings,
    kubernetes: KubernetesSettings,
}

#[derive(Serialize)]
struct UpdateSettings {
    ignore_waves: bool,
}

#[derive(Serialize)]
struct KubernetesSettings {
    api_server: String,
    // etc...
}

Then you could do something like:

let settings = Settings {
    updates: UpdateSettings {
        ignore_waves: true,
    },
    kubernetes: KubernetesSettings {
        // etc...
    },
}
toml::ser::to_string_pretty(settings);

[gthao313]

I tried the method that @cbgbt mentioned above; however, the string formate of userdata which was created by toml::ser::to_string_pretty() can be recognized by 'early-boot-config'. We can't use this method and I think it's better to keep the original method.
Error

[    5.826817] early-boot-config[1483]: Provider error: Unable to serialize settings from instance user data: TOML data did not contain 'settings' section

userdata created by toml

"[\"settings.updates\"]\n
ignore-waves = true\n\n
[\"settings.kubernetes\"]\n
api-server = 'xxxx7.us-west-2.eks.amazonaws.com'\n
cluster-name = 'bottlerocket-test'\n
cluster-certificate = '=xxxxx'\n"

[gthao313]

Update nginx image version to 1.21.6 so that able to create arm/amd pods. Old version Nginx doesn't support arm.

[gthao313]

Push above address comments, update third party packages.

[gthao313]

resolve conflict on this part. The code is from IPV6 PR

[gthao313]

Push above rebase and update aws rust dependencies to 0.13.0

[arnaldo2792]

Should you have a different commit for this change?