Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document autoscale for Azure IaaS and refactor the doc #1798

Closed
wants to merge 17 commits into from

Conversation

ritawatson
Copy link
Contributor

@ritawatson ritawatson commented Nov 14, 2023

Describe the Change

This PR provides missing autoscaler information in the Azure IaaS doc and refactors the doc. Because the doc refers to a couple of related docs, this PR also makes wording improvements to the Register and Manage Azure Account and Cluster Removal docs.

Review Changes

💻 Preview URL

🎫 DOC-897

@ritawatson ritawatson changed the title Revise steps 1-10 Document Azure autoscaler Nov 15, 2023
@ritawatson ritawatson changed the title Document Azure autoscaler Document Azure autoscaler and refactor the doc Nov 16, 2023
@ritawatson ritawatson marked this pull request as ready for review November 16, 2023 03:18
@ritawatson ritawatson requested a review from a team as a code owner November 16, 2023 03:18
@ritawatson ritawatson requested review from karl-cardenas-coding, addetz and lennessyy and removed request for a team November 16, 2023 03:18
@ritawatson ritawatson added auto-backport Enable backport backport-version-4-0 Backport change to version 4.0 backport-version-3-4 Backport change to version 3.4 backport-version-4-1 Backport change to version 4.1 documentation Improvements or additions to documentation labels Nov 16, 2023
@ritawatson ritawatson changed the title Document Azure autoscaler and refactor the doc Document autoscale for Azure IaaS and refactor the doc Nov 16, 2023
Copy link
Contributor

@karl-cardenas-coding karl-cardenas-coding left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left some suggestions and some comment regarding concerns I identified.

|**Account Name**| A custom account name.|
|**Tenant ID**| Unique tenant ID from Azure Management Portal.|
|**Client ID**| Unique client ID from Azure Management Portal.|
|**Client Secret**| Azure secret for authentication. Refer to Microsoft's reference guide for creating a [Client Secret](https://docs.microsoft.com/en-us/azure/active-directory/develop/howto-create-service-principal-portal#create-an-azure-active-directory-application) |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a validate button right next to the credentials. We need to mention this.

CleanShot 2023-11-21 at 19 09 10@2x

2. Click on **Clusters** from the left **Main Menu**.
If you need help creating a custom storage account or container, check out the [Create a Storage Account](https://learn.microsoft.com/en-us/azure/storage/common/storage-account-create?tabs=azure-portal) guide or the [Manage Blob Containers](https://learn.microsoft.com/en-us/azure/storage/blobs/blob-containers-portal).

- If you do not provide your own Virtual Network (VNet), Palette creates one for you with compute, network, and storage resources in Azure when it provisions Kubernetes clusters. Ensure there is sufficient capacity in the preferred Azure region to create the following resources. Note that Palette does not create these resources if you specify an existing VNet.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This feels a bit odd. If the user does not need to provide a VNet, then it's not a prerequisite.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar wording is used/approved in the refactored AWS EKS. I think it needs to be a prereq. in the event the user doesn't provide their own VNet. I've removed the last sentence and slightly reworded to clarify:

CleanShot 2023-11-28 at 12 00 01

Co-authored-by: Karl Cardenas <karl@spectrocloud.com>

For this, we first need to create an Azure Active Directory (AAD) Application which can be used with role-based access control. Follow the steps below to create a new AAD application, assign roles, and create the client secret:
When you disable network calls from Palette, you need to create a [Microsoft Entra](https://learn.microsoft.com/en-us/entra/) application, which can be used with Role-Based Access Control (RBAC). Follow the summary steps below to create a new Microsoft Entra application, assign roles, and create the client secret.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Entra'?


For this, we first need to create an Azure Active Directory (AAD) Application which can be used with role-based access control. Follow the steps below to create a new AAD application, assign roles, and create the client secret:
When you disable network calls from Palette, you need to create a [Microsoft Entra](https://learn.microsoft.com/en-us/entra/) application, which can be used with Role-Based Access Control (RBAC). Follow the summary steps below to create a new Microsoft Entra application, assign roles, and create the client secret.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Entra'?


Azure autoscale allows you to provision nodes to support the demand of your application. Within Azure, you can add resources to handle increases in load or scale back resources when they are not needed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


6. Type in the name of the cluster and click on **OK**
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using virtual machine **scale sets**, or virtual machine pool. Within Azure, you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


6. Type in the name of the cluster and click on **OK**
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using virtual machine **scale sets**, or virtual machine pool. Within Azure, you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


6. Type in the name of the cluster and click on **OK**
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using virtual machine **scale sets**, or virtual machine pool. Within Azure, you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


<br />
To use Autoscale capability, you must log in to the [Azure Portal](https://portal.azure.com/#home) and create a VM and a VM scale set. To learn how to create a scale set in Azure, review [Create virtual machines in a scale set using Azure portal](https://learn.microsoft.com/en-us/azure/virtual-machine-scale-sets/flexible-virtual-machine-scale-sets-portal).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


Basic autoscaling options are available for host-based scaling when you create your scale set. To create custom autoscale rules based on schedule or metrics, you need to use Custom Autoscale.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


Basic autoscaling options are available for host-based scaling when you create your scale set. To create custom autoscale rules based on schedule or metrics, you need to use Custom Autoscale.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


A force delete can result in resources Palette provisioned being missed in the removal process. Verify there are no remaining Palette provisioned resources such as:
Once you create your VM scale set, you can find Autoscale under the **Monitor** service, the **Resource Groups** service, or by searching *Autoscale*. To learn how you can scale resources based on metrics you define, refer to Microsoft's [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) reference guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


A force delete can result in resources Palette provisioned being missed in the removal process. Verify there are no remaining Palette provisioned resources such as:
Once you create your VM scale set, you can find Autoscale under the **Monitor** service, the **Resource Groups** service, or by searching *Autoscale*. To learn how you can scale resources based on metrics you define, refer to Microsoft's [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) reference guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


3. Click on the cluster that you want to remove.
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using a *virtual machine scale set*. The scale set serves as a virtual machine pool. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


3. Click on the cluster that you want to remove.
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using a *virtual machine scale set*. The scale set serves as a virtual machine pool. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


3. Click on the cluster that you want to remove.
Azure autoscale allows you to provision nodes to support the demand of your application. Azure VMs autoscale using a *virtual machine scale set*. The scale set serves as a virtual machine pool. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. For more information, review Microsoft's [Overview of autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


4. Click on the **Settings** drop-down menu.
When using Autoscale capability,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


The cluster status is updated to **Deleting** while cluster resources are being deleted. Once all resources are successfully deleted, the cluster status is updated to **Deleted** and is removed from the list of clusters.
Basic autoscaling options are available for host-based scaling when you create your scale set. Use **Custom autoscale** to create custom autoscale rules based on metrics or a schedule.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


:::caution
To learn how you can scale resources based on metrics you define, refer to Microsoft's [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) reference guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


A force delete can result in resources Palette provisioned being missed in the removal process. Verify there are no remaining Palette provisioned resources such as:
A [Microsoft video](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started?WT.mc_id=Portal-Microsoft_Azure_Monitoring#discover-the-autoscale-settings-in-your-subscription) in [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) recommends for every scale rule you add to scale out resources, a matching rule should be added to scale in when the resources are no longer needed. This best practice avoids extra costs that could be incurred for unused provisioned resources.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 37.1%, saving 124.44 KB.

Filename Before After Improvement Visual comparison
static/assets/docs/images/clusters_publiccloud_azure_add-rule.png 158.77 KB 99.91 KB -37.1% View diff
static/assets/docs/images/clusters_publiccloud_azure_custom-autoscale.png 176.73 KB 111.15 KB -37.1% View diff

507 images did not require optimisation.


3. Click on the cluster that you want to remove.
Azure Autoscale allows you to provision nodes to support workload demand on your application. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. Azure VMs autoscale using a *virtual machine scale set*, which you create. The scale set serves as a virtual machine pool. For more information, review Microsoft's [Overview of Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


3. Click on the cluster that you want to remove.
Azure Autoscale allows you to provision nodes to support workload demand on your application. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. Azure VMs autoscale using a *virtual machine scale set*, which you create. The scale set serves as a virtual machine pool. For more information, review Microsoft's [Overview of Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


3. Click on the cluster that you want to remove.
Azure Autoscale allows you to provision nodes to support workload demand on your application. Within [Azure Portal](https://portal.azure.com/#home), you can scale out VMs to handle increases in load or scale in VMs when they are not needed. Azure VMs autoscale using a *virtual machine scale set*, which you create. The scale set serves as a virtual machine pool. For more information, review Microsoft's [Overview of Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-overview).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


4. Click on the **Settings** drop-down menu.
To use Custom Autoscale capability, the following applies regarding scale sets:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


- Custom Autoscale requires the creation of a virtual machine scale set.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


## Force Delete a Cluster
Basic autoscaling options are available for host-based scaling when you create your scale set. However, to create custom autoscale rules based on metrics or a schedule, use **Custom autoscale**.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'autoscale'?


:::caution

A [Microsoft video](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started?WT.mc_id=Portal-Microsoft_Azure_Monitoring#discover-the-autoscale-settings-in-your-subscription) in [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) recommends adding matching scale-in and scale-out rules to avoid extra costs that could be incurred for unused provisioned resources.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?


:::

## Validate
To learn how you can scale resources based on metrics you define, refer to Microsoft's [Get started with Autoscale in Azure](https://learn.microsoft.com/en-us/azure/azure-monitor/autoscale/autoscale-get-started) reference guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [vale] reported by reviewdog 🐶
[Vale.Spelling] Did you really mean 'Autoscale'?

@ritawatson ritawatson added do-not-merge/work-in-progress Work in-progress. DO NOT MERGE and removed backport-version-4-0 Backport change to version 4.0 auto-backport Enable backport backport-version-3-4 Backport change to version 3.4 backport-version-4-1 Backport change to version 4.1 labels Nov 30, 2023
Copy link
Contributor

🚀 Netlify preview deployed succesfully for commit 9c0e131. Click here to preview the changes.

karl-cardenas-coding

This comment was marked as outdated.

@karl-cardenas-coding
Copy link
Contributor

Closing this PR as #1857 carries over the work.

@karl-cardenas-coding karl-cardenas-coding deleted the azure-missing-autoscaler-and-refactor branch December 22, 2023 17:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
do-not-merge/work-in-progress Work in-progress. DO NOT MERGE documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants