Use a different healthcheck port for AWS CSI controller

[rifelpet]

This avoids port conflicts when both the deployment (controller) and daemonset (agent) run as hostNetwork

Example:

https://storage.googleapis.com/kubernetes-ci-logs/logs/e2e-kops-aws-upgrade-k127-ko130-to-k128-kolatest-many-addons/1846558413924864000/artifacts/cluster-info/kube-system/events.yaml

- apiVersion: v1
  count: 13
  eventTime: null
  firstTimestamp: "2024-10-16T14:42:36Z"
  involvedObject:
    apiVersion: v1
    kind: Pod
    name: ebs-csi-controller-6c444dc485-8zlmm
    namespace: kube-system
    resourceVersion: "5101"
    uid: 49871d0b-efec-4aff-8fba-158f0deecc5d
  kind: Event
  lastTimestamp: "2024-10-16T14:50:45Z"
  message: '0/15 nodes are available: 12 node(s) didn''t match Pod''s node affinity/selector,
    3 node(s) didn''t have free ports for the requested pod ports. preemption: 0/15
    nodes are available: 12 Preemption is not helpful for scheduling, 3 No preemption
    victims found for incoming pod..'
  metadata:
    creationTimestamp: "2024-10-16T14:42:36Z"
    name: ebs-csi-controller-6c444dc485-8zlmm.17fef5f8db9d27c1
    namespace: kube-system
    resourceVersion: "2866"
    uid: d6650adf-9a99-45dc-8065-e696a0583a5b
  reason: FailedScheduling
  reportingComponent: ""
  reportingInstance: ""
  source:
    component: default-scheduler
  type: Warning

[rifelpet]

/test pull-kops-e2e-aws-upgrade-k130-ko130-to-klatest-kolatest-many-addons

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hakman

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [hakman]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[mwiede]

@rifelpet fyi this conflicts with default port set by aws-efs-csi helm chart https://github.com/kubernetes-sigs/aws-efs-csi-driver/blob/9b81560bc204cf52c9f44e7f31d6876893f57e06/charts/aws-efs-csi-driver/values.yaml#L203