Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

yarn-operator: support multi yarn cluster #26

Closed
wants to merge 1 commit into from
Closed

Conversation

zwzhang0107
Copy link
Collaborator

Ⅰ. Describe what this PR does

nm pods in k8s may belongs to multiple yarn clusters.
yarn operator supports sync batch resource to different yarn rm.

Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how to verify it

  1. Add cluster id to annotation of nm pod:
    kubectl annotate pod $yarn-nm-pod yarn.hadoop.apache.org/cluster-id: test-cluster-id
  annotations:
    yarn.hadoop.apache.org/cluster-id: test-cluster-id
  1. create ConfigMap with yarn config by cluster, the prefix of config key test-cluster-id must be equal to the nm pod annotation.
apiVersion: v1
kind: ConfigMap
metadata:
  name: yarn-config
  namespace: koordinator-system
data:
  yarn-site.xml: |
    <configuration>
        ......
    </configuration>
  # format: ${cluster-id}.yarn-site.xml
  test-cluster-id.yarn-site.xml: |
    <configuration>
        ......
    </configuration>
  1. should restart yarn-operator if new yarn config added

Ⅳ. Special notes for reviews

V. Checklist

  • I have written necessary docs and comments
  • I have added necessary unit tests and integration tests
  • All checks passed in make test

@koordinator-bot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please ask for approval from zwzhang0107 after the PR has been reviewed.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Signed-off-by: 佑祎 <zzw261520@alibaba-inc.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant