Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[question]koordinator yarn跑实时流计算作业 #2109

Closed
zj619 opened this issue Jun 18, 2024 · 2 comments
Closed

[question]koordinator yarn跑实时流计算作业 #2109

zj619 opened this issue Jun 18, 2024 · 2 comments
Labels
area/YARN colocate yarn with k8s kind/question Support request or question relating to Koordinator

Comments

@zj619
Copy link

zj619 commented Jun 18, 2024

如果用koordinator yarn跑实时流计算作业,怎么让流计算任务不被驱逐。目前观察到nm的pod里面有个koordinator.sh/qosClass: BE的配置,另一个是slo-controller-config的host-application-config里面有个qos为BE的配置,这两种有什么区别,怎样做才能满足koordinator yarn跑实时流计算作业不被驱逐?
f294f410cdd86dcef39903b1d1e172e1

What happened:

What you expected to happen:

Environment:

  • Koordinator version: - v1.4.0
  • Kubernetes version (use kubectl version): v1.22.3
  • docker/containerd version: containerd 1.5.0
  • OS (e.g: cat /etc/os-release): Ubuntu 20.04.4 LTS
  • Kernel (e.g. uname -a): Linux 5.10.112-11.al8.x86_64 ✨ Add NodeMetric API #1 SMP Tue May 24 16:05:50 CST 2022 x86_64 x86_64 x86_64 GNU/Linux

Anything else we need to know:

@zj619 zj619 added the kind/question Support request or question relating to Koordinator label Jun 18, 2024
@saintube saintube added the area/YARN colocate yarn with k8s label Jun 18, 2024
@saintube
Copy link
Member

PTAL /cc @zwzhang0107

@zwzhang0107
Copy link
Contributor

如开源例会讨论,YANR stream/batch混在一起和k8s混部,这种是不支持的;YARN stream单独和K8s部署不建议通过混部模式。
https://alidocs.dingtalk.com/document/edit?dontjump=true&type=d&dentryKey=paP7wO3nXFnLzMAa&docKey=oJGq769vBG4WnAKe

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/YARN colocate yarn with k8s kind/question Support request or question relating to Koordinator
Projects
None yet
Development

No branches or pull requests

3 participants