Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KEP-2170: Rename TrainingRuntimeRef to RuntimeRef API #2283

Merged
merged 2 commits into from
Oct 17, 2024

Conversation

andreyvelich
Copy link
Member

Related: #2170

Since this PR introduced ability to register custom runtimes: #2248, we decided to rename the API from TrainingRuntimeRef to RuntimeRef in TrainJob.

In the future, we are planning to support custom user runtimes (e.g. Slurm, Flux, etc.) that might use their own CRDs to orchestrate K8s resources.
The RuntimeRef API gives us more flexibility in the future and not confuse users that only TrainingRuntime and ClusterTrainingRuntime CRDs can be used.

/assign @kubeflow/wg-training-leads
/cc @ahg-g @kannon92 @danielvegamyhre @vsoch

Copy link

@andreyvelich: GitHub didn't allow me to request PR reviews from the following users: ahg-g, kannon92, danielvegamyhre, vsoch.

Note that only kubeflow members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

Related: #2170

Since this PR introduced ability to register custom runtimes: #2248, we decided to rename the API from TrainingRuntimeRef to RuntimeRef in TrainJob.

In the future, we are planning to support custom user runtimes (e.g. Slurm, Flux, etc.) that might use their own CRDs to orchestrate K8s resources.
The RuntimeRef API gives us more flexibility in the future and not confuse users that only TrainingRuntime and ClusterTrainingRuntime CRDs can be used.

/assign @kubeflow/wg-training-leads
/cc @ahg-g @kannon92 @danielvegamyhre @vsoch

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
@andreyvelich andreyvelich force-pushed the v2-rename-runtime-ref branch from 622f134 to b0719cb Compare October 17, 2024 17:19
Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
@coveralls
Copy link

Pull Request Test Coverage Report for Build 11389967973

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 100.0%

Totals Coverage Status
Change from base Build 11389726196: 0.0%
Covered Lines: 73
Relevant Lines: 73

💛 - Coveralls

Copy link
Member

@tenzen-y tenzen-y left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!
/lgtm
/approve
/hold for CI

Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: tenzen-y

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@tenzen-y
Copy link
Member

All green.
/hold cancel

@google-oss-prow google-oss-prow bot merged commit 6965c1a into kubeflow:master Oct 17, 2024
41 checks passed
@andreyvelich andreyvelich deleted the v2-rename-runtime-ref branch October 17, 2024 18:47
saileshd1402 pushed a commit to saileshd1402/training-operator that referenced this pull request Dec 2, 2024
* KEP-2170: Rename TrainingRuntimeRef to RuntimeRef API

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Rename RuntimeRef in runtime framework

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>
google-oss-prow bot pushed a commit that referenced this pull request Dec 9, 2024
* Added test for create-pytorchjob.ipynb

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* fix yaml syntax

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Fix uses path

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add actions/checkout

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add bash to action.yaml

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Install pip dependencies step

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add quotes for args

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add jupyter

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add nbformat_minor: 5 to fix invalid format error

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Fix job name

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* test papermill-args-yaml

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* testing multi line args

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* testing multi line args1

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* testing multi line args2

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* testing multi line args3

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Parameterize sdk install

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Remove unnecessary output

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* nbformat normailze

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [SDK] Training Client Conditions related unit tests (#2253)

* test: add unit test for get_job_conditions function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: add unit test for is_job_created function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: add unit test for is_job_running function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: add unit test for is_job_restarting function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: add unit test for is_job_failed function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: add unit test for is_job_succeded function of training client

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

* test: improve job condition unit tests efficiency

Signed-off-by: Bobbins228 <mcampbel@redhat.com>

---------

Signed-off-by: Bobbins228 <mcampbel@redhat.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [SDK] test: add unit test for list_jobs method of the training_client (#2267)

Signed-off-by: wei-chenglai <qazwsx0939059006@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Generate clientset, openapi spec for the V2 APIs (#2273)

Generate clientset, informers, listers and open api spec
for v2alpha1 APIs.

Signed-off-by: Varsha Prasad Narsing <varshaprasad96@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [SDK] Use torchrun to create PyTorchJob from function (#2276)

* [SDK] Use torchrun to create PyTorchJob from function

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update PyTorchJob SDK example

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add consts for entrypoint

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add check for num procs per worker

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [SDK] test: add unit test for get_job_logs method of the training_client (#2275)

Signed-off-by: wei-chenglai <qazwsx0939059006@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [v2alpha] Move GV related codebase (#2281)

Move GV related codebase in v2alpha

Signed-off-by: Varsha Prasad Narsing <varshaprasad96@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Implement runtime framework (#2248)

* KEP-2170: Implement runtime framework interfaces

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Remove grep dependency

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* KEP-2170: Implement ValidateObjects interface to the runtime framework

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* KEP-2170: Expose the TrainingRuntime and ClusterTrainingRuntime Kind

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* KEP-2170: Remove unneeded scheme field from the internal TrainingRuntime

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Rephrase the error message

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Distinguish TrainingRuntime and ClusterTrainingRuntime when creating indexes for the TrainJobs

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Propagate the TrainJob labels and annotations to the JobSet

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Remove PodAnnotations from the runtime info

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Implement TrainingRuntime ReplicatedJob validation

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Add TODO comments

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Replace queueSuspendedTrainJob with queueSuspendedTrainJobs

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

---------

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add DeepSpeed Example with Pytorch Operator (#2235)

Signed-off-by: Syulin7 <735122171@qq.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Rename TrainingRuntimeRef to RuntimeRef API (#2283)

* KEP-2170: Rename TrainingRuntimeRef to RuntimeRef API

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Rename RuntimeRef in runtime framework

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Adding CEL validations on v2 TrainJob CRD (#2260)

Signed-off-by: Akshay Chitneni <achitneni@apple.com>
Co-authored-by: Akshay Chitneni <achitneni@apple.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Upgrade Deepspeed demo dependencies (#2294)

Signed-off-by: Syulin7 <735122171@qq.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Add manifests for Kubeflow Training V2 (#2289)

* KEP-2170: Add manifests for Kubeflow Training V2

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix invalid name for webhook config in cert

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix integration tests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Move kubebuilder markers to runtime framework

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Use Kubernetes recommended labels

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* FSDP Example for T5 Fine-Tuning and PyTorchJob (#2286)

* FSDP Example with PyTorchJob and T5 Fine-Tuning

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Modify text

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Implement TrainJob Reconciler to manage objects (#2295)

* KEP-2170: Implement TrainJob Reconciler to manage objects

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Mode dep-crds to manifests/external-crds

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Rename run with runtime

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

---------

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Remove Prometheus Monitoring doc (#2301)

Signed-off-by: Sophie <sophy010017@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Decouple JobSet from TrainJob (#2296)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Strictly verify the CRD marker validation and defaulting in the integration testings (#2304)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Initialize runtimes before the manager starts (#2306)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Generate Python SDK for Kubeflow Training V2 (#2310)

* Generate SDK models for the Training V2 APIs

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Create pyproject.toml config

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove comments

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix pre-commit

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Create model and dataset initializers (#2303)

* KEP-2170: Create model and dataset initializers

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add abstract classes

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add storage URI to config

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update .gitignore

Co-authored-by: Kevin Hannon <kehannon@redhat.com>
Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix the misspelling for initializer

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add .pt and .pth to ignore_patterns

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Co-authored-by: Kevin Hannon <kehannon@redhat.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Implement JobSet, PlainML, and Torch Plugins (#2308)

* KEP-2170: Implement JobSet and PlainML Plugins

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix nil pointer exception for Trainer

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix unit tests in runtime package

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix unit tests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix integration tests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix lint

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Implement Torch Plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Use list for the Info envs

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix golang ci

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Fix Torch plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Use K8s sets
Update error return
Use ptr.Deref() for nil values

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Use client.Object for Build() call

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove DeepCopy

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove MLPolicy and PodGroupPolicy from the Info object

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Inline error

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove SDK jar file

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add integration test for Torch plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add TODO to calculate PodGroup values in unit tests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Revert the change to add original Runtime Policies to Info

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Create const for the DefaultJobReplicas

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Check if PodLabels is empty

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Implement Initializer builders in the JobSet plugin  (#2316)

* KEP-2170: Implement Initializer builder in the JobSet plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update the SDK models

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove Info from Initializer builder

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update manifests

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update pkg/constants/constants.go

Co-authored-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Use var for envs

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove check manifests from GitHub actions

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Move consts to JobSet plugin

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Co-authored-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Add the TrainJob state transition design (#2298)

* KEP-2170: Add the TrainJob state transition design

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Replace actual jobs with TrainJob

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Remove the JobSet conditions propagation and Add expanding runtime framework interfaces for each plugin

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Expand the Creation Failed reasons

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Rename Completed to Complete

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

---------

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Update tf job examples to tf v2 (#2270)

* mnist with summaries updaetd to TF v2

Signed-off-by: yelias <yossi.elias@nokia.com>

* tf_sample updaetd to TF v2

Signed-off-by: yelias <yossi.elias@nokia.com>

* Add mnist_utils and update dist-mnist

Signed-off-by: yelias <yossi.elias@nokia.com>

* Add mnist_utils and update dist-mnist

Signed-off-by: yelias <yossi.elias@nokia.com>

* Remove old example - estimator-API, this example has been replaced by distribution_strategy

Signed-off-by: yelias <yossi.elias@nokia.com>

* Small fix

Signed-off-by: yelias <yossi.elias@nokia.com>

* Remove unsupported powerPC dockerfiles

Signed-off-by: yelias <yossi.elias@nokia.com>

* Fix typo in copyright

Signed-off-by: yelias <yossi.elias@nokia.com>

---------

Signed-off-by: yelias <yossi.elias@nokia.com>
Co-authored-by: yelias <yossi.elias@nokia.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Add TrainJob conditions (#2322)

* KEP-2170: Implement TrainJob conditions

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Fix API comments

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Make condition message constants

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

* Stop connecting condition type and reason in JobSet plugin

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>

---------

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Pin Gloo repository in JAX Dockerfile to a specific commit (#2329)

This commit pins the Gloo repository to a specific commit (43b7acbf) in
the JAX Dockerfile to prevent build failures caused by a recent bug
introduced in the Gloo codebase. By locking the version of Gloo to
a known working commit, we ensure that the JAX build remains stable and
functional until the issue is resolved upstream.

The build failure occurs when compiling the gloo/transport/tcp/buffer.cc
file due to an undefined __NR_gettid constant, which was introduced
after the pinned commit. By using this commit, we bypass the issue and
allow the build to complete successfully.

Signed-off-by: Sandipan Panda <samparksandipan@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* [fix] Resolve v2alpha API exceptions (#2317)

Resolve v2alpha API exceptions by adding necessary listType validations.

Signed-off-by: Varsha Prasad Narsing <varshaprasad96@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Upgrade Kubernetes to v1.30.7 (#2332)

* Upgrade Kubernetes to v1.30.7

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>

* Use typed event handlers and predicates in job controllers

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>

* Re-organize pkg/common/util/reconciler.go

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>

* Update installation instructions in README

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>

---------

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Ignore cache exporting errors in the image building workflows (#2336)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* KEP-2170: Add Torch Distributed Runtime (#2328)

* KEP-2170: Add Torch Distributed Runtime

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Add pip list

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Refine the server-side apply installation args (#2337)

Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add openapi-generator CLI option to skip SDK v2 test generation (#2338)

Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Upgrade kustomization files to Kustomize v5 (#2326)

Signed-off-by: oksanabaza <obazylie@redhat.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Pin accelerate package version in trainer (#2340)

* Pin accelerate package version in trainer

Signed-off-by: Gavrish Prabhu <gavrish.prabhu@nutanix.com>

* include new line to pass pre-commit hook

Signed-off-by: Gavrish Prabhu <gavrish.prabhu@nutanix.com>

---------

Signed-off-by: Gavrish Prabhu <gavrish.prabhu@nutanix.com>
Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Replace papermill command with bash script

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Typo fix

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Move Checkout step outside action.yaml file

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Add newline EOF in script

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Pass python dependencies as args and pin versions

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Update Usage

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Install dependencies in yaml

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* fix ipynb

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* set bash flags

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* Update script args and add more kubernetes versions for tests

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* add gang-scheduler-name to  template

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* move go setup to template

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

* remove -p parameter from script

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>

---------

Signed-off-by: sailesh duddupudi <saileshradar@gmail.com>
Signed-off-by: Bobbins228 <mcampbel@redhat.com>
Signed-off-by: wei-chenglai <qazwsx0939059006@gmail.com>
Signed-off-by: Varsha Prasad Narsing <varshaprasad96@gmail.com>
Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Signed-off-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Signed-off-by: Syulin7 <735122171@qq.com>
Signed-off-by: Akshay Chitneni <achitneni@apple.com>
Signed-off-by: Sophie <sophy010017@gmail.com>
Signed-off-by: yelias <yossi.elias@nokia.com>
Signed-off-by: Sandipan Panda <samparksandipan@gmail.com>
Signed-off-by: Antonin Stefanutti <antonin@stefanutti.fr>
Signed-off-by: oksanabaza <obazylie@redhat.com>
Signed-off-by: Gavrish Prabhu <gavrish.prabhu@nutanix.com>
Co-authored-by: Mark Campbell <mcampbel@redhat.com>
Co-authored-by: Wei-Cheng Lai <qazwsx0939059006@gmail.com>
Co-authored-by: Varsha <varshaprasad96@gmail.com>
Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Co-authored-by: Yuki Iwai <yuki.iwai.tz@gmail.com>
Co-authored-by: yu lin <735122171@qq.com>
Co-authored-by: Akshay Chitneni <akshayadatta@gmail.com>
Co-authored-by: Akshay Chitneni <achitneni@apple.com>
Co-authored-by: Sophie Hsu <112261858+sophie0730@users.noreply.github.com>
Co-authored-by: Kevin Hannon <kehannon@redhat.com>
Co-authored-by: YosiElias <73485442+YosiElias@users.noreply.github.com>
Co-authored-by: yelias <yossi.elias@nokia.com>
Co-authored-by: Sandipan Panda <87253083+sandipanpanda@users.noreply.github.com>
Co-authored-by: Antonin Stefanutti <astefanutti@users.noreply.github.com>
Co-authored-by: Oksana Bazylieva <61097730+oksanabaza@users.noreply.github.com>
Co-authored-by: Gavrish Prabhu <gavrish.prabhu@nutanix.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants