Skip to content
/ torchx Public

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

License

Notifications You must be signed in to change notification settings

pytorch/torchx

Folders and files

NameName
Last commit message
Last commit date

Latest commit

7254961 · Feb 18, 2025
Dec 10, 2024
Oct 9, 2024
Jul 3, 2024
Jun 4, 2024
Sep 10, 2022
Mar 27, 2024
Feb 18, 2025
May 15, 2022
Oct 11, 2021
Jul 14, 2022
May 25, 2021
Oct 1, 2021
May 7, 2024
Nov 26, 2024
Dec 13, 2021
May 20, 2022
May 25, 2021
Jul 16, 2024
May 5, 2021
Mar 27, 2024
Apr 3, 2023
May 30, 2024
Dec 11, 2024
Nov 16, 2024
Mar 27, 2024
Mar 26, 2024
Nov 2, 2023

Repository files navigation

PyPI License Tests Lint codecov

TorchX

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.

TorchX currently supports:

  • Kubernetes (EKS, GKE, AKS, etc)
  • Slurm
  • AWS Batch
  • Docker
  • Local
  • Ray (prototype)
  • GCP Batch (prototype)

Need a scheduler not listed? Let us know!

Quickstart

See the quickstart guide.

Documentation

Requirements

torchx:

  • python3 (3.8+)
  • PyTorch
  • optional: Docker (needed for docker based schedulers)

Certain schedulers may require scheduler specific requirements. See installation for info.

Installation

Stable

# install torchx sdk and CLI -- minimum dependencies
pip install torchx

# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"

# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"

# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"

# install torchx Ray support
pip install "torchx[ray]"

# install torchx GCP Batch support
pip install "torchx[gcp_batch]"

Nightly

# install torchx sdk and CLI
pip install torchx-nightly[dev]

Source

# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx

# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]

Docker

TorchX provides a docker container for using as as part of a TorchX role.

See: https://github.com/pytorch/torchx/pkgs/container/torchx

Contributing

We welcome PRs! See the CONTRIBUTING file.

License

TorchX is BSD licensed, as found in the LICENSE file.