Skip to content

Commit

Permalink
(vllm) New versions
Browse files Browse the repository at this point in the history
  • Loading branch information
sasha0552 authored Nov 16, 2024
1 parent 07694fe commit 4401dd2
Show file tree
Hide file tree
Showing 3 changed files with 89 additions and 3 deletions.
43 changes: 43 additions & 0 deletions .github/workflows/vllm-pascal-0.6.4.post1.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
name: "[X] Build vLLM (v0.6.4.post1)"

jobs:
build:
runs-on: ubuntu-latest

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Build vLLM wheels
uses: ./.github/actions/build-vllm
with:
ghcr_token: ${{ secrets.GHCR_TOKEN }}
ref: v0.6.4.post1

publish:
needs: build
runs-on: ubuntu-latest

permissions:
contents: write

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Publish wheels
uses: ./.github/actions/common/publish-wheels
with:
prefix: vllm_pascal-0.6.4.post1+

update-index:
needs: publish
secrets: inherit
uses: ./.github/workflows/zz-update-index.yml

permissions:
id-token: write
pages: write

on:
workflow_dispatch:
43 changes: 43 additions & 0 deletions .github/workflows/vllm-pascal-0.6.4.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
name: "[X] Build vLLM (v0.6.4)"

jobs:
build:
runs-on: ubuntu-latest

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Build vLLM wheels
uses: ./.github/actions/build-vllm
with:
ghcr_token: ${{ secrets.GHCR_TOKEN }}
ref: v0.6.4

publish:
needs: build
runs-on: ubuntu-latest

permissions:
contents: write

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Publish wheels
uses: ./.github/actions/common/publish-wheels
with:
prefix: vllm_pascal-0.6.4+

update-index:
needs: publish
secrets: inherit
uses: ./.github/workflows/zz-update-index.yml

permissions:
id-token: write
pages: write

on:
workflow_dispatch:
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

The main repository for building Pascal-compatible versions of ML applications and libraries.

1. vLLM `0.5.5`, `0.6.0`, `0.6.1`, `0.6.1.post1`, `0.6.1.post`, `0.6.2`, `0.6.3`, `0.6.3.post1` and `main` (nightly, updates daily) are available in this repository.
1. vLLM `0.5.5`, `0.6.0`, `0.6.1`, `0.6.1.post1`, `0.6.1.post`, `0.6.2`, `0.6.3`, `0.6.3.post1`, `0.6.4`, `0.6.4.post1` and `main` (nightly, updates daily) are available in this repository.
2. Triton `2.2.0`, `2.3.0`, `2.3.1`, `3.0.0`, `3.1.0` are available in this repository.

> [!IMPORTANT]
Expand All @@ -15,7 +15,7 @@ The main repository for building Pascal-compatible versions of ML applications a

```sh
# Pull the vLLM image
docker pull ghcr.io/sasha0552/vllm:v0.6.3.post1 # you can omit the version specifier
docker pull ghcr.io/sasha0552/vllm:v0.6.4.post1 # you can omit the version specifier
# to install nightly version

# You can now follow the official vLLM documentation.
Expand Down Expand Up @@ -72,7 +72,7 @@ python -m venv venv
source venv/bin/activate
# Install vLLM
pip3 install vllm-pascal==0.6.3.post1 # you can omit the version specifier
pip3 install vllm-pascal==0.6.4.post1 # you can omit the version specifier
# to install nightly version
# Install patched triton
Expand Down

0 comments on commit 4401dd2

Please sign in to comment.