Skip to content

Commit

Permalink
Modify LLM Trainer to support BERT and Tiny LLaMA (#2031)
Browse files Browse the repository at this point in the history
* Modify LLM Trainer to support BERT and Tiny LLaMA

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Access PVC access modes to storage config

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Format Python files

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Distribute datasets

Fix access modes in storage config

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Update example to fine tune BERT with Train API

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

* Remove dataset download twice

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>

---------

Signed-off-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
  • Loading branch information
andreyvelich authored Mar 15, 2024
1 parent 8433edc commit bb8bba0
Show file tree
Hide file tree
Showing 16 changed files with 1,073 additions and 792 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/test-python.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
- name: Check Python code with Black
uses: psf/black@stable
with:
version: 23.9.1
version: 24.2.0
options: --check --exclude '/*kubeflow_org_v1*|__init__.py|api_client.py|configuration.py|exceptions.py|rest.py'
src: sdk/

Expand Down
Loading

0 comments on commit bb8bba0

Please sign in to comment.