Skip to content

Commit

Permalink
fix(CI): added HF_TOKEN to use models that require it
Browse files Browse the repository at this point in the history
Also manually install accelerate to avoid memory issues when loading
gemma.
  • Loading branch information
tengomucho committed Mar 13, 2024
1 parent 0a085a6 commit c342e4f
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion .github/workflows/test-pytorch-xla-tpu-tgi.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,4 +32,6 @@ jobs:
run: python -c "import torch_xla.core.xla_model as xm; assert xm.xla_device().type == 'xla', 'XLA device not available'"

- name: Build and test TGI server
run: make tgi_test
run: |
pip install accelerate==0.27.2
HF_TOKEN=${{ secrets.HF_TOKEN_OPTIMUM_TPU_CI }} make tgi_test

0 comments on commit c342e4f

Please sign in to comment.