Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows/Linux - Install no cuda stuff, cpu only for tf and torch #293

Merged
merged 2 commits into from
May 20, 2024

Conversation

julesvanrie
Copy link
Contributor

Setup on Windows and Ubuntu takes ages because we install gpu enabled versions of tensorflow and torch, while very few students have a gpu. Especially knowing that torch is only there for the Transformers day.

  • Use tensorflow-cpu
  • Specify wheel location for torch so it downloads a cpu versions
  • Remove all unnecessary nvidia-cu... packages

This reduces the virtualenv size with 4 Gb!

9.4G	./lewagon
5.4G	./lwlight

Fixes #285

julesvanrie and others added 2 commits May 18, 2024 17:57
Setup on Windows and Ubuntu takes ages because we install gpu enabled versions of tensorflow and torch, while very few students have a gpu. Especially knowing that torch is only there for the Transformers day.

- Use tensorflow-cpu
- Specify wheel location for torch so it downloads a cpu versions
- Remove all unnecessary nvidia-cu... packages

This reduces the virtualenv size with 4 Gb!
```bash
9.4G	./lewagon
5.4G	./lwlight
```
@julesvanrie
Copy link
Contributor Author

Tested this both on Windows and native Ubuntu:

  • setup runs correctly
  • My first transformer challenge works correctly

@julesvanrie julesvanrie merged commit 8518a99 into master May 20, 2024
@julesvanrie julesvanrie deleted the no-cuda-for-ubuntu branch May 20, 2024 08:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Installing requirements on windows/linux takes a huge time due to nvidia stuff
2 participants