Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

<auto_select_gpus=True, gpus=-1> raise MisconfigurationException("GPUs requested but none are available.") #4207

Closed
ssaru opened this issue Oct 17, 2020 · 0 comments · Fixed by #4209
Closed

<auto_select_gpus=True, gpus=-1> raise MisconfigurationException("GPUs requested but none are available.") #4207

ssaru opened this issue Oct 17, 2020 · 0 comments · Fixed by #4209
Labels
bug Something isn't working help wanted Open to be worked on
Milestone
pl:1.0.x

Comments

@ssaru
Copy link
Contributor

ssaru commented Oct 17, 2020 •
edited
Loading

🐛 Bug

auto_select_gpus

if auto_select_gpus enabled and gpus is an integer, pick available gpus automatically.

but, if you set gpus is -1, raise MisconfigurationException("GPUs requested but none are available.")

Please reproduce using [the BoringModel and post here]

bug_auto_select_gpus

Expected behavior

pick all gpus

Environment

  • CUDA:
    • GPU:
      • Quadro RTX 6000
    • available: True
    • version: 10.1
  • Packages:
    • numpy: 1.19.2
    • pyTorch_debug: False
    • pyTorch_version: 1.6.0+cu101
    • pytorch-lightning: 0.9.0
    • tqdm: 4.50.2
  • System:

Additional context

(cc. @inmoonlight)
@ssaru ssaru added bug Something isn't working help wanted Open to be worked on labels Oct 17, 2020
@ssaru ssaru mentioned this issue Oct 17, 2020
Merged
7 tasks
@edenlightning edenlightning added this to the 1.0.3 milestone Oct 19, 2020
SkafteNicki added a commit that referenced this issue Oct 29, 2020
@ssaru @tchaton
@s-rog @SkafteNicki
fix: nb is set total number of devices, when nb is -1. (#4209)
b459fd2 
* fix: `nb` is set total number of devices, when nb is -1.

 Refs: #4207

* feat: add test code
     1. test combination `auto_select_gpus`, `gpus` options using
Trainer
     2. test `pick_multiple_gpus` function directly

Refs: #4207

* docs: modify contents in `Select GPU devices`

 Refs: #4207

* refactore: reflect the reuslt of review

 Refs: #4207

* refactore: reflect the reuslt of review

 Refs: #4207

* Update CHANGELOG.md

Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Roger Shieh <55400948+s-rog@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Borda pushed a commit that referenced this issue Nov 4, 2020
@ssaru @Borda
fix: nb is set total number of devices, when nb is -1. (#4209)
d3a818b 
* fix: `nb` is set total number of devices, when nb is -1.

 Refs: #4207

* feat: add test code
     1. test combination `auto_select_gpus`, `gpus` options using
Trainer
     2. test `pick_multiple_gpus` function directly

Refs: #4207

* docs: modify contents in `Select GPU devices`

 Refs: #4207

* refactore: reflect the reuslt of review

 Refs: #4207

* refactore: reflect the reuslt of review

 Refs: #4207

* Update CHANGELOG.md

Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Roger Shieh <55400948+s-rog@users.noreply.github.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
(cherry picked from commit b459fd2)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working help wanted Open to be worked on
Projects
None yet
Milestone
pl:1.0.x
Development

Successfully merging a pull request may close this issue.

fix: nb is set total number of devices, when nb is -1.
2 participants
@ssaru @edenlightning