CUDA out of memory
#403
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
I just got an A100 gpu and when I finaly ran the stable-zero I got this error:
CUDA out of memory. Tried to allocate 310.00 MiB. GPU 0 has a total capacity of 39.56 GiB of which 108.81 MiB is free. Process 305661 has 39.45 GiB memory in use. Of the allocated memory 33.29 GiB is allocated by PyTorch, and 1.22 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
Beta Was this translation helpful? Give feedback.
All reactions