Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA OOM error #861

Open
nautics889 opened this issue Nov 6, 2024 · 0 comments
Open

CUDA OOM error #861

nautics889 opened this issue Nov 6, 2024 · 0 comments

Comments

@nautics889
Copy link

nautics889 commented Nov 6, 2024

It seems like something tried to eat all of my memory.

When trying to run via inference_realesrgan.py.
A command to run:

(real-esrgan) PS C:\Users\***\Real-ESRGAN> python .\inference_realesrgan.py -n RealESRGAN_x4plus_anime_6B.pth -i input.jpg -o .\output\

Produced output:

...

100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 17.1M/17.1M [00:01<00:00, 10.7MB/s]
Testing 0 02
Error CUDA out of memory. Tried to allocate 110.72 GiB (GPU 0; 8.00 GiB total capacity; 28.49 GiB already allocated; 0 bytes free; 29.31 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
If you encounter CUDA out of memory, try to set --tile with a smaller number.
Testing 1 03

It works ok via ncnn-vulkan though, so I just keep using it, I'm just curious about this error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant